Orbiter History

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 748.933244ms FAIL (2025-08-14 23:29:50 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": remote error: tls: internal error Duration: 748.967899ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.........................X.......X..................X.......] duration: 1.837972504s FAIL (2025-08-14 23:29:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 23:23:25.708535090 (149h57m20.139615221s) [upload=155967]: Starting upload Aug 14 23:23:25.708582129 (149h57m20.13966226s) [upload=155967]: Done starting upload Aug 14 23:23:25.708683684 (149h57m20.139763825s) [upload=155967]: Uploading segments... Aug 14 23:23:25.708784046 (149h57m20.139864177s) [upload=155967]: Got next segment. Inline: true Aug 14 23:23:25.708791670 (149h57m20.139871791s) [upload=155967]: Waiting for error group managing segments... Aug 14 23:23:25.708833912 (149h57m20.139914043s) [upload=155967]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 23:23:25.708838921 (149h57m20.139919052s) [upload=155967]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 23:23:25.708841696 (149h57m20.139921827s) [upload=155967]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 23:23:25.923862328 (149h57m20.354942459s) [upload=155967]: Done uploading segments... Aug 14 23:23:25.923880343 (149h57m20.354960464s) [upload=155967]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.838000047s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 731.853414ms FAIL (2025-08-14 23:29:14 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": remote error: tls: internal error Duration: 731.881597ms edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 16 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXX............................................] duration: 6.351742808s FAIL (2025-08-14 23:29:04 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.351770249s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [................................X.............X....X..X.....] duration: 5.919097447s FAIL (2025-08-14 23:28:55 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 14 23:25:23.865082679 (149h59m18.29616281s) [upload=156000]: Starting upload Aug 14 23:25:23.865134989 (149h59m18.29621512s) [upload=156000]: Done starting upload Aug 14 23:25:23.865241213 (149h59m18.296321344s) [upload=156000]: Uploading segments... Aug 14 23:25:23.865391189 (149h59m18.29647132s) [upload=156000]: Got next segment. Inline: false Aug 14 23:25:23.865430435 (149h59m18.296510566s) [upload=156000]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 23:25:23.865434993 (149h59m18.296515114s) [upload=156000]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 23:25:24.427593929 (149h59m18.85867406s) [seg_pos={0 0}, upload=156000]: Begin upload segment... Aug 14 23:25:24.427659504 (149h59m18.858739635s) [seg_pos={0 0}, upload=156000]: Done begin upload segment. Aug 14 23:25:24.427681045 (149h59m18.858761167s) [noise=true , address=77.90.31.12:4594 , piece_id=PVTRB6VZG4GCAP44UDAKKP2VF4TN2ODKEBATJT7EYR2KD7EOQVMA, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.427712806 (149h59m18.858792937s) [noise=true , address=77.90.31.18:4809 , piece_id=TFDTIW6CWJXTN3KKGJTIACJT4ZXCSRAE4CM2W25BWPRLLGZI5UGA, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.428058338 (149h59m18.859138469s) [noise=true , address=79.127.219.48:4076 , piece_id=2MQMWXT5523NS5PYGDCQ4Z22CJ23KCN3S3UPCS7WI6TMU6X355CA, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.428321260 (149h59m18.859401391s) [noise=true , address=104.36.82.3:4796 , piece_id=5JBUWYKUBQHHBR2A7BZJOCN7HEQJKQ6FX3MWQS55QI7LGUH5PKSA, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.428582981 (149h59m18.859663112s) [noise=true , address=104.36.82.62:4436 , piece_id=5RTH5H3PD755UV2XLIRW5CNMDCZY6VCOTIKNZF7IMVMFDV5CQLQQ, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.428780519 (149h59m18.85986064s) [noise=true , address=104.36.82.44:4889 , piece_id=H2KS4DZ6I5UZ42TNCNXTPGYU573Q2KB45OBK3MTNP32H4Q2ILUDQ, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.428928291 (149h59m18.860008423s) [noise=true , address=104.36.82.34:4570 , piece_id=KUK5NYXHUA46Y3MZYC5USNVRSKUF6PLK5GSUPLWXRQXSECIOXLSQ, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.429112424 (149h59m18.860192555s) [noise=true , address=104.36.82.21:4494 , piece_id=3EU3EVA4ESIIUW5MVSAJEV5BP6GYIF4YSYFANMPU3H6EYD7M3HQQ, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.429144285 (149h59m18.860224406s) [noise=true , address=77.90.31.19:4851 , piece_id=RWQ6L76GA66LIVEHAYGU7SWE7T2LC6GGZ6NQJVTGHVZ76CA6X3EQ, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.429170645 (149h59m18.860250776s) [noise=true , address=104.36.82.15:4290 , piece_id=AM4FQ7FJUUI5LTV4RIETMT6MW5CS6V35B5QN52SDXKW5OD5YKFAQ, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.429384725 (149h59m18.860464856s) [noise=true , address=104.36.82.38:4707 , piece_id=6W3I4M7OO56SXQ6737N5LYU6EKXC3FOKJBDSS4XFRIWLFTTNGQMQ, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.429432106 (149h59m18.860512227s) [noise=true , address=79.127.201.215:4347 , piece_id=FULXIVH2YVM3AVFF33XJFMEJK2QAM7EA6WS6I5X7XPT4TR7YQDYA, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.429593535 (149h59m18.860673666s) [noise=true , address=104.36.82.46:4495 , piece_id=XNRCALQ6NSXEBUV7Z25OQ2E4DLDREK3XQKCNHZH3YWXA4OFIPVPA, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.429704938 (149h59m18.860785059s) [noise=true , address=104.36.82.60:4365 , piece_id=7WYNE5TBGOJM5R7MVCIZ7CDG5737XZGVMQRSFSPCVEWHRGSY3XMQ, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.429992358 (149h59m18.861072489s) [noise=true , address=104.36.82.51:4063 , piece_id=OBDG6K567SOAA2DERKZP4GSZERTUHRJEI7BJ4MIVL3JHPNMVJG4Q, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.430255922 (149h59m18.861336053s) [noise=true , address=77.90.31.21:4891 , piece_id=WK3MWAOBT4BQT5VA36KBN2RWUT5JVHBFPXTSZSRIH6J2HRSJW4IQ, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.430549503 (149h59m18.861629624s) [noise=true , address=104.36.82.59:4302 , piece_id=SFCJYOAJKPT26MASF3X4NYUHLV4HYCHPKCJUV2BWBH2TKC3RIVRA, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.430809041 (149h59m18.861889172s) [noise=true , address=45.91.116.9:4266 , piece_id=R6LXPDABDOXCMIFF2PV43BSKRBH4KXPLCGPZ3DU3H7HL66WWYWNQ, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:25.923497549 (149h59m20.35457768s) [upload=156000]: Next returned nil segment Aug 14 23:25:25.923507829 (149h59m20.35458795s) [upload=156000]: Waiting for error group managing segments... Aug 14 23:25:26.337042342 (149h59m20.768122463s) [noise=true , address=79.127.219.48:4076 , piece_id=2MQMWXT5523NS5PYGDCQ4Z22CJ23KCN3S3UPCS7WI6TMU6X355CA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.350688071 (149h59m20.781768202s) [noise=true , address=77.90.31.21:4891 , piece_id=WK3MWAOBT4BQT5VA36KBN2RWUT5JVHBFPXTSZSRIH6J2HRSJW4IQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.367283975 (149h59m20.798364106s) [noise=true , address=104.36.82.59:4302 , piece_id=SFCJYOAJKPT26MASF3X4NYUHLV4HYCHPKCJUV2BWBH2TKC3RIVRA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.392847758 (149h59m20.823927889s) [noise=true , address=79.127.201.215:4347 , piece_id=FULXIVH2YVM3AVFF33XJFMEJK2QAM7EA6WS6I5X7XPT4TR7YQDYA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.476671684 (149h59m20.907751805s) [noise=true , address=104.36.82.34:4570 , piece_id=KUK5NYXHUA46Y3MZYC5USNVRSKUF6PLK5GSUPLWXRQXSECIOXLSQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.477883863 (149h59m20.908963994s) [noise=true , address=104.36.82.51:4063 , piece_id=OBDG6K567SOAA2DERKZP4GSZERTUHRJEI7BJ4MIVL3JHPNMVJG4Q, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.495071439 (149h59m20.92615157s) [noise=true , address=77.90.31.12:4594 , piece_id=PVTRB6VZG4GCAP44UDAKKP2VF4TN2ODKEBATJT7EYR2KD7EOQVMA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.499490865 (149h59m20.930571016s) [noise=true , address=104.36.82.3:4796 , piece_id=5JBUWYKUBQHHBR2A7BZJOCN7HEQJKQ6FX3MWQS55QI7LGUH5PKSA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.534749478 (149h59m20.965829599s) [noise=true , address=104.36.82.62:4436 , piece_id=5RTH5H3PD755UV2XLIRW5CNMDCZY6VCOTIKNZF7IMVMFDV5CQLQQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.567397536 (149h59m20.998477667s) [noise=true , address=77.90.31.19:4851 , piece_id=RWQ6L76GA66LIVEHAYGU7SWE7T2LC6GGZ6NQJVTGHVZ76CA6X3EQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.581324884 (149h59m21.012405015s) [noise=true , address=104.36.82.60:4365 , piece_id=7WYNE5TBGOJM5R7MVCIZ7CDG5737XZGVMQRSFSPCVEWHRGSY3XMQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.600511545 (149h59m21.031591676s) [noise=true , address=104.36.82.46:4495 , piece_id=XNRCALQ6NSXEBUV7Z25OQ2E4DLDREK3XQKCNHZH3YWXA4OFIPVPA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.602312732 (149h59m21.033392863s) [noise=true , address=77.90.31.18:4809 , piece_id=TFDTIW6CWJXTN3KKGJTIACJT4ZXCSRAE4CM2W25BWPRLLGZI5UGA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.614279168 (149h59m21.045359299s) [noise=true , address=45.91.116.9:4266 , piece_id=R6LXPDABDOXCMIFF2PV43BSKRBH4KXPLCGPZ3DU3H7HL66WWYWNQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.614295228 (149h59m21.045375359s) [seg_pos={0 0}, upload=156000]: Segment reached optimal threshold of 14 pieces. Aug 14 23:25:26.614385762 (149h59m21.045465893s) [noise=true , address=104.36.82.44:4889 , piece_id=H2KS4DZ6I5UZ42TNCNXTPGYU573Q2KB45OBK3MTNP32H4Q2ILUDQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PCtJRFHPHi1dHJNcRnGZg8HZPQDfo5L3aw6DgVnUzVUz92Kyv): protocol: expected piece hash; context canceled; EOF Aug 14 23:25:26.614431238 (149h59m21.045511369s) [noise=true , address=104.36.82.15:4290 , piece_id=AM4FQ7FJUUI5LTV4RIETMT6MW5CS6V35B5QN52SDXKW5OD5YKFAQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FmG5i2o4BwJmdL9u2tqKGmTAUErivGEe63TbfDTPpBdELozfz): protocol: expected piece hash; context canceled; EOF Aug 14 23:25:26.614559364 (149h59m21.045639485s) [noise=true , address=104.36.82.21:4494 , piece_id=3EU3EVA4ESIIUW5MVSAJEV5BP6GYIF4YSYFANMPU3H6EYD7M3HQQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sRaMuQG18B5SfPpzxp5VWjrwe38SS38g4askmbURxU9tepJHi): protocol: expected piece hash; context canceled; EOF Aug 14 23:25:26.614656349 (149h59m21.04573647s) [noise=true , address=104.36.82.38:4707 , piece_id=6W3I4M7OO56SXQ6737N5LYU6EKXC3FOKJBDSS4XFRIWLFTTNGQMQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N7XaDABpimefP5xEz5Swk53fiZk4DTv5L8Hg5cNDgeG6gHP1T): protocol: write tcp 188.166.225.170:43504->104.36.82.38:4707: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 14 23:25:26.614687790 (149h59m21.045767921s) [seg_pos={0 0}, upload=156000]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 14 23:25:26.614759687 (149h59m21.045839818s) [upload=156000]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 14 23:25:26.614763564 (149h59m21.045843695s) [upload=156000]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 23:25:27.350074072 (149h59m21.781154203s) [upload=156000]: Done uploading segments... Aug 14 23:25:27.350115130 (149h59m21.781195261s) [upload=156000]: Upload finished. err: <nil> Duration: 5.919115001s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 764.332777ms FAIL (2025-08-14 23:28:50 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": remote error: tls: internal error Duration: 764.363006ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.................................X.............X....X..X....] duration: 6.515102244s FAIL (2025-08-14 23:28:34 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 14 23:25:23.865082679 (149h59m18.29616281s) [upload=156000]: Starting upload Aug 14 23:25:23.865134989 (149h59m18.29621512s) [upload=156000]: Done starting upload Aug 14 23:25:23.865241213 (149h59m18.296321344s) [upload=156000]: Uploading segments... Aug 14 23:25:23.865391189 (149h59m18.29647132s) [upload=156000]: Got next segment. Inline: false Aug 14 23:25:23.865430435 (149h59m18.296510566s) [upload=156000]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 23:25:23.865434993 (149h59m18.296515114s) [upload=156000]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 23:25:24.427593929 (149h59m18.85867406s) [seg_pos={0 0}, upload=156000]: Begin upload segment... Aug 14 23:25:24.427659504 (149h59m18.858739635s) [seg_pos={0 0}, upload=156000]: Done begin upload segment. Aug 14 23:25:24.427681045 (149h59m18.858761167s) [noise=true , address=77.90.31.12:4594 , piece_id=PVTRB6VZG4GCAP44UDAKKP2VF4TN2ODKEBATJT7EYR2KD7EOQVMA, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.427712806 (149h59m18.858792937s) [noise=true , address=77.90.31.18:4809 , piece_id=TFDTIW6CWJXTN3KKGJTIACJT4ZXCSRAE4CM2W25BWPRLLGZI5UGA, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.428058338 (149h59m18.859138469s) [noise=true , address=79.127.219.48:4076 , piece_id=2MQMWXT5523NS5PYGDCQ4Z22CJ23KCN3S3UPCS7WI6TMU6X355CA, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.428321260 (149h59m18.859401391s) [noise=true , address=104.36.82.3:4796 , piece_id=5JBUWYKUBQHHBR2A7BZJOCN7HEQJKQ6FX3MWQS55QI7LGUH5PKSA, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.428582981 (149h59m18.859663112s) [noise=true , address=104.36.82.62:4436 , piece_id=5RTH5H3PD755UV2XLIRW5CNMDCZY6VCOTIKNZF7IMVMFDV5CQLQQ, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.428780519 (149h59m18.85986064s) [noise=true , address=104.36.82.44:4889 , piece_id=H2KS4DZ6I5UZ42TNCNXTPGYU573Q2KB45OBK3MTNP32H4Q2ILUDQ, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.428928291 (149h59m18.860008423s) [noise=true , address=104.36.82.34:4570 , piece_id=KUK5NYXHUA46Y3MZYC5USNVRSKUF6PLK5GSUPLWXRQXSECIOXLSQ, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.429112424 (149h59m18.860192555s) [noise=true , address=104.36.82.21:4494 , piece_id=3EU3EVA4ESIIUW5MVSAJEV5BP6GYIF4YSYFANMPU3H6EYD7M3HQQ, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.429144285 (149h59m18.860224406s) [noise=true , address=77.90.31.19:4851 , piece_id=RWQ6L76GA66LIVEHAYGU7SWE7T2LC6GGZ6NQJVTGHVZ76CA6X3EQ, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.429170645 (149h59m18.860250776s) [noise=true , address=104.36.82.15:4290 , piece_id=AM4FQ7FJUUI5LTV4RIETMT6MW5CS6V35B5QN52SDXKW5OD5YKFAQ, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.429384725 (149h59m18.860464856s) [noise=true , address=104.36.82.38:4707 , piece_id=6W3I4M7OO56SXQ6737N5LYU6EKXC3FOKJBDSS4XFRIWLFTTNGQMQ, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.429432106 (149h59m18.860512227s) [noise=true , address=79.127.201.215:4347 , piece_id=FULXIVH2YVM3AVFF33XJFMEJK2QAM7EA6WS6I5X7XPT4TR7YQDYA, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.429593535 (149h59m18.860673666s) [noise=true , address=104.36.82.46:4495 , piece_id=XNRCALQ6NSXEBUV7Z25OQ2E4DLDREK3XQKCNHZH3YWXA4OFIPVPA, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.429704938 (149h59m18.860785059s) [noise=true , address=104.36.82.60:4365 , piece_id=7WYNE5TBGOJM5R7MVCIZ7CDG5737XZGVMQRSFSPCVEWHRGSY3XMQ, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.429992358 (149h59m18.861072489s) [noise=true , address=104.36.82.51:4063 , piece_id=OBDG6K567SOAA2DERKZP4GSZERTUHRJEI7BJ4MIVL3JHPNMVJG4Q, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.430255922 (149h59m18.861336053s) [noise=true , address=77.90.31.21:4891 , piece_id=WK3MWAOBT4BQT5VA36KBN2RWUT5JVHBFPXTSZSRIH6J2HRSJW4IQ, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.430549503 (149h59m18.861629624s) [noise=true , address=104.36.82.59:4302 , piece_id=SFCJYOAJKPT26MASF3X4NYUHLV4HYCHPKCJUV2BWBH2TKC3RIVRA, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.430809041 (149h59m18.861889172s) [noise=true , address=45.91.116.9:4266 , piece_id=R6LXPDABDOXCMIFF2PV43BSKRBH4KXPLCGPZ3DU3H7HL66WWYWNQ, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:25.923497549 (149h59m20.35457768s) [upload=156000]: Next returned nil segment Aug 14 23:25:25.923507829 (149h59m20.35458795s) [upload=156000]: Waiting for error group managing segments... Aug 14 23:25:26.337042342 (149h59m20.768122463s) [noise=true , address=79.127.219.48:4076 , piece_id=2MQMWXT5523NS5PYGDCQ4Z22CJ23KCN3S3UPCS7WI6TMU6X355CA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.350688071 (149h59m20.781768202s) [noise=true , address=77.90.31.21:4891 , piece_id=WK3MWAOBT4BQT5VA36KBN2RWUT5JVHBFPXTSZSRIH6J2HRSJW4IQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.367283975 (149h59m20.798364106s) [noise=true , address=104.36.82.59:4302 , piece_id=SFCJYOAJKPT26MASF3X4NYUHLV4HYCHPKCJUV2BWBH2TKC3RIVRA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.392847758 (149h59m20.823927889s) [noise=true , address=79.127.201.215:4347 , piece_id=FULXIVH2YVM3AVFF33XJFMEJK2QAM7EA6WS6I5X7XPT4TR7YQDYA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.476671684 (149h59m20.907751805s) [noise=true , address=104.36.82.34:4570 , piece_id=KUK5NYXHUA46Y3MZYC5USNVRSKUF6PLK5GSUPLWXRQXSECIOXLSQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.477883863 (149h59m20.908963994s) [noise=true , address=104.36.82.51:4063 , piece_id=OBDG6K567SOAA2DERKZP4GSZERTUHRJEI7BJ4MIVL3JHPNMVJG4Q, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.495071439 (149h59m20.92615157s) [noise=true , address=77.90.31.12:4594 , piece_id=PVTRB6VZG4GCAP44UDAKKP2VF4TN2ODKEBATJT7EYR2KD7EOQVMA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.499490865 (149h59m20.930571016s) [noise=true , address=104.36.82.3:4796 , piece_id=5JBUWYKUBQHHBR2A7BZJOCN7HEQJKQ6FX3MWQS55QI7LGUH5PKSA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.534749478 (149h59m20.965829599s) [noise=true , address=104.36.82.62:4436 , piece_id=5RTH5H3PD755UV2XLIRW5CNMDCZY6VCOTIKNZF7IMVMFDV5CQLQQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.567397536 (149h59m20.998477667s) [noise=true , address=77.90.31.19:4851 , piece_id=RWQ6L76GA66LIVEHAYGU7SWE7T2LC6GGZ6NQJVTGHVZ76CA6X3EQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.581324884 (149h59m21.012405015s) [noise=true , address=104.36.82.60:4365 , piece_id=7WYNE5TBGOJM5R7MVCIZ7CDG5737XZGVMQRSFSPCVEWHRGSY3XMQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.600511545 (149h59m21.031591676s) [noise=true , address=104.36.82.46:4495 , piece_id=XNRCALQ6NSXEBUV7Z25OQ2E4DLDREK3XQKCNHZH3YWXA4OFIPVPA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.602312732 (149h59m21.033392863s) [noise=true , address=77.90.31.18:4809 , piece_id=TFDTIW6CWJXTN3KKGJTIACJT4ZXCSRAE4CM2W25BWPRLLGZI5UGA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.614279168 (149h59m21.045359299s) [noise=true , address=45.91.116.9:4266 , piece_id=R6LXPDABDOXCMIFF2PV43BSKRBH4KXPLCGPZ3DU3H7HL66WWYWNQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.614295228 (149h59m21.045375359s) [seg_pos={0 0}, upload=156000]: Segment reached optimal threshold of 14 pieces. Aug 14 23:25:26.614385762 (149h59m21.045465893s) [noise=true , address=104.36.82.44:4889 , piece_id=H2KS4DZ6I5UZ42TNCNXTPGYU573Q2KB45OBK3MTNP32H4Q2ILUDQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PCtJRFHPHi1dHJNcRnGZg8HZPQDfo5L3aw6DgVnUzVUz92Kyv): protocol: expected piece hash; context canceled; EOF Aug 14 23:25:26.614431238 (149h59m21.045511369s) [noise=true , address=104.36.82.15:4290 , piece_id=AM4FQ7FJUUI5LTV4RIETMT6MW5CS6V35B5QN52SDXKW5OD5YKFAQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FmG5i2o4BwJmdL9u2tqKGmTAUErivGEe63TbfDTPpBdELozfz): protocol: expected piece hash; context canceled; EOF Aug 14 23:25:26.614559364 (149h59m21.045639485s) [noise=true , address=104.36.82.21:4494 , piece_id=3EU3EVA4ESIIUW5MVSAJEV5BP6GYIF4YSYFANMPU3H6EYD7M3HQQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sRaMuQG18B5SfPpzxp5VWjrwe38SS38g4askmbURxU9tepJHi): protocol: expected piece hash; context canceled; EOF Aug 14 23:25:26.614656349 (149h59m21.04573647s) [noise=true , address=104.36.82.38:4707 , piece_id=6W3I4M7OO56SXQ6737N5LYU6EKXC3FOKJBDSS4XFRIWLFTTNGQMQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N7XaDABpimefP5xEz5Swk53fiZk4DTv5L8Hg5cNDgeG6gHP1T): protocol: write tcp 188.166.225.170:43504->104.36.82.38:4707: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 14 23:25:26.614687790 (149h59m21.045767921s) [seg_pos={0 0}, upload=156000]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 14 23:25:26.614759687 (149h59m21.045839818s) [upload=156000]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 14 23:25:26.614763564 (149h59m21.045843695s) [upload=156000]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 23:25:27.350074072 (149h59m21.781154203s) [upload=156000]: Done uploading segments... Aug 14 23:25:27.350115130 (149h59m21.781195261s) [upload=156000]: Upload finished. err: <nil> Duration: 6.515125467s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..........................X.......X..................X......] duration: 2.093387104s FAIL (2025-08-14 23:28:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 23:23:25.708535090 (149h57m20.139615221s) [upload=155967]: Starting upload Aug 14 23:23:25.708582129 (149h57m20.13966226s) [upload=155967]: Done starting upload Aug 14 23:23:25.708683684 (149h57m20.139763825s) [upload=155967]: Uploading segments... Aug 14 23:23:25.708784046 (149h57m20.139864177s) [upload=155967]: Got next segment. Inline: true Aug 14 23:23:25.708791670 (149h57m20.139871791s) [upload=155967]: Waiting for error group managing segments... Aug 14 23:23:25.708833912 (149h57m20.139914043s) [upload=155967]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 23:23:25.708838921 (149h57m20.139919052s) [upload=155967]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 23:23:25.708841696 (149h57m20.139921827s) [upload=155967]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 23:23:25.923862328 (149h57m20.354942459s) [upload=155967]: Done uploading segments... Aug 14 23:23:25.923880343 (149h57m20.354960464s) [upload=155967]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.09341617s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 774.672861ms FAIL (2025-08-14 23:28:21 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": remote error: tls: internal error Duration: 774.69873ms edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 17 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXX...........................................] duration: 6.48448994s FAIL (2025-08-14 23:28:12 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.484517292s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..................................X.............X....X..X...] duration: 6.04699024s FAIL (2025-08-14 23:28:06 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 14 23:25:23.865082679 (149h59m18.29616281s) [upload=156000]: Starting upload Aug 14 23:25:23.865134989 (149h59m18.29621512s) [upload=156000]: Done starting upload Aug 14 23:25:23.865241213 (149h59m18.296321344s) [upload=156000]: Uploading segments... Aug 14 23:25:23.865391189 (149h59m18.29647132s) [upload=156000]: Got next segment. Inline: false Aug 14 23:25:23.865430435 (149h59m18.296510566s) [upload=156000]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 23:25:23.865434993 (149h59m18.296515114s) [upload=156000]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 23:25:24.427593929 (149h59m18.85867406s) [seg_pos={0 0}, upload=156000]: Begin upload segment... Aug 14 23:25:24.427659504 (149h59m18.858739635s) [seg_pos={0 0}, upload=156000]: Done begin upload segment. Aug 14 23:25:24.427681045 (149h59m18.858761167s) [noise=true , address=77.90.31.12:4594 , piece_id=PVTRB6VZG4GCAP44UDAKKP2VF4TN2ODKEBATJT7EYR2KD7EOQVMA, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.427712806 (149h59m18.858792937s) [noise=true , address=77.90.31.18:4809 , piece_id=TFDTIW6CWJXTN3KKGJTIACJT4ZXCSRAE4CM2W25BWPRLLGZI5UGA, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.428058338 (149h59m18.859138469s) [noise=true , address=79.127.219.48:4076 , piece_id=2MQMWXT5523NS5PYGDCQ4Z22CJ23KCN3S3UPCS7WI6TMU6X355CA, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.428321260 (149h59m18.859401391s) [noise=true , address=104.36.82.3:4796 , piece_id=5JBUWYKUBQHHBR2A7BZJOCN7HEQJKQ6FX3MWQS55QI7LGUH5PKSA, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.428582981 (149h59m18.859663112s) [noise=true , address=104.36.82.62:4436 , piece_id=5RTH5H3PD755UV2XLIRW5CNMDCZY6VCOTIKNZF7IMVMFDV5CQLQQ, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.428780519 (149h59m18.85986064s) [noise=true , address=104.36.82.44:4889 , piece_id=H2KS4DZ6I5UZ42TNCNXTPGYU573Q2KB45OBK3MTNP32H4Q2ILUDQ, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.428928291 (149h59m18.860008423s) [noise=true , address=104.36.82.34:4570 , piece_id=KUK5NYXHUA46Y3MZYC5USNVRSKUF6PLK5GSUPLWXRQXSECIOXLSQ, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.429112424 (149h59m18.860192555s) [noise=true , address=104.36.82.21:4494 , piece_id=3EU3EVA4ESIIUW5MVSAJEV5BP6GYIF4YSYFANMPU3H6EYD7M3HQQ, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.429144285 (149h59m18.860224406s) [noise=true , address=77.90.31.19:4851 , piece_id=RWQ6L76GA66LIVEHAYGU7SWE7T2LC6GGZ6NQJVTGHVZ76CA6X3EQ, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.429170645 (149h59m18.860250776s) [noise=true , address=104.36.82.15:4290 , piece_id=AM4FQ7FJUUI5LTV4RIETMT6MW5CS6V35B5QN52SDXKW5OD5YKFAQ, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.429384725 (149h59m18.860464856s) [noise=true , address=104.36.82.38:4707 , piece_id=6W3I4M7OO56SXQ6737N5LYU6EKXC3FOKJBDSS4XFRIWLFTTNGQMQ, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.429432106 (149h59m18.860512227s) [noise=true , address=79.127.201.215:4347 , piece_id=FULXIVH2YVM3AVFF33XJFMEJK2QAM7EA6WS6I5X7XPT4TR7YQDYA, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.429593535 (149h59m18.860673666s) [noise=true , address=104.36.82.46:4495 , piece_id=XNRCALQ6NSXEBUV7Z25OQ2E4DLDREK3XQKCNHZH3YWXA4OFIPVPA, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.429704938 (149h59m18.860785059s) [noise=true , address=104.36.82.60:4365 , piece_id=7WYNE5TBGOJM5R7MVCIZ7CDG5737XZGVMQRSFSPCVEWHRGSY3XMQ, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.429992358 (149h59m18.861072489s) [noise=true , address=104.36.82.51:4063 , piece_id=OBDG6K567SOAA2DERKZP4GSZERTUHRJEI7BJ4MIVL3JHPNMVJG4Q, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.430255922 (149h59m18.861336053s) [noise=true , address=77.90.31.21:4891 , piece_id=WK3MWAOBT4BQT5VA36KBN2RWUT5JVHBFPXTSZSRIH6J2HRSJW4IQ, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.430549503 (149h59m18.861629624s) [noise=true , address=104.36.82.59:4302 , piece_id=SFCJYOAJKPT26MASF3X4NYUHLV4HYCHPKCJUV2BWBH2TKC3RIVRA, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.430809041 (149h59m18.861889172s) [noise=true , address=45.91.116.9:4266 , piece_id=R6LXPDABDOXCMIFF2PV43BSKRBH4KXPLCGPZ3DU3H7HL66WWYWNQ, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:25.923497549 (149h59m20.35457768s) [upload=156000]: Next returned nil segment Aug 14 23:25:25.923507829 (149h59m20.35458795s) [upload=156000]: Waiting for error group managing segments... Aug 14 23:25:26.337042342 (149h59m20.768122463s) [noise=true , address=79.127.219.48:4076 , piece_id=2MQMWXT5523NS5PYGDCQ4Z22CJ23KCN3S3UPCS7WI6TMU6X355CA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.350688071 (149h59m20.781768202s) [noise=true , address=77.90.31.21:4891 , piece_id=WK3MWAOBT4BQT5VA36KBN2RWUT5JVHBFPXTSZSRIH6J2HRSJW4IQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.367283975 (149h59m20.798364106s) [noise=true , address=104.36.82.59:4302 , piece_id=SFCJYOAJKPT26MASF3X4NYUHLV4HYCHPKCJUV2BWBH2TKC3RIVRA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.392847758 (149h59m20.823927889s) [noise=true , address=79.127.201.215:4347 , piece_id=FULXIVH2YVM3AVFF33XJFMEJK2QAM7EA6WS6I5X7XPT4TR7YQDYA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.476671684 (149h59m20.907751805s) [noise=true , address=104.36.82.34:4570 , piece_id=KUK5NYXHUA46Y3MZYC5USNVRSKUF6PLK5GSUPLWXRQXSECIOXLSQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.477883863 (149h59m20.908963994s) [noise=true , address=104.36.82.51:4063 , piece_id=OBDG6K567SOAA2DERKZP4GSZERTUHRJEI7BJ4MIVL3JHPNMVJG4Q, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.495071439 (149h59m20.92615157s) [noise=true , address=77.90.31.12:4594 , piece_id=PVTRB6VZG4GCAP44UDAKKP2VF4TN2ODKEBATJT7EYR2KD7EOQVMA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.499490865 (149h59m20.930571016s) [noise=true , address=104.36.82.3:4796 , piece_id=5JBUWYKUBQHHBR2A7BZJOCN7HEQJKQ6FX3MWQS55QI7LGUH5PKSA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.534749478 (149h59m20.965829599s) [noise=true , address=104.36.82.62:4436 , piece_id=5RTH5H3PD755UV2XLIRW5CNMDCZY6VCOTIKNZF7IMVMFDV5CQLQQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.567397536 (149h59m20.998477667s) [noise=true , address=77.90.31.19:4851 , piece_id=RWQ6L76GA66LIVEHAYGU7SWE7T2LC6GGZ6NQJVTGHVZ76CA6X3EQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.581324884 (149h59m21.012405015s) [noise=true , address=104.36.82.60:4365 , piece_id=7WYNE5TBGOJM5R7MVCIZ7CDG5737XZGVMQRSFSPCVEWHRGSY3XMQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.600511545 (149h59m21.031591676s) [noise=true , address=104.36.82.46:4495 , piece_id=XNRCALQ6NSXEBUV7Z25OQ2E4DLDREK3XQKCNHZH3YWXA4OFIPVPA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.602312732 (149h59m21.033392863s) [noise=true , address=77.90.31.18:4809 , piece_id=TFDTIW6CWJXTN3KKGJTIACJT4ZXCSRAE4CM2W25BWPRLLGZI5UGA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.614279168 (149h59m21.045359299s) [noise=true , address=45.91.116.9:4266 , piece_id=R6LXPDABDOXCMIFF2PV43BSKRBH4KXPLCGPZ3DU3H7HL66WWYWNQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.614295228 (149h59m21.045375359s) [seg_pos={0 0}, upload=156000]: Segment reached optimal threshold of 14 pieces. Aug 14 23:25:26.614385762 (149h59m21.045465893s) [noise=true , address=104.36.82.44:4889 , piece_id=H2KS4DZ6I5UZ42TNCNXTPGYU573Q2KB45OBK3MTNP32H4Q2ILUDQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PCtJRFHPHi1dHJNcRnGZg8HZPQDfo5L3aw6DgVnUzVUz92Kyv): protocol: expected piece hash; context canceled; EOF Aug 14 23:25:26.614431238 (149h59m21.045511369s) [noise=true , address=104.36.82.15:4290 , piece_id=AM4FQ7FJUUI5LTV4RIETMT6MW5CS6V35B5QN52SDXKW5OD5YKFAQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FmG5i2o4BwJmdL9u2tqKGmTAUErivGEe63TbfDTPpBdELozfz): protocol: expected piece hash; context canceled; EOF Aug 14 23:25:26.614559364 (149h59m21.045639485s) [noise=true , address=104.36.82.21:4494 , piece_id=3EU3EVA4ESIIUW5MVSAJEV5BP6GYIF4YSYFANMPU3H6EYD7M3HQQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sRaMuQG18B5SfPpzxp5VWjrwe38SS38g4askmbURxU9tepJHi): protocol: expected piece hash; context canceled; EOF Aug 14 23:25:26.614656349 (149h59m21.04573647s) [noise=true , address=104.36.82.38:4707 , piece_id=6W3I4M7OO56SXQ6737N5LYU6EKXC3FOKJBDSS4XFRIWLFTTNGQMQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N7XaDABpimefP5xEz5Swk53fiZk4DTv5L8Hg5cNDgeG6gHP1T): protocol: write tcp 188.166.225.170:43504->104.36.82.38:4707: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 14 23:25:26.614687790 (149h59m21.045767921s) [seg_pos={0 0}, upload=156000]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 14 23:25:26.614759687 (149h59m21.045839818s) [upload=156000]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 14 23:25:26.614763564 (149h59m21.045843695s) [upload=156000]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 23:25:27.350074072 (149h59m21.781154203s) [upload=156000]: Done uploading segments... Aug 14 23:25:27.350115130 (149h59m21.781195261s) [upload=156000]: Upload finished. err: <nil> Duration: 6.047020128s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 771.255292ms FAIL (2025-08-14 23:27:56 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": remote error: tls: internal error Duration: 771.293415ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...........................X.......X..................X.....] duration: 2.006567228s FAIL (2025-08-14 23:27:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 23:23:25.708535090 (149h57m20.139615221s) [upload=155967]: Starting upload Aug 14 23:23:25.708582129 (149h57m20.13966226s) [upload=155967]: Done starting upload Aug 14 23:23:25.708683684 (149h57m20.139763825s) [upload=155967]: Uploading segments... Aug 14 23:23:25.708784046 (149h57m20.139864177s) [upload=155967]: Got next segment. Inline: true Aug 14 23:23:25.708791670 (149h57m20.139871791s) [upload=155967]: Waiting for error group managing segments... Aug 14 23:23:25.708833912 (149h57m20.139914043s) [upload=155967]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 23:23:25.708838921 (149h57m20.139919052s) [upload=155967]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 23:23:25.708841696 (149h57m20.139921827s) [upload=155967]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 23:23:25.923862328 (149h57m20.354942459s) [upload=155967]: Done uploading segments... Aug 14 23:23:25.923880343 (149h57m20.354960464s) [upload=155967]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.006591414s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [............................X.......X..................X....] duration: 1.945587962s FAIL (2025-08-14 23:27:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 23:23:25.708535090 (149h57m20.139615221s) [upload=155967]: Starting upload Aug 14 23:23:25.708582129 (149h57m20.13966226s) [upload=155967]: Done starting upload Aug 14 23:23:25.708683684 (149h57m20.139763825s) [upload=155967]: Uploading segments... Aug 14 23:23:25.708784046 (149h57m20.139864177s) [upload=155967]: Got next segment. Inline: true Aug 14 23:23:25.708791670 (149h57m20.139871791s) [upload=155967]: Waiting for error group managing segments... Aug 14 23:23:25.708833912 (149h57m20.139914043s) [upload=155967]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 23:23:25.708838921 (149h57m20.139919052s) [upload=155967]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 23:23:25.708841696 (149h57m20.139921827s) [upload=155967]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 23:23:25.923862328 (149h57m20.354942459s) [upload=155967]: Done uploading segments... Aug 14 23:23:25.923880343 (149h57m20.354960464s) [upload=155967]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.94561871s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [...................................X.............X....X..X..] duration: 6.16624013s FAIL (2025-08-14 23:27:18 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 14 23:25:23.865082679 (149h59m18.29616281s) [upload=156000]: Starting upload Aug 14 23:25:23.865134989 (149h59m18.29621512s) [upload=156000]: Done starting upload Aug 14 23:25:23.865241213 (149h59m18.296321344s) [upload=156000]: Uploading segments... Aug 14 23:25:23.865391189 (149h59m18.29647132s) [upload=156000]: Got next segment. Inline: false Aug 14 23:25:23.865430435 (149h59m18.296510566s) [upload=156000]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 23:25:23.865434993 (149h59m18.296515114s) [upload=156000]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 23:25:24.427593929 (149h59m18.85867406s) [seg_pos={0 0}, upload=156000]: Begin upload segment... Aug 14 23:25:24.427659504 (149h59m18.858739635s) [seg_pos={0 0}, upload=156000]: Done begin upload segment. Aug 14 23:25:24.427681045 (149h59m18.858761167s) [noise=true , address=77.90.31.12:4594 , piece_id=PVTRB6VZG4GCAP44UDAKKP2VF4TN2ODKEBATJT7EYR2KD7EOQVMA, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.427712806 (149h59m18.858792937s) [noise=true , address=77.90.31.18:4809 , piece_id=TFDTIW6CWJXTN3KKGJTIACJT4ZXCSRAE4CM2W25BWPRLLGZI5UGA, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.428058338 (149h59m18.859138469s) [noise=true , address=79.127.219.48:4076 , piece_id=2MQMWXT5523NS5PYGDCQ4Z22CJ23KCN3S3UPCS7WI6TMU6X355CA, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.428321260 (149h59m18.859401391s) [noise=true , address=104.36.82.3:4796 , piece_id=5JBUWYKUBQHHBR2A7BZJOCN7HEQJKQ6FX3MWQS55QI7LGUH5PKSA, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.428582981 (149h59m18.859663112s) [noise=true , address=104.36.82.62:4436 , piece_id=5RTH5H3PD755UV2XLIRW5CNMDCZY6VCOTIKNZF7IMVMFDV5CQLQQ, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.428780519 (149h59m18.85986064s) [noise=true , address=104.36.82.44:4889 , piece_id=H2KS4DZ6I5UZ42TNCNXTPGYU573Q2KB45OBK3MTNP32H4Q2ILUDQ, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.428928291 (149h59m18.860008423s) [noise=true , address=104.36.82.34:4570 , piece_id=KUK5NYXHUA46Y3MZYC5USNVRSKUF6PLK5GSUPLWXRQXSECIOXLSQ, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.429112424 (149h59m18.860192555s) [noise=true , address=104.36.82.21:4494 , piece_id=3EU3EVA4ESIIUW5MVSAJEV5BP6GYIF4YSYFANMPU3H6EYD7M3HQQ, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.429144285 (149h59m18.860224406s) [noise=true , address=77.90.31.19:4851 , piece_id=RWQ6L76GA66LIVEHAYGU7SWE7T2LC6GGZ6NQJVTGHVZ76CA6X3EQ, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.429170645 (149h59m18.860250776s) [noise=true , address=104.36.82.15:4290 , piece_id=AM4FQ7FJUUI5LTV4RIETMT6MW5CS6V35B5QN52SDXKW5OD5YKFAQ, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.429384725 (149h59m18.860464856s) [noise=true , address=104.36.82.38:4707 , piece_id=6W3I4M7OO56SXQ6737N5LYU6EKXC3FOKJBDSS4XFRIWLFTTNGQMQ, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.429432106 (149h59m18.860512227s) [noise=true , address=79.127.201.215:4347 , piece_id=FULXIVH2YVM3AVFF33XJFMEJK2QAM7EA6WS6I5X7XPT4TR7YQDYA, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.429593535 (149h59m18.860673666s) [noise=true , address=104.36.82.46:4495 , piece_id=XNRCALQ6NSXEBUV7Z25OQ2E4DLDREK3XQKCNHZH3YWXA4OFIPVPA, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.429704938 (149h59m18.860785059s) [noise=true , address=104.36.82.60:4365 , piece_id=7WYNE5TBGOJM5R7MVCIZ7CDG5737XZGVMQRSFSPCVEWHRGSY3XMQ, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.429992358 (149h59m18.861072489s) [noise=true , address=104.36.82.51:4063 , piece_id=OBDG6K567SOAA2DERKZP4GSZERTUHRJEI7BJ4MIVL3JHPNMVJG4Q, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.430255922 (149h59m18.861336053s) [noise=true , address=77.90.31.21:4891 , piece_id=WK3MWAOBT4BQT5VA36KBN2RWUT5JVHBFPXTSZSRIH6J2HRSJW4IQ, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.430549503 (149h59m18.861629624s) [noise=true , address=104.36.82.59:4302 , piece_id=SFCJYOAJKPT26MASF3X4NYUHLV4HYCHPKCJUV2BWBH2TKC3RIVRA, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.430809041 (149h59m18.861889172s) [noise=true , address=45.91.116.9:4266 , piece_id=R6LXPDABDOXCMIFF2PV43BSKRBH4KXPLCGPZ3DU3H7HL66WWYWNQ, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:25.923497549 (149h59m20.35457768s) [upload=156000]: Next returned nil segment Aug 14 23:25:25.923507829 (149h59m20.35458795s) [upload=156000]: Waiting for error group managing segments... Aug 14 23:25:26.337042342 (149h59m20.768122463s) [noise=true , address=79.127.219.48:4076 , piece_id=2MQMWXT5523NS5PYGDCQ4Z22CJ23KCN3S3UPCS7WI6TMU6X355CA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.350688071 (149h59m20.781768202s) [noise=true , address=77.90.31.21:4891 , piece_id=WK3MWAOBT4BQT5VA36KBN2RWUT5JVHBFPXTSZSRIH6J2HRSJW4IQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.367283975 (149h59m20.798364106s) [noise=true , address=104.36.82.59:4302 , piece_id=SFCJYOAJKPT26MASF3X4NYUHLV4HYCHPKCJUV2BWBH2TKC3RIVRA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.392847758 (149h59m20.823927889s) [noise=true , address=79.127.201.215:4347 , piece_id=FULXIVH2YVM3AVFF33XJFMEJK2QAM7EA6WS6I5X7XPT4TR7YQDYA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.476671684 (149h59m20.907751805s) [noise=true , address=104.36.82.34:4570 , piece_id=KUK5NYXHUA46Y3MZYC5USNVRSKUF6PLK5GSUPLWXRQXSECIOXLSQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.477883863 (149h59m20.908963994s) [noise=true , address=104.36.82.51:4063 , piece_id=OBDG6K567SOAA2DERKZP4GSZERTUHRJEI7BJ4MIVL3JHPNMVJG4Q, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.495071439 (149h59m20.92615157s) [noise=true , address=77.90.31.12:4594 , piece_id=PVTRB6VZG4GCAP44UDAKKP2VF4TN2ODKEBATJT7EYR2KD7EOQVMA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.499490865 (149h59m20.930571016s) [noise=true , address=104.36.82.3:4796 , piece_id=5JBUWYKUBQHHBR2A7BZJOCN7HEQJKQ6FX3MWQS55QI7LGUH5PKSA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.534749478 (149h59m20.965829599s) [noise=true , address=104.36.82.62:4436 , piece_id=5RTH5H3PD755UV2XLIRW5CNMDCZY6VCOTIKNZF7IMVMFDV5CQLQQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.567397536 (149h59m20.998477667s) [noise=true , address=77.90.31.19:4851 , piece_id=RWQ6L76GA66LIVEHAYGU7SWE7T2LC6GGZ6NQJVTGHVZ76CA6X3EQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.581324884 (149h59m21.012405015s) [noise=true , address=104.36.82.60:4365 , piece_id=7WYNE5TBGOJM5R7MVCIZ7CDG5737XZGVMQRSFSPCVEWHRGSY3XMQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.600511545 (149h59m21.031591676s) [noise=true , address=104.36.82.46:4495 , piece_id=XNRCALQ6NSXEBUV7Z25OQ2E4DLDREK3XQKCNHZH3YWXA4OFIPVPA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.602312732 (149h59m21.033392863s) [noise=true , address=77.90.31.18:4809 , piece_id=TFDTIW6CWJXTN3KKGJTIACJT4ZXCSRAE4CM2W25BWPRLLGZI5UGA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.614279168 (149h59m21.045359299s) [noise=true , address=45.91.116.9:4266 , piece_id=R6LXPDABDOXCMIFF2PV43BSKRBH4KXPLCGPZ3DU3H7HL66WWYWNQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.614295228 (149h59m21.045375359s) [seg_pos={0 0}, upload=156000]: Segment reached optimal threshold of 14 pieces. Aug 14 23:25:26.614385762 (149h59m21.045465893s) [noise=true , address=104.36.82.44:4889 , piece_id=H2KS4DZ6I5UZ42TNCNXTPGYU573Q2KB45OBK3MTNP32H4Q2ILUDQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PCtJRFHPHi1dHJNcRnGZg8HZPQDfo5L3aw6DgVnUzVUz92Kyv): protocol: expected piece hash; context canceled; EOF Aug 14 23:25:26.614431238 (149h59m21.045511369s) [noise=true , address=104.36.82.15:4290 , piece_id=AM4FQ7FJUUI5LTV4RIETMT6MW5CS6V35B5QN52SDXKW5OD5YKFAQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FmG5i2o4BwJmdL9u2tqKGmTAUErivGEe63TbfDTPpBdELozfz): protocol: expected piece hash; context canceled; EOF Aug 14 23:25:26.614559364 (149h59m21.045639485s) [noise=true , address=104.36.82.21:4494 , piece_id=3EU3EVA4ESIIUW5MVSAJEV5BP6GYIF4YSYFANMPU3H6EYD7M3HQQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sRaMuQG18B5SfPpzxp5VWjrwe38SS38g4askmbURxU9tepJHi): protocol: expected piece hash; context canceled; EOF Aug 14 23:25:26.614656349 (149h59m21.04573647s) [noise=true , address=104.36.82.38:4707 , piece_id=6W3I4M7OO56SXQ6737N5LYU6EKXC3FOKJBDSS4XFRIWLFTTNGQMQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N7XaDABpimefP5xEz5Swk53fiZk4DTv5L8Hg5cNDgeG6gHP1T): protocol: write tcp 188.166.225.170:43504->104.36.82.38:4707: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 14 23:25:26.614687790 (149h59m21.045767921s) [seg_pos={0 0}, upload=156000]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 14 23:25:26.614759687 (149h59m21.045839818s) [upload=156000]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 14 23:25:26.614763564 (149h59m21.045843695s) [upload=156000]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 23:25:27.350074072 (149h59m21.781154203s) [upload=156000]: Done uploading segments... Aug 14 23:25:27.350115130 (149h59m21.781195261s) [upload=156000]: Upload finished. err: <nil> Duration: 6.166258225s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 18 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXX..........................................] duration: 6.229333168s FAIL (2025-08-14 23:27:18 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.229354478s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 19 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXX.........................................] duration: 6.300446426s FAIL (2025-08-14 23:26:55 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.300467658s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 753.79758ms FAIL (2025-08-14 23:26:51 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": remote error: tls: internal error Duration: 753.836545ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.............................X.......X..................X...] duration: 2.056037521s FAIL (2025-08-14 23:26:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 23:23:25.708535090 (149h57m20.139615221s) [upload=155967]: Starting upload Aug 14 23:23:25.708582129 (149h57m20.13966226s) [upload=155967]: Done starting upload Aug 14 23:23:25.708683684 (149h57m20.139763825s) [upload=155967]: Uploading segments... Aug 14 23:23:25.708784046 (149h57m20.139864177s) [upload=155967]: Got next segment. Inline: true Aug 14 23:23:25.708791670 (149h57m20.139871791s) [upload=155967]: Waiting for error group managing segments... Aug 14 23:23:25.708833912 (149h57m20.139914043s) [upload=155967]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 23:23:25.708838921 (149h57m20.139919052s) [upload=155967]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 23:23:25.708841696 (149h57m20.139921827s) [upload=155967]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 23:23:25.923862328 (149h57m20.354942459s) [upload=155967]: Done uploading segments... Aug 14 23:23:25.923880343 (149h57m20.354960464s) [upload=155967]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.056065845s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [....................................X.............X....X..X.] duration: 5.854536896s FAIL (2025-08-14 23:26:21 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 14 23:25:23.865082679 (149h59m18.29616281s) [upload=156000]: Starting upload Aug 14 23:25:23.865134989 (149h59m18.29621512s) [upload=156000]: Done starting upload Aug 14 23:25:23.865241213 (149h59m18.296321344s) [upload=156000]: Uploading segments... Aug 14 23:25:23.865391189 (149h59m18.29647132s) [upload=156000]: Got next segment. Inline: false Aug 14 23:25:23.865430435 (149h59m18.296510566s) [upload=156000]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 23:25:23.865434993 (149h59m18.296515114s) [upload=156000]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 23:25:24.427593929 (149h59m18.85867406s) [seg_pos={0 0}, upload=156000]: Begin upload segment... Aug 14 23:25:24.427659504 (149h59m18.858739635s) [seg_pos={0 0}, upload=156000]: Done begin upload segment. Aug 14 23:25:24.427681045 (149h59m18.858761167s) [noise=true , address=77.90.31.12:4594 , piece_id=PVTRB6VZG4GCAP44UDAKKP2VF4TN2ODKEBATJT7EYR2KD7EOQVMA, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.427712806 (149h59m18.858792937s) [noise=true , address=77.90.31.18:4809 , piece_id=TFDTIW6CWJXTN3KKGJTIACJT4ZXCSRAE4CM2W25BWPRLLGZI5UGA, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.428058338 (149h59m18.859138469s) [noise=true , address=79.127.219.48:4076 , piece_id=2MQMWXT5523NS5PYGDCQ4Z22CJ23KCN3S3UPCS7WI6TMU6X355CA, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.428321260 (149h59m18.859401391s) [noise=true , address=104.36.82.3:4796 , piece_id=5JBUWYKUBQHHBR2A7BZJOCN7HEQJKQ6FX3MWQS55QI7LGUH5PKSA, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.428582981 (149h59m18.859663112s) [noise=true , address=104.36.82.62:4436 , piece_id=5RTH5H3PD755UV2XLIRW5CNMDCZY6VCOTIKNZF7IMVMFDV5CQLQQ, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.428780519 (149h59m18.85986064s) [noise=true , address=104.36.82.44:4889 , piece_id=H2KS4DZ6I5UZ42TNCNXTPGYU573Q2KB45OBK3MTNP32H4Q2ILUDQ, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.428928291 (149h59m18.860008423s) [noise=true , address=104.36.82.34:4570 , piece_id=KUK5NYXHUA46Y3MZYC5USNVRSKUF6PLK5GSUPLWXRQXSECIOXLSQ, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.429112424 (149h59m18.860192555s) [noise=true , address=104.36.82.21:4494 , piece_id=3EU3EVA4ESIIUW5MVSAJEV5BP6GYIF4YSYFANMPU3H6EYD7M3HQQ, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.429144285 (149h59m18.860224406s) [noise=true , address=77.90.31.19:4851 , piece_id=RWQ6L76GA66LIVEHAYGU7SWE7T2LC6GGZ6NQJVTGHVZ76CA6X3EQ, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.429170645 (149h59m18.860250776s) [noise=true , address=104.36.82.15:4290 , piece_id=AM4FQ7FJUUI5LTV4RIETMT6MW5CS6V35B5QN52SDXKW5OD5YKFAQ, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.429384725 (149h59m18.860464856s) [noise=true , address=104.36.82.38:4707 , piece_id=6W3I4M7OO56SXQ6737N5LYU6EKXC3FOKJBDSS4XFRIWLFTTNGQMQ, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.429432106 (149h59m18.860512227s) [noise=true , address=79.127.201.215:4347 , piece_id=FULXIVH2YVM3AVFF33XJFMEJK2QAM7EA6WS6I5X7XPT4TR7YQDYA, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.429593535 (149h59m18.860673666s) [noise=true , address=104.36.82.46:4495 , piece_id=XNRCALQ6NSXEBUV7Z25OQ2E4DLDREK3XQKCNHZH3YWXA4OFIPVPA, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.429704938 (149h59m18.860785059s) [noise=true , address=104.36.82.60:4365 , piece_id=7WYNE5TBGOJM5R7MVCIZ7CDG5737XZGVMQRSFSPCVEWHRGSY3XMQ, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.429992358 (149h59m18.861072489s) [noise=true , address=104.36.82.51:4063 , piece_id=OBDG6K567SOAA2DERKZP4GSZERTUHRJEI7BJ4MIVL3JHPNMVJG4Q, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.430255922 (149h59m18.861336053s) [noise=true , address=77.90.31.21:4891 , piece_id=WK3MWAOBT4BQT5VA36KBN2RWUT5JVHBFPXTSZSRIH6J2HRSJW4IQ, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.430549503 (149h59m18.861629624s) [noise=true , address=104.36.82.59:4302 , piece_id=SFCJYOAJKPT26MASF3X4NYUHLV4HYCHPKCJUV2BWBH2TKC3RIVRA, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.430809041 (149h59m18.861889172s) [noise=true , address=45.91.116.9:4266 , piece_id=R6LXPDABDOXCMIFF2PV43BSKRBH4KXPLCGPZ3DU3H7HL66WWYWNQ, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:25.923497549 (149h59m20.35457768s) [upload=156000]: Next returned nil segment Aug 14 23:25:25.923507829 (149h59m20.35458795s) [upload=156000]: Waiting for error group managing segments... Aug 14 23:25:26.337042342 (149h59m20.768122463s) [noise=true , address=79.127.219.48:4076 , piece_id=2MQMWXT5523NS5PYGDCQ4Z22CJ23KCN3S3UPCS7WI6TMU6X355CA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.350688071 (149h59m20.781768202s) [noise=true , address=77.90.31.21:4891 , piece_id=WK3MWAOBT4BQT5VA36KBN2RWUT5JVHBFPXTSZSRIH6J2HRSJW4IQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.367283975 (149h59m20.798364106s) [noise=true , address=104.36.82.59:4302 , piece_id=SFCJYOAJKPT26MASF3X4NYUHLV4HYCHPKCJUV2BWBH2TKC3RIVRA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.392847758 (149h59m20.823927889s) [noise=true , address=79.127.201.215:4347 , piece_id=FULXIVH2YVM3AVFF33XJFMEJK2QAM7EA6WS6I5X7XPT4TR7YQDYA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.476671684 (149h59m20.907751805s) [noise=true , address=104.36.82.34:4570 , piece_id=KUK5NYXHUA46Y3MZYC5USNVRSKUF6PLK5GSUPLWXRQXSECIOXLSQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.477883863 (149h59m20.908963994s) [noise=true , address=104.36.82.51:4063 , piece_id=OBDG6K567SOAA2DERKZP4GSZERTUHRJEI7BJ4MIVL3JHPNMVJG4Q, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.495071439 (149h59m20.92615157s) [noise=true , address=77.90.31.12:4594 , piece_id=PVTRB6VZG4GCAP44UDAKKP2VF4TN2ODKEBATJT7EYR2KD7EOQVMA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.499490865 (149h59m20.930571016s) [noise=true , address=104.36.82.3:4796 , piece_id=5JBUWYKUBQHHBR2A7BZJOCN7HEQJKQ6FX3MWQS55QI7LGUH5PKSA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.534749478 (149h59m20.965829599s) [noise=true , address=104.36.82.62:4436 , piece_id=5RTH5H3PD755UV2XLIRW5CNMDCZY6VCOTIKNZF7IMVMFDV5CQLQQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.567397536 (149h59m20.998477667s) [noise=true , address=77.90.31.19:4851 , piece_id=RWQ6L76GA66LIVEHAYGU7SWE7T2LC6GGZ6NQJVTGHVZ76CA6X3EQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.581324884 (149h59m21.012405015s) [noise=true , address=104.36.82.60:4365 , piece_id=7WYNE5TBGOJM5R7MVCIZ7CDG5737XZGVMQRSFSPCVEWHRGSY3XMQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.600511545 (149h59m21.031591676s) [noise=true , address=104.36.82.46:4495 , piece_id=XNRCALQ6NSXEBUV7Z25OQ2E4DLDREK3XQKCNHZH3YWXA4OFIPVPA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.602312732 (149h59m21.033392863s) [noise=true , address=77.90.31.18:4809 , piece_id=TFDTIW6CWJXTN3KKGJTIACJT4ZXCSRAE4CM2W25BWPRLLGZI5UGA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.614279168 (149h59m21.045359299s) [noise=true , address=45.91.116.9:4266 , piece_id=R6LXPDABDOXCMIFF2PV43BSKRBH4KXPLCGPZ3DU3H7HL66WWYWNQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.614295228 (149h59m21.045375359s) [seg_pos={0 0}, upload=156000]: Segment reached optimal threshold of 14 pieces. Aug 14 23:25:26.614385762 (149h59m21.045465893s) [noise=true , address=104.36.82.44:4889 , piece_id=H2KS4DZ6I5UZ42TNCNXTPGYU573Q2KB45OBK3MTNP32H4Q2ILUDQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PCtJRFHPHi1dHJNcRnGZg8HZPQDfo5L3aw6DgVnUzVUz92Kyv): protocol: expected piece hash; context canceled; EOF Aug 14 23:25:26.614431238 (149h59m21.045511369s) [noise=true , address=104.36.82.15:4290 , piece_id=AM4FQ7FJUUI5LTV4RIETMT6MW5CS6V35B5QN52SDXKW5OD5YKFAQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FmG5i2o4BwJmdL9u2tqKGmTAUErivGEe63TbfDTPpBdELozfz): protocol: expected piece hash; context canceled; EOF Aug 14 23:25:26.614559364 (149h59m21.045639485s) [noise=true , address=104.36.82.21:4494 , piece_id=3EU3EVA4ESIIUW5MVSAJEV5BP6GYIF4YSYFANMPU3H6EYD7M3HQQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sRaMuQG18B5SfPpzxp5VWjrwe38SS38g4askmbURxU9tepJHi): protocol: expected piece hash; context canceled; EOF Aug 14 23:25:26.614656349 (149h59m21.04573647s) [noise=true , address=104.36.82.38:4707 , piece_id=6W3I4M7OO56SXQ6737N5LYU6EKXC3FOKJBDSS4XFRIWLFTTNGQMQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N7XaDABpimefP5xEz5Swk53fiZk4DTv5L8Hg5cNDgeG6gHP1T): protocol: write tcp 188.166.225.170:43504->104.36.82.38:4707: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 14 23:25:26.614687790 (149h59m21.045767921s) [seg_pos={0 0}, upload=156000]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 14 23:25:26.614759687 (149h59m21.045839818s) [upload=156000]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 14 23:25:26.614763564 (149h59m21.045843695s) [upload=156000]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 23:25:27.350074072 (149h59m21.781154203s) [upload=156000]: Done uploading segments... Aug 14 23:25:27.350115130 (149h59m21.781195261s) [upload=156000]: Upload finished. err: <nil> Duration: 5.854559229s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 20 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXX........................................] duration: 6.078602798s FAIL (2025-08-14 23:26:11 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.078629048s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 733.07478ms FAIL (2025-08-14 23:25:43 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": remote error: tls: internal error Duration: 733.151026ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..............................X.......X..................X..] duration: 2.125760965s FAIL (2025-08-14 23:25:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 23:23:25.708535090 (149h57m20.139615221s) [upload=155967]: Starting upload Aug 14 23:23:25.708582129 (149h57m20.13966226s) [upload=155967]: Done starting upload Aug 14 23:23:25.708683684 (149h57m20.139763825s) [upload=155967]: Uploading segments... Aug 14 23:23:25.708784046 (149h57m20.139864177s) [upload=155967]: Got next segment. Inline: true Aug 14 23:23:25.708791670 (149h57m20.139871791s) [upload=155967]: Waiting for error group managing segments... Aug 14 23:23:25.708833912 (149h57m20.139914043s) [upload=155967]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 23:23:25.708838921 (149h57m20.139919052s) [upload=155967]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 23:23:25.708841696 (149h57m20.139921827s) [upload=155967]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 23:23:25.923862328 (149h57m20.354942459s) [upload=155967]: Done uploading segments... Aug 14 23:23:25.923880343 (149h57m20.354960464s) [upload=155967]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.125819978s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.....................................X.............X....X..X] duration: 4.598423406s FAIL (2025-08-14 23:25:27 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 14 23:25:23.865082679 (149h59m18.29616281s) [upload=156000]: Starting upload Aug 14 23:25:23.865134989 (149h59m18.29621512s) [upload=156000]: Done starting upload Aug 14 23:25:23.865241213 (149h59m18.296321344s) [upload=156000]: Uploading segments... Aug 14 23:25:23.865391189 (149h59m18.29647132s) [upload=156000]: Got next segment. Inline: false Aug 14 23:25:23.865430435 (149h59m18.296510566s) [upload=156000]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 23:25:23.865434993 (149h59m18.296515114s) [upload=156000]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 23:25:24.427593929 (149h59m18.85867406s) [seg_pos={0 0}, upload=156000]: Begin upload segment... Aug 14 23:25:24.427659504 (149h59m18.858739635s) [seg_pos={0 0}, upload=156000]: Done begin upload segment. Aug 14 23:25:24.427681045 (149h59m18.858761167s) [noise=true , address=77.90.31.12:4594 , piece_id=PVTRB6VZG4GCAP44UDAKKP2VF4TN2ODKEBATJT7EYR2KD7EOQVMA, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.427712806 (149h59m18.858792937s) [noise=true , address=77.90.31.18:4809 , piece_id=TFDTIW6CWJXTN3KKGJTIACJT4ZXCSRAE4CM2W25BWPRLLGZI5UGA, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.428058338 (149h59m18.859138469s) [noise=true , address=79.127.219.48:4076 , piece_id=2MQMWXT5523NS5PYGDCQ4Z22CJ23KCN3S3UPCS7WI6TMU6X355CA, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.428321260 (149h59m18.859401391s) [noise=true , address=104.36.82.3:4796 , piece_id=5JBUWYKUBQHHBR2A7BZJOCN7HEQJKQ6FX3MWQS55QI7LGUH5PKSA, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.428582981 (149h59m18.859663112s) [noise=true , address=104.36.82.62:4436 , piece_id=5RTH5H3PD755UV2XLIRW5CNMDCZY6VCOTIKNZF7IMVMFDV5CQLQQ, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.428780519 (149h59m18.85986064s) [noise=true , address=104.36.82.44:4889 , piece_id=H2KS4DZ6I5UZ42TNCNXTPGYU573Q2KB45OBK3MTNP32H4Q2ILUDQ, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.428928291 (149h59m18.860008423s) [noise=true , address=104.36.82.34:4570 , piece_id=KUK5NYXHUA46Y3MZYC5USNVRSKUF6PLK5GSUPLWXRQXSECIOXLSQ, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.429112424 (149h59m18.860192555s) [noise=true , address=104.36.82.21:4494 , piece_id=3EU3EVA4ESIIUW5MVSAJEV5BP6GYIF4YSYFANMPU3H6EYD7M3HQQ, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.429144285 (149h59m18.860224406s) [noise=true , address=77.90.31.19:4851 , piece_id=RWQ6L76GA66LIVEHAYGU7SWE7T2LC6GGZ6NQJVTGHVZ76CA6X3EQ, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.429170645 (149h59m18.860250776s) [noise=true , address=104.36.82.15:4290 , piece_id=AM4FQ7FJUUI5LTV4RIETMT6MW5CS6V35B5QN52SDXKW5OD5YKFAQ, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.429384725 (149h59m18.860464856s) [noise=true , address=104.36.82.38:4707 , piece_id=6W3I4M7OO56SXQ6737N5LYU6EKXC3FOKJBDSS4XFRIWLFTTNGQMQ, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.429432106 (149h59m18.860512227s) [noise=true , address=79.127.201.215:4347 , piece_id=FULXIVH2YVM3AVFF33XJFMEJK2QAM7EA6WS6I5X7XPT4TR7YQDYA, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.429593535 (149h59m18.860673666s) [noise=true , address=104.36.82.46:4495 , piece_id=XNRCALQ6NSXEBUV7Z25OQ2E4DLDREK3XQKCNHZH3YWXA4OFIPVPA, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.429704938 (149h59m18.860785059s) [noise=true , address=104.36.82.60:4365 , piece_id=7WYNE5TBGOJM5R7MVCIZ7CDG5737XZGVMQRSFSPCVEWHRGSY3XMQ, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.429992358 (149h59m18.861072489s) [noise=true , address=104.36.82.51:4063 , piece_id=OBDG6K567SOAA2DERKZP4GSZERTUHRJEI7BJ4MIVL3JHPNMVJG4Q, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.430255922 (149h59m18.861336053s) [noise=true , address=77.90.31.21:4891 , piece_id=WK3MWAOBT4BQT5VA36KBN2RWUT5JVHBFPXTSZSRIH6J2HRSJW4IQ, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.430549503 (149h59m18.861629624s) [noise=true , address=104.36.82.59:4302 , piece_id=SFCJYOAJKPT26MASF3X4NYUHLV4HYCHPKCJUV2BWBH2TKC3RIVRA, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:24.430809041 (149h59m18.861889172s) [noise=true , address=45.91.116.9:4266 , piece_id=R6LXPDABDOXCMIFF2PV43BSKRBH4KXPLCGPZ3DU3H7HL66WWYWNQ, seg_pos={0 0}, upload=156000]: Uploading piece... Aug 14 23:25:25.923497549 (149h59m20.35457768s) [upload=156000]: Next returned nil segment Aug 14 23:25:25.923507829 (149h59m20.35458795s) [upload=156000]: Waiting for error group managing segments... Aug 14 23:25:26.337042342 (149h59m20.768122463s) [noise=true , address=79.127.219.48:4076 , piece_id=2MQMWXT5523NS5PYGDCQ4Z22CJ23KCN3S3UPCS7WI6TMU6X355CA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.350688071 (149h59m20.781768202s) [noise=true , address=77.90.31.21:4891 , piece_id=WK3MWAOBT4BQT5VA36KBN2RWUT5JVHBFPXTSZSRIH6J2HRSJW4IQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.367283975 (149h59m20.798364106s) [noise=true , address=104.36.82.59:4302 , piece_id=SFCJYOAJKPT26MASF3X4NYUHLV4HYCHPKCJUV2BWBH2TKC3RIVRA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.392847758 (149h59m20.823927889s) [noise=true , address=79.127.201.215:4347 , piece_id=FULXIVH2YVM3AVFF33XJFMEJK2QAM7EA6WS6I5X7XPT4TR7YQDYA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.476671684 (149h59m20.907751805s) [noise=true , address=104.36.82.34:4570 , piece_id=KUK5NYXHUA46Y3MZYC5USNVRSKUF6PLK5GSUPLWXRQXSECIOXLSQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.477883863 (149h59m20.908963994s) [noise=true , address=104.36.82.51:4063 , piece_id=OBDG6K567SOAA2DERKZP4GSZERTUHRJEI7BJ4MIVL3JHPNMVJG4Q, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.495071439 (149h59m20.92615157s) [noise=true , address=77.90.31.12:4594 , piece_id=PVTRB6VZG4GCAP44UDAKKP2VF4TN2ODKEBATJT7EYR2KD7EOQVMA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.499490865 (149h59m20.930571016s) [noise=true , address=104.36.82.3:4796 , piece_id=5JBUWYKUBQHHBR2A7BZJOCN7HEQJKQ6FX3MWQS55QI7LGUH5PKSA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.534749478 (149h59m20.965829599s) [noise=true , address=104.36.82.62:4436 , piece_id=5RTH5H3PD755UV2XLIRW5CNMDCZY6VCOTIKNZF7IMVMFDV5CQLQQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.567397536 (149h59m20.998477667s) [noise=true , address=77.90.31.19:4851 , piece_id=RWQ6L76GA66LIVEHAYGU7SWE7T2LC6GGZ6NQJVTGHVZ76CA6X3EQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.581324884 (149h59m21.012405015s) [noise=true , address=104.36.82.60:4365 , piece_id=7WYNE5TBGOJM5R7MVCIZ7CDG5737XZGVMQRSFSPCVEWHRGSY3XMQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.600511545 (149h59m21.031591676s) [noise=true , address=104.36.82.46:4495 , piece_id=XNRCALQ6NSXEBUV7Z25OQ2E4DLDREK3XQKCNHZH3YWXA4OFIPVPA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.602312732 (149h59m21.033392863s) [noise=true , address=77.90.31.18:4809 , piece_id=TFDTIW6CWJXTN3KKGJTIACJT4ZXCSRAE4CM2W25BWPRLLGZI5UGA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.614279168 (149h59m21.045359299s) [noise=true , address=45.91.116.9:4266 , piece_id=R6LXPDABDOXCMIFF2PV43BSKRBH4KXPLCGPZ3DU3H7HL66WWYWNQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil> Aug 14 23:25:26.614295228 (149h59m21.045375359s) [seg_pos={0 0}, upload=156000]: Segment reached optimal threshold of 14 pieces. Aug 14 23:25:26.614385762 (149h59m21.045465893s) [noise=true , address=104.36.82.44:4889 , piece_id=H2KS4DZ6I5UZ42TNCNXTPGYU573Q2KB45OBK3MTNP32H4Q2ILUDQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PCtJRFHPHi1dHJNcRnGZg8HZPQDfo5L3aw6DgVnUzVUz92Kyv): protocol: expected piece hash; context canceled; EOF Aug 14 23:25:26.614431238 (149h59m21.045511369s) [noise=true , address=104.36.82.15:4290 , piece_id=AM4FQ7FJUUI5LTV4RIETMT6MW5CS6V35B5QN52SDXKW5OD5YKFAQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FmG5i2o4BwJmdL9u2tqKGmTAUErivGEe63TbfDTPpBdELozfz): protocol: expected piece hash; context canceled; EOF Aug 14 23:25:26.614559364 (149h59m21.045639485s) [noise=true , address=104.36.82.21:4494 , piece_id=3EU3EVA4ESIIUW5MVSAJEV5BP6GYIF4YSYFANMPU3H6EYD7M3HQQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sRaMuQG18B5SfPpzxp5VWjrwe38SS38g4askmbURxU9tepJHi): protocol: expected piece hash; context canceled; EOF Aug 14 23:25:26.614656349 (149h59m21.04573647s) [noise=true , address=104.36.82.38:4707 , piece_id=6W3I4M7OO56SXQ6737N5LYU6EKXC3FOKJBDSS4XFRIWLFTTNGQMQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N7XaDABpimefP5xEz5Swk53fiZk4DTv5L8Hg5cNDgeG6gHP1T): protocol: write tcp 188.166.225.170:43504->104.36.82.38:4707: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 14 23:25:26.614687790 (149h59m21.045767921s) [seg_pos={0 0}, upload=156000]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 14 23:25:26.614759687 (149h59m21.045839818s) [upload=156000]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 14 23:25:26.614763564 (149h59m21.045843695s) [upload=156000]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 23:25:27.350074072 (149h59m21.781154203s) [upload=156000]: Done uploading segments... Aug 14 23:25:27.350115130 (149h59m21.781195261s) [upload=156000]: Upload finished. err: <nil> Duration: 4.598475035s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 21 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXX.......................................] duration: 6.045297453s FAIL (2025-08-14 23:25:26 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.045329284s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [......................................X.............X....X..] duration: 6.037942809s FAIL (2025-08-14 23:25:01 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 14 23:22:29.271248146 (149h56m23.702328277s) [upload=155951]: Starting upload Aug 14 23:22:29.271301599 (149h56m23.70238172s) [upload=155951]: Done starting upload Aug 14 23:22:29.271389708 (149h56m23.702469829s) [upload=155951]: Uploading segments... Aug 14 23:22:29.271553261 (149h56m23.702633392s) [upload=155951]: Got next segment. Inline: false Aug 14 23:22:29.271589570 (149h56m23.702669701s) [upload=155951]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 23:22:29.271594289 (149h56m23.70267442s) [upload=155951]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 23:22:29.718722150 (149h56m24.149802271s) [seg_pos={0 0}, upload=155951]: Begin upload segment... Aug 14 23:22:29.718775442 (149h56m24.149855573s) [seg_pos={0 0}, upload=155951]: Done begin upload segment. Aug 14 23:22:29.718797365 (149h56m24.149877496s) [noise=true , address=104.36.82.14:4239 , piece_id=KU3A65MKNSI3IGRKUKOAF5ZMN752AJJOLL3Z277AOHUXVDXC4XGQ, seg_pos={0 0}, upload=155951]: Uploading piece... Aug 14 23:22:29.719250611 (149h56m24.150330742s) [noise=true , address=104.36.82.5:4853 , piece_id=7FTCM4PE3U7B7HIKMUKFZKBR66WSFPZHM56PPWTE364NPL4GX35A, seg_pos={0 0}, upload=155951]: Uploading piece... Aug 14 23:22:29.719592145 (149h56m24.150672276s) [noise=true , address=104.36.82.18:4396 , piece_id=IMBHFLCYQM2FQRL5DVQTLO4KXUCOMDK67HTKXXXPXBKPJMK67IGQ, seg_pos={0 0}, upload=155951]: Uploading piece... Aug 14 23:22:29.719921505 (149h56m24.151001637s) [noise=true , address=77.90.31.16:4759 , piece_id=LWQ3CNAYFISJB524Z7G7MPRJL7HGXTJDCK6NJF42XMSTZYA7BIXA, seg_pos={0 0}, upload=155951]: Uploading piece... Aug 14 23:22:29.720233652 (149h56m24.151313773s) [noise=true , address=77.90.31.19:4868 , piece_id=2EXK67T4I56LCKDOWXUCAB3VNXEZ5FO4M2ACVFJMH2WJFU5KSECQ, seg_pos={0 0}, upload=155951]: Uploading piece... Aug 14 23:22:29.720811999 (149h56m24.15189212s) [noise=true , address=104.36.82.4:4817 , piece_id=ZHSFAM4OM7KE57YZCQ6WID2VJA254D2TF63RDH2BZFD5IEVFJDMQ, seg_pos={0 0}, upload=155951]: Uploading piece... Aug 14 23:22:29.721276367 (149h56m24.152356498s) [noise=true , address=79.127.220.97:4374 , piece_id=5AKG6ES6L3BLDABGY5SXHRSVCBATLFRCBMQLB3CJGT73E6RABRLA, seg_pos={0 0}, upload=155951]: Uploading piece... Aug 14 23:22:29.721656295 (149h56m24.152736426s) [noise=true , address=77.90.31.12:4602 , piece_id=DLFOIF6BKGVQFLM2NHBMHBSF5LVUAINQQ3LQGRTHKBJNN2YCBDPQ, seg_pos={0 0}, upload=155951]: Uploading piece... Aug 14 23:22:29.722570954 (149h56m24.153651075s) [noise=true , address=104.36.82.19:4412 , piece_id=MWJZAVQVIULLOW2RUFCZI4DUCMGSBIJTEGEETYLGBRV5ZUWHI6ZQ, seg_pos={0 0}, upload=155951]: Uploading piece... Aug 14 23:22:29.723533286 (149h56m24.154613407s) [noise=true , address=77.90.31.17:4800 , piece_id=ATPVNKSAFSB5I4WGJ3UGZUW3DUKSOZ56H3Z4J3ZV6TB7ALAWUMEA, seg_pos={0 0}, upload=155951]: Uploading piece... Aug 14 23:22:29.724389944 (149h56m24.155470065s) [noise=true , address=104.36.82.58:4290 , piece_id=TZ3HCARZKI2TDBQZ3ZYTQRMTY7O3DUZC7HNKXD2HDRVPW4SZLVFA, seg_pos={0 0}, upload=155951]: Uploading piece... Aug 14 23:22:29.724716379 (149h56m24.15579651s) [noise=true , address=79.127.201.215:4359 , piece_id=RLMOL3JTDISIDESBECK2MSBB7TYE6KUN6OY7KFDLD5ZKOWWO4UJQ, seg_pos={0 0}, upload=155951]: Uploading piece... Aug 14 23:22:29.724999612 (149h56m24.156079733s) [noise=true , address=104.36.82.13:4194 , piece_id=TMQM53UTJLZKJFU4Q7E32MLFAQDSEHF7OBZNA5HBP3MVP2PAO6EA, seg_pos={0 0}, upload=155951]: Uploading piece... Aug 14 23:22:29.725272453 (149h56m24.156352584s) [noise=true , address=104.36.82.5:4848 , piece_id=PIK6FZM5DLZU5QCZV7DPBXTVSLMBXWENMERD6NOLL6FZ4F56MIMA, seg_pos={0 0}, upload=155951]: Uploading piece... Aug 14 23:22:29.725500079 (149h56m24.15658021s) [noise=true , address=104.36.82.35:4606 , piece_id=BDNE264H6CG2UWJLXWGOHXOPAKX2HLBXNQMVGKPZCVAOK4XFCILA, seg_pos={0 0}, upload=155951]: Uploading piece... Aug 14 23:22:29.725725620 (149h56m24.156805751s) [noise=true , address=104.36.82.44:4890 , piece_id=I6IIIYJGUQ6YZHXOMRWXJMPXVP6GFPZCT5USD6TWFETSUSR5FEXA, seg_pos={0 0}, upload=155951]: Uploading piece... Aug 14 23:22:29.726046445 (149h56m24.157126576s) [noise=true , address=104.36.82.45:4924 , piece_id=N25SBLQWU4M2JWP7DRHF25PAHTKXEG2GBDVHIQAX52JMLHHQ5KHQ, seg_pos={0 0}, upload=155951]: Uploading piece... Aug 14 23:22:29.726301883 (149h56m24.157382014s) [noise=true , address=66.23.193.175:4554 , piece_id=42XOM3TTSQIPTCSPMP7ZE4AMIMVPMYVFQQ6RSFOIOGB3F4TFIGLQ, seg_pos={0 0}, upload=155951]: Uploading piece... Aug 14 23:22:30.875640360 (149h56m25.306720481s) [upload=155951]: Next returned nil segment Aug 14 23:22:30.875657804 (149h56m25.306737935s) [upload=155951]: Waiting for error group managing segments... Aug 14 23:22:31.164652808 (149h56m25.595732939s) [noise=true , address=66.23.193.175:4554 , piece_id=42XOM3TTSQIPTCSPMP7ZE4AMIMVPMYVFQQ6RSFOIOGB3F4TFIGLQ, seg_pos={0 0}, upload=155951]: Done uploading piece. err: <nil> Aug 14 23:22:31.577583947 (149h56m26.008664078s) [noise=true , address=79.127.220.97:4374 , piece_id=5AKG6ES6L3BLDABGY5SXHRSVCBATLFRCBMQLB3CJGT73E6RABRLA, seg_pos={0 0}, upload=155951]: Done uploading piece. err: <nil> Aug 14 23:22:31.647126337 (149h56m26.078206468s) [noise=true , address=77.90.31.12:4602 , piece_id=DLFOIF6BKGVQFLM2NHBMHBSF5LVUAINQQ3LQGRTHKBJNN2YCBDPQ, seg_pos={0 0}, upload=155951]: Done uploading piece. err: <nil> Aug 14 23:22:31.674427485 (149h56m26.105507616s) [noise=true , address=104.36.82.45:4924 , piece_id=N25SBLQWU4M2JWP7DRHF25PAHTKXEG2GBDVHIQAX52JMLHHQ5KHQ, seg_pos={0 0}, upload=155951]: Done uploading piece. err: <nil> Aug 14 23:22:31.682682128 (149h56m26.113762259s) [noise=true , address=104.36.82.18:4396 , piece_id=IMBHFLCYQM2FQRL5DVQTLO4KXUCOMDK67HTKXXXPXBKPJMK67IGQ, seg_pos={0 0}, upload=155951]: Done uploading piece. err: <nil> Aug 14 23:22:31.706798873 (149h56m26.137879004s) [noise=true , address=104.36.82.5:4848 , piece_id=PIK6FZM5DLZU5QCZV7DPBXTVSLMBXWENMERD6NOLL6FZ4F56MIMA, seg_pos={0 0}, upload=155951]: Done uploading piece. err: <nil> Aug 14 23:22:31.719247882 (149h56m26.150328014s) [noise=true , address=77.90.31.19:4868 , piece_id=2EXK67T4I56LCKDOWXUCAB3VNXEZ5FO4M2ACVFJMH2WJFU5KSECQ, seg_pos={0 0}, upload=155951]: Done uploading piece. err: <nil> Aug 14 23:22:31.721246286 (149h56m26.152326417s) [noise=true , address=79.127.201.215:4359 , piece_id=RLMOL3JTDISIDESBECK2MSBB7TYE6KUN6OY7KFDLD5ZKOWWO4UJQ, seg_pos={0 0}, upload=155951]: Done uploading piece. err: <nil> Aug 14 23:22:31.758341282 (149h56m26.189421413s) [noise=true , address=104.36.82.5:4853 , piece_id=7FTCM4PE3U7B7HIKMUKFZKBR66WSFPZHM56PPWTE364NPL4GX35A, seg_pos={0 0}, upload=155951]: Done uploading piece. err: <nil> Aug 14 23:22:31.794838284 (149h56m26.225918406s) [noise=true , address=77.90.31.17:4800 , piece_id=ATPVNKSAFSB5I4WGJ3UGZUW3DUKSOZ56H3Z4J3ZV6TB7ALAWUMEA, seg_pos={0 0}, upload=155951]: Done uploading piece. err: <nil> Aug 14 23:22:31.855750842 (149h56m26.286830973s) [noise=true , address=77.90.31.16:4759 , piece_id=LWQ3CNAYFISJB524Z7G7MPRJL7HGXTJDCK6NJF42XMSTZYA7BIXA, seg_pos={0 0}, upload=155951]: Done uploading piece. err: <nil> Aug 14 23:22:31.864354124 (149h56m26.295434255s) [noise=true , address=104.36.82.4:4817 , piece_id=ZHSFAM4OM7KE57YZCQ6WID2VJA254D2TF63RDH2BZFD5IEVFJDMQ, seg_pos={0 0}, upload=155951]: Done uploading piece. err: <nil> Aug 14 23:22:31.882957379 (149h56m26.3140375s) [noise=true , address=104.36.82.19:4412 , piece_id=MWJZAVQVIULLOW2RUFCZI4DUCMGSBIJTEGEETYLGBRV5ZUWHI6ZQ, seg_pos={0 0}, upload=155951]: Done uploading piece. err: <nil> Aug 14 23:22:31.895810972 (149h56m26.326891103s) [noise=true , address=104.36.82.13:4194 , piece_id=TMQM53UTJLZKJFU4Q7E32MLFAQDSEHF7OBZNA5HBP3MVP2PAO6EA, seg_pos={0 0}, upload=155951]: Done uploading piece. err: <nil> Aug 14 23:22:31.895826693 (149h56m26.326906814s) [seg_pos={0 0}, upload=155951]: Segment reached optimal threshold of 14 pieces. Aug 14 23:22:31.896139110 (149h56m26.327219241s) [noise=true , address=104.36.82.44:4890 , piece_id=I6IIIYJGUQ6YZHXOMRWXJMPXVP6GFPZCT5USD6TWFETSUSR5FEXA, seg_pos={0 0}, upload=155951]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XYhMcqH63UiHYE4ofxDxjXz2HMvN1RfQjgxxxHcUst7P3aN7M): protocol: expected piece hash; context canceled; EOF Aug 14 23:22:31.896241717 (149h56m26.327321848s) [noise=true , address=104.36.82.58:4290 , piece_id=TZ3HCARZKI2TDBQZ3ZYTQRMTY7O3DUZC7HNKXD2HDRVPW4SZLVFA, seg_pos={0 0}, upload=155951]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YieSs1jRT5hKVKc7DuME4rFeX2BmeNngjBaGoB2hRrNwiLakv): protocol: rpc: dial tcp 104.36.82.58:4290: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Aug 14 23:22:31.896268748 (149h56m26.32734889s) [noise=true , address=104.36.82.35:4606 , piece_id=BDNE264H6CG2UWJLXWGOHXOPAKX2HLBXNQMVGKPZCVAOK4XFCILA, seg_pos={0 0}, upload=155951]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iPDQbkaZ3jmN5pSD8V8btwuXh1hx1hhYVNL14JzXf4dQXdVsW): protocol: write tcp 188.166.225.170:35578->104.36.82.35:4606: use of closed network connection; write tcp 188.166.225.170:35578->104.36.82.35:4606: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35578->104.36.82.35:4606: use of closed network connection Aug 14 23:22:31.896307172 (149h56m26.327387303s) [noise=true , address=104.36.82.14:4239 , piece_id=KU3A65MKNSI3IGRKUKOAF5ZMN752AJJOLL3Z277AOHUXVDXC4XGQ, seg_pos={0 0}, upload=155951]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pTRYQDUQVz3nNo46TfMeaihJoP2zvTMfgvTNjUMF8iePz5MvV): protocol: read tcp 188.166.225.170:42008->104.36.82.14:4239: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 14 23:22:31.896336297 (149h56m26.327416428s) [seg_pos={0 0}, upload=155951]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 14 23:22:31.896404488 (149h56m26.327484609s) [upload=155951]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 14 23:22:31.896408416 (149h56m26.327488547s) [upload=155951]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 23:22:32.216485901 (149h56m26.647566032s) [upload=155951]: Done uploading segments... Aug 14 23:22:32.216505529 (149h56m26.64758566s) [upload=155951]: Upload finished. err: <nil> Duration: 6.037966183s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 22 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXX......................................] duration: 6.161294338s FAIL (2025-08-14 23:24:57 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.161340415s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 760.834926ms FAIL (2025-08-14 23:24:39 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": remote error: tls: internal error Duration: 760.860133ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...............................X.......X..................X.] duration: 2.045891969s FAIL (2025-08-14 23:24:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 23:23:25.708535090 (149h57m20.139615221s) [upload=155967]: Starting upload Aug 14 23:23:25.708582129 (149h57m20.13966226s) [upload=155967]: Done starting upload Aug 14 23:23:25.708683684 (149h57m20.139763825s) [upload=155967]: Uploading segments... Aug 14 23:23:25.708784046 (149h57m20.139864177s) [upload=155967]: Got next segment. Inline: true Aug 14 23:23:25.708791670 (149h57m20.139871791s) [upload=155967]: Waiting for error group managing segments... Aug 14 23:23:25.708833912 (149h57m20.139914043s) [upload=155967]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 23:23:25.708838921 (149h57m20.139919052s) [upload=155967]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 23:23:25.708841696 (149h57m20.139921827s) [upload=155967]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 23:23:25.923862328 (149h57m20.354942459s) [upload=155967]: Done uploading segments... Aug 14 23:23:25.923880343 (149h57m20.354960464s) [upload=155967]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.045921296s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 23 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXX.....................................] duration: 6.143897056s FAIL (2025-08-14 23:24:21 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.143917866s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 773.181258ms FAIL (2025-08-14 23:24:12 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": remote error: tls: internal error Duration: 773.206608ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.......................................X.............X....X.] duration: 8.63386647s FAIL (2025-08-14 23:23:52 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 14 23:22:29.271248146 (149h56m23.702328277s) [upload=155951]: Starting upload Aug 14 23:22:29.271301599 (149h56m23.70238172s) [upload=155951]: Done starting upload Aug 14 23:22:29.271389708 (149h56m23.702469829s) [upload=155951]: Uploading segments... Aug 14 23:22:29.271553261 (149h56m23.702633392s) [upload=155951]: Got next segment. Inline: false Aug 14 23:22:29.271589570 (149h56m23.702669701s) [upload=155951]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 23:22:29.271594289 (149h56m23.70267442s) [upload=155951]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 23:22:29.718722150 (149h56m24.149802271s) [seg_pos={0 0}, upload=155951]: Begin upload segment... Aug 14 23:22:29.718775442 (149h56m24.149855573s) [seg_pos={0 0}, upload=155951]: Done begin upload segment. Aug 14 23:22:29.718797365 (149h56m24.149877496s) [noise=true , address=104.36.82.14:4239 , piece_id=KU3A65MKNSI3IGRKUKOAF5ZMN752AJJOLL3Z277AOHUXVDXC4XGQ, seg_pos={0 0}, upload=155951]: Uploading piece... Aug 14 23:22:29.719250611 (149h56m24.150330742s) [noise=true , address=104.36.82.5:4853 , piece_id=7FTCM4PE3U7B7HIKMUKFZKBR66WSFPZHM56PPWTE364NPL4GX35A, seg_pos={0 0}, upload=155951]: Uploading piece... Aug 14 23:22:29.719592145 (149h56m24.150672276s) [noise=true , address=104.36.82.18:4396 , piece_id=IMBHFLCYQM2FQRL5DVQTLO4KXUCOMDK67HTKXXXPXBKPJMK67IGQ, seg_pos={0 0}, upload=155951]: Uploading piece... Aug 14 23:22:29.719921505 (149h56m24.151001637s) [noise=true , address=77.90.31.16:4759 , piece_id=LWQ3CNAYFISJB524Z7G7MPRJL7HGXTJDCK6NJF42XMSTZYA7BIXA, seg_pos={0 0}, upload=155951]: Uploading piece... Aug 14 23:22:29.720233652 (149h56m24.151313773s) [noise=true , address=77.90.31.19:4868 , piece_id=2EXK67T4I56LCKDOWXUCAB3VNXEZ5FO4M2ACVFJMH2WJFU5KSECQ, seg_pos={0 0}, upload=155951]: Uploading piece... Aug 14 23:22:29.720811999 (149h56m24.15189212s) [noise=true , address=104.36.82.4:4817 , piece_id=ZHSFAM4OM7KE57YZCQ6WID2VJA254D2TF63RDH2BZFD5IEVFJDMQ, seg_pos={0 0}, upload=155951]: Uploading piece... Aug 14 23:22:29.721276367 (149h56m24.152356498s) [noise=true , address=79.127.220.97:4374 , piece_id=5AKG6ES6L3BLDABGY5SXHRSVCBATLFRCBMQLB3CJGT73E6RABRLA, seg_pos={0 0}, upload=155951]: Uploading piece... Aug 14 23:22:29.721656295 (149h56m24.152736426s) [noise=true , address=77.90.31.12:4602 , piece_id=DLFOIF6BKGVQFLM2NHBMHBSF5LVUAINQQ3LQGRTHKBJNN2YCBDPQ, seg_pos={0 0}, upload=155951]: Uploading piece... Aug 14 23:22:29.722570954 (149h56m24.153651075s) [noise=true , address=104.36.82.19:4412 , piece_id=MWJZAVQVIULLOW2RUFCZI4DUCMGSBIJTEGEETYLGBRV5ZUWHI6ZQ, seg_pos={0 0}, upload=155951]: Uploading piece... Aug 14 23:22:29.723533286 (149h56m24.154613407s) [noise=true , address=77.90.31.17:4800 , piece_id=ATPVNKSAFSB5I4WGJ3UGZUW3DUKSOZ56H3Z4J3ZV6TB7ALAWUMEA, seg_pos={0 0}, upload=155951]: Uploading piece... Aug 14 23:22:29.724389944 (149h56m24.155470065s) [noise=true , address=104.36.82.58:4290 , piece_id=TZ3HCARZKI2TDBQZ3ZYTQRMTY7O3DUZC7HNKXD2HDRVPW4SZLVFA, seg_pos={0 0}, upload=155951]: Uploading piece... Aug 14 23:22:29.724716379 (149h56m24.15579651s) [noise=true , address=79.127.201.215:4359 , piece_id=RLMOL3JTDISIDESBECK2MSBB7TYE6KUN6OY7KFDLD5ZKOWWO4UJQ, seg_pos={0 0}, upload=155951]: Uploading piece... Aug 14 23:22:29.724999612 (149h56m24.156079733s) [noise=true , address=104.36.82.13:4194 , piece_id=TMQM53UTJLZKJFU4Q7E32MLFAQDSEHF7OBZNA5HBP3MVP2PAO6EA, seg_pos={0 0}, upload=155951]: Uploading piece... Aug 14 23:22:29.725272453 (149h56m24.156352584s) [noise=true , address=104.36.82.5:4848 , piece_id=PIK6FZM5DLZU5QCZV7DPBXTVSLMBXWENMERD6NOLL6FZ4F56MIMA, seg_pos={0 0}, upload=155951]: Uploading piece... Aug 14 23:22:29.725500079 (149h56m24.15658021s) [noise=true , address=104.36.82.35:4606 , piece_id=BDNE264H6CG2UWJLXWGOHXOPAKX2HLBXNQMVGKPZCVAOK4XFCILA, seg_pos={0 0}, upload=155951]: Uploading piece... Aug 14 23:22:29.725725620 (149h56m24.156805751s) [noise=true , address=104.36.82.44:4890 , piece_id=I6IIIYJGUQ6YZHXOMRWXJMPXVP6GFPZCT5USD6TWFETSUSR5FEXA, seg_pos={0 0}, upload=155951]: Uploading piece... Aug 14 23:22:29.726046445 (149h56m24.157126576s) [noise=true , address=104.36.82.45:4924 , piece_id=N25SBLQWU4M2JWP7DRHF25PAHTKXEG2GBDVHIQAX52JMLHHQ5KHQ, seg_pos={0 0}, upload=155951]: Uploading piece... Aug 14 23:22:29.726301883 (149h56m24.157382014s) [noise=true , address=66.23.193.175:4554 , piece_id=42XOM3TTSQIPTCSPMP7ZE4AMIMVPMYVFQQ6RSFOIOGB3F4TFIGLQ, seg_pos={0 0}, upload=155951]: Uploading piece... Aug 14 23:22:30.875640360 (149h56m25.306720481s) [upload=155951]: Next returned nil segment Aug 14 23:22:30.875657804 (149h56m25.306737935s) [upload=155951]: Waiting for error group managing segments... Aug 14 23:22:31.164652808 (149h56m25.595732939s) [noise=true , address=66.23.193.175:4554 , piece_id=42XOM3TTSQIPTCSPMP7ZE4AMIMVPMYVFQQ6RSFOIOGB3F4TFIGLQ, seg_pos={0 0}, upload=155951]: Done uploading piece. err: <nil> Aug 14 23:22:31.577583947 (149h56m26.008664078s) [noise=true , address=79.127.220.97:4374 , piece_id=5AKG6ES6L3BLDABGY5SXHRSVCBATLFRCBMQLB3CJGT73E6RABRLA, seg_pos={0 0}, upload=155951]: Done uploading piece. err: <nil> Aug 14 23:22:31.647126337 (149h56m26.078206468s) [noise=true , address=77.90.31.12:4602 , piece_id=DLFOIF6BKGVQFLM2NHBMHBSF5LVUAINQQ3LQGRTHKBJNN2YCBDPQ, seg_pos={0 0}, upload=155951]: Done uploading piece. err: <nil> Aug 14 23:22:31.674427485 (149h56m26.105507616s) [noise=true , address=104.36.82.45:4924 , piece_id=N25SBLQWU4M2JWP7DRHF25PAHTKXEG2GBDVHIQAX52JMLHHQ5KHQ, seg_pos={0 0}, upload=155951]: Done uploading piece. err: <nil> Aug 14 23:22:31.682682128 (149h56m26.113762259s) [noise=true , address=104.36.82.18:4396 , piece_id=IMBHFLCYQM2FQRL5DVQTLO4KXUCOMDK67HTKXXXPXBKPJMK67IGQ, seg_pos={0 0}, upload=155951]: Done uploading piece. err: <nil> Aug 14 23:22:31.706798873 (149h56m26.137879004s) [noise=true , address=104.36.82.5:4848 , piece_id=PIK6FZM5DLZU5QCZV7DPBXTVSLMBXWENMERD6NOLL6FZ4F56MIMA, seg_pos={0 0}, upload=155951]: Done uploading piece. err: <nil> Aug 14 23:22:31.719247882 (149h56m26.150328014s) [noise=true , address=77.90.31.19:4868 , piece_id=2EXK67T4I56LCKDOWXUCAB3VNXEZ5FO4M2ACVFJMH2WJFU5KSECQ, seg_pos={0 0}, upload=155951]: Done uploading piece. err: <nil> Aug 14 23:22:31.721246286 (149h56m26.152326417s) [noise=true , address=79.127.201.215:4359 , piece_id=RLMOL3JTDISIDESBECK2MSBB7TYE6KUN6OY7KFDLD5ZKOWWO4UJQ, seg_pos={0 0}, upload=155951]: Done uploading piece. err: <nil> Aug 14 23:22:31.758341282 (149h56m26.189421413s) [noise=true , address=104.36.82.5:4853 , piece_id=7FTCM4PE3U7B7HIKMUKFZKBR66WSFPZHM56PPWTE364NPL4GX35A, seg_pos={0 0}, upload=155951]: Done uploading piece. err: <nil> Aug 14 23:22:31.794838284 (149h56m26.225918406s) [noise=true , address=77.90.31.17:4800 , piece_id=ATPVNKSAFSB5I4WGJ3UGZUW3DUKSOZ56H3Z4J3ZV6TB7ALAWUMEA, seg_pos={0 0}, upload=155951]: Done uploading piece. err: <nil> Aug 14 23:22:31.855750842 (149h56m26.286830973s) [noise=true , address=77.90.31.16:4759 , piece_id=LWQ3CNAYFISJB524Z7G7MPRJL7HGXTJDCK6NJF42XMSTZYA7BIXA, seg_pos={0 0}, upload=155951]: Done uploading piece. err: <nil> Aug 14 23:22:31.864354124 (149h56m26.295434255s) [noise=true , address=104.36.82.4:4817 , piece_id=ZHSFAM4OM7KE57YZCQ6WID2VJA254D2TF63RDH2BZFD5IEVFJDMQ, seg_pos={0 0}, upload=155951]: Done uploading piece. err: <nil> Aug 14 23:22:31.882957379 (149h56m26.3140375s) [noise=true , address=104.36.82.19:4412 , piece_id=MWJZAVQVIULLOW2RUFCZI4DUCMGSBIJTEGEETYLGBRV5ZUWHI6ZQ, seg_pos={0 0}, upload=155951]: Done uploading piece. err: <nil> Aug 14 23:22:31.895810972 (149h56m26.326891103s) [noise=true , address=104.36.82.13:4194 , piece_id=TMQM53UTJLZKJFU4Q7E32MLFAQDSEHF7OBZNA5HBP3MVP2PAO6EA, seg_pos={0 0}, upload=155951]: Done uploading piece. err: <nil> Aug 14 23:22:31.895826693 (149h56m26.326906814s) [seg_pos={0 0}, upload=155951]: Segment reached optimal threshold of 14 pieces. Aug 14 23:22:31.896139110 (149h56m26.327219241s) [noise=true , address=104.36.82.44:4890 , piece_id=I6IIIYJGUQ6YZHXOMRWXJMPXVP6GFPZCT5USD6TWFETSUSR5FEXA, seg_pos={0 0}, upload=155951]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XYhMcqH63UiHYE4ofxDxjXz2HMvN1RfQjgxxxHcUst7P3aN7M): protocol: expected piece hash; context canceled; EOF Aug 14 23:22:31.896241717 (149h56m26.327321848s) [noise=true , address=104.36.82.58:4290 , piece_id=TZ3HCARZKI2TDBQZ3ZYTQRMTY7O3DUZC7HNKXD2HDRVPW4SZLVFA, seg_pos={0 0}, upload=155951]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YieSs1jRT5hKVKc7DuME4rFeX2BmeNngjBaGoB2hRrNwiLakv): protocol: rpc: dial tcp 104.36.82.58:4290: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Aug 14 23:22:31.896268748 (149h56m26.32734889s) [noise=true , address=104.36.82.35:4606 , piece_id=BDNE264H6CG2UWJLXWGOHXOPAKX2HLBXNQMVGKPZCVAOK4XFCILA, seg_pos={0 0}, upload=155951]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iPDQbkaZ3jmN5pSD8V8btwuXh1hx1hhYVNL14JzXf4dQXdVsW): protocol: write tcp 188.166.225.170:35578->104.36.82.35:4606: use of closed network connection; write tcp 188.166.225.170:35578->104.36.82.35:4606: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35578->104.36.82.35:4606: use of closed network connection Aug 14 23:22:31.896307172 (149h56m26.327387303s) [noise=true , address=104.36.82.14:4239 , piece_id=KU3A65MKNSI3IGRKUKOAF5ZMN752AJJOLL3Z277AOHUXVDXC4XGQ, seg_pos={0 0}, upload=155951]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pTRYQDUQVz3nNo46TfMeaihJoP2zvTMfgvTNjUMF8iePz5MvV): protocol: read tcp 188.166.225.170:42008->104.36.82.14:4239: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 14 23:22:31.896336297 (149h56m26.327416428s) [seg_pos={0 0}, upload=155951]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 14 23:22:31.896404488 (149h56m26.327484609s) [upload=155951]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 14 23:22:31.896408416 (149h56m26.327488547s) [upload=155951]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 23:22:32.216485901 (149h56m26.647566032s) [upload=155951]: Done uploading segments... Aug 14 23:22:32.216505529 (149h56m26.64758566s) [upload=155951]: Upload finished. err: <nil> Duration: 8.633891678s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 24 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXX....................................] duration: 5.913531036s FAIL (2025-08-14 23:23:27 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.913572676s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [................................X.......X..................X] duration: 865.996096ms FAIL (2025-08-14 23:23:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 23:23:25.708535090 (149h57m20.139615221s) [upload=155967]: Starting upload Aug 14 23:23:25.708582129 (149h57m20.13966226s) [upload=155967]: Done starting upload Aug 14 23:23:25.708683684 (149h57m20.139763825s) [upload=155967]: Uploading segments... Aug 14 23:23:25.708784046 (149h57m20.139864177s) [upload=155967]: Got next segment. Inline: true Aug 14 23:23:25.708791670 (149h57m20.139871791s) [upload=155967]: Waiting for error group managing segments... Aug 14 23:23:25.708833912 (149h57m20.139914043s) [upload=155967]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 23:23:25.708838921 (149h57m20.139919052s) [upload=155967]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 23:23:25.708841696 (149h57m20.139921827s) [upload=155967]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 23:23:25.923862328 (149h57m20.354942459s) [upload=155967]: Done uploading segments... Aug 14 23:23:25.923880343 (149h57m20.354960464s) [upload=155967]: Upload finished. err: metaclient: Too Many Requests Duration:* 866.018388ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 764.653322ms FAIL (2025-08-14 23:23:20 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": remote error: tls: internal error Duration: 764.69942ms edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 25 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXX...................................] duration: 6.336254966s FAIL (2025-08-14 23:23:11 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.336277149s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 747.566038ms FAIL (2025-08-14 23:22:55 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": remote error: tls: internal error Duration: 747.601036ms edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 25 out of 60 is failed (threshold=3) [.XXXXXXXXXXXXXXXXXXXXXXXXX..................................] duration: 6.596864979s FAIL (2025-08-14 23:22:54 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.596887482s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.................................X.......X..................] duration: 1.935219046s FAIL (2025-08-14 23:22:34 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 14 23:09:30.496311157 (149h43m24.927391288s) [upload=155721]: Starting upload Aug 14 23:09:30.496358919 (149h43m24.92743905s) [upload=155721]: Done starting upload Aug 14 23:09:30.496409976 (149h43m24.927490107s) [upload=155721]: Uploading segments... Aug 14 23:09:30.496446436 (149h43m24.927526567s) [upload=155721]: Got next segment. Inline: true Aug 14 23:09:30.496450264 (149h43m24.927530395s) [upload=155721]: Waiting for error group managing segments... Aug 14 23:09:30.496483657 (149h43m24.927563788s) [upload=155721]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 23:09:30.496487354 (149h43m24.927567485s) [upload=155721]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 23:09:30.496489648 (149h43m24.927569779s) [upload=155721]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 23:09:33.939233724 (149h43m28.370313845s) [upload=155721]: Done uploading segments... Aug 14 23:09:33.939252460 (149h43m28.370332591s) [upload=155721]: Upload finished. err: <nil> Duration:* 1.935246539s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 732.587139ms FAIL (2025-08-14 23:22:34 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": remote error: tls: internal error Duration: 732.610104ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [........................................X.............X....X] duration: 4.24886821s FAIL (2025-08-14 23:22:32 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 14 23:22:29.271248146 (149h56m23.702328277s) [upload=155951]: Starting upload Aug 14 23:22:29.271301599 (149h56m23.70238172s) [upload=155951]: Done starting upload Aug 14 23:22:29.271389708 (149h56m23.702469829s) [upload=155951]: Uploading segments... Aug 14 23:22:29.271553261 (149h56m23.702633392s) [upload=155951]: Got next segment. Inline: false Aug 14 23:22:29.271589570 (149h56m23.702669701s) [upload=155951]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 23:22:29.271594289 (149h56m23.70267442s) [upload=155951]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 23:22:29.718722150 (149h56m24.149802271s) [seg_pos={0 0}, upload=155951]: Begin upload segment... Aug 14 23:22:29.718775442 (149h56m24.149855573s) [seg_pos={0 0}, upload=155951]: Done begin upload segment. Aug 14 23:22:29.718797365 (149h56m24.149877496s) [noise=true , address=104.36.82.14:4239 , piece_id=KU3A65MKNSI3IGRKUKOAF5ZMN752AJJOLL3Z277AOHUXVDXC4XGQ, seg_pos={0 0}, upload=155951]: Uploading piece... Aug 14 23:22:29.719250611 (149h56m24.150330742s) [noise=true , address=104.36.82.5:4853 , piece_id=7FTCM4PE3U7B7HIKMUKFZKBR66WSFPZHM56PPWTE364NPL4GX35A, seg_pos={0 0}, upload=155951]: Uploading piece... Aug 14 23:22:29.719592145 (149h56m24.150672276s) [noise=true , address=104.36.82.18:4396 , piece_id=IMBHFLCYQM2FQRL5DVQTLO4KXUCOMDK67HTKXXXPXBKPJMK67IGQ, seg_pos={0 0}, upload=155951]: Uploading piece... Aug 14 23:22:29.719921505 (149h56m24.151001637s) [noise=true , address=77.90.31.16:4759 , piece_id=LWQ3CNAYFISJB524Z7G7MPRJL7HGXTJDCK6NJF42XMSTZYA7BIXA, seg_pos={0 0}, upload=155951]: Uploading piece... Aug 14 23:22:29.720233652 (149h56m24.151313773s) [noise=true , address=77.90.31.19:4868 , piece_id=2EXK67T4I56LCKDOWXUCAB3VNXEZ5FO4M2ACVFJMH2WJFU5KSECQ, seg_pos={0 0}, upload=155951]: Uploading piece... Aug 14 23:22:29.720811999 (149h56m24.15189212s) [noise=true , address=104.36.82.4:4817 , piece_id=ZHSFAM4OM7KE57YZCQ6WID2VJA254D2TF63RDH2BZFD5IEVFJDMQ, seg_pos={0 0}, upload=155951]: Uploading piece... Aug 14 23:22:29.721276367 (149h56m24.152356498s) [noise=true , address=79.127.220.97:4374 , piece_id=5AKG6ES6L3BLDABGY5SXHRSVCBATLFRCBMQLB3CJGT73E6RABRLA, seg_pos={0 0}, upload=155951]: Uploading piece... Aug 14 23:22:29.721656295 (149h56m24.152736426s) [noise=true , address=77.90.31.12:4602 , piece_id=DLFOIF6BKGVQFLM2NHBMHBSF5LVUAINQQ3LQGRTHKBJNN2YCBDPQ, seg_pos={0 0}, upload=155951]: Uploading piece... Aug 14 23:22:29.722570954 (149h56m24.153651075s) [noise=true , address=104.36.82.19:4412 , piece_id=MWJZAVQVIULLOW2RUFCZI4DUCMGSBIJTEGEETYLGBRV5ZUWHI6ZQ, seg_pos={0 0}, upload=155951]: Uploading piece... Aug 14 23:22:29.723533286 (149h56m24.154613407s) [noise=true , address=77.90.31.17:4800 , piece_id=ATPVNKSAFSB5I4WGJ3UGZUW3DUKSOZ56H3Z4J3ZV6TB7ALAWUMEA, seg_pos={0 0}, upload=155951]: Uploading piece... Aug 14 23:22:29.724389944 (149h56m24.155470065s) [noise=true , address=104.36.82.58:4290 , piece_id=TZ3HCARZKI2TDBQZ3ZYTQRMTY7O3DUZC7HNKXD2HDRVPW4SZLVFA, seg_pos={0 0}, upload=155951]: Uploading piece... Aug 14 23:22:29.724716379 (149h56m24.15579651s) [noise=true , address=79.127.201.215:4359 , piece_id=RLMOL3JTDISIDESBECK2MSBB7TYE6KUN6OY7KFDLD5ZKOWWO4UJQ, seg_pos={0 0}, upload=155951]: Uploading piece... Aug 14 23:22:29.724999612 (149h56m24.156079733s) [noise=true , address=104.36.82.13:4194 , piece_id=TMQM53UTJLZKJFU4Q7E32MLFAQDSEHF7OBZNA5HBP3MVP2PAO6EA, seg_pos={0 0}, upload=155951]: Uploading piece... Aug 14 23:22:29.725272453 (149h56m24.156352584s) [noise=true , address=104.36.82.5:4848 , piece_id=PIK6FZM5DLZU5QCZV7DPBXTVSLMBXWENMERD6NOLL6FZ4F56MIMA, seg_pos={0 0}, upload=155951]: Uploading piece... Aug 14 23:22:29.725500079 (149h56m24.15658021s) [noise=true , address=104.36.82.35:4606 , piece_id=BDNE264H6CG2UWJLXWGOHXOPAKX2HLBXNQMVGKPZCVAOK4XFCILA, seg_pos={0 0}, upload=155951]: Uploading piece... Aug 14 23:22:29.725725620 (149h56m24.156805751s) [noise=true , address=104.36.82.44:4890 , piece_id=I6IIIYJGUQ6YZHXOMRWXJMPXVP6GFPZCT5USD6TWFETSUSR5FEXA, seg_pos={0 0}, upload=155951]: Uploading piece... Aug 14 23:22:29.726046445 (149h56m24.157126576s) [noise=true , address=104.36.82.45:4924 , piece_id=N25SBLQWU4M2JWP7DRHF25PAHTKXEG2GBDVHIQAX52JMLHHQ5KHQ, seg_pos={0 0}, upload=155951]: Uploading piece... Aug 14 23:22:29.726301883 (149h56m24.157382014s) [noise=true , address=66.23.193.175:4554 , piece_id=42XOM3TTSQIPTCSPMP7ZE4AMIMVPMYVFQQ6RSFOIOGB3F4TFIGLQ, seg_pos={0 0}, upload=155951]: Uploading piece... Aug 14 23:22:30.875640360 (149h56m25.306720481s) [upload=155951]: Next returned nil segment Aug 14 23:22:30.875657804 (149h56m25.306737935s) [upload=155951]: Waiting for error group managing segments... Aug 14 23:22:31.164652808 (149h56m25.595732939s) [noise=true , address=66.23.193.175:4554 , piece_id=42XOM3TTSQIPTCSPMP7ZE4AMIMVPMYVFQQ6RSFOIOGB3F4TFIGLQ, seg_pos={0 0}, upload=155951]: Done uploading piece. err: <nil> Aug 14 23:22:31.577583947 (149h56m26.008664078s) [noise=true , address=79.127.220.97:4374 , piece_id=5AKG6ES6L3BLDABGY5SXHRSVCBATLFRCBMQLB3CJGT73E6RABRLA, seg_pos={0 0}, upload=155951]: Done uploading piece. err: <nil> Aug 14 23:22:31.647126337 (149h56m26.078206468s) [noise=true , address=77.90.31.12:4602 , piece_id=DLFOIF6BKGVQFLM2NHBMHBSF5LVUAINQQ3LQGRTHKBJNN2YCBDPQ, seg_pos={0 0}, upload=155951]: Done uploading piece. err: <nil> Aug 14 23:22:31.674427485 (149h56m26.105507616s) [noise=true , address=104.36.82.45:4924 , piece_id=N25SBLQWU4M2JWP7DRHF25PAHTKXEG2GBDVHIQAX52JMLHHQ5KHQ, seg_pos={0 0}, upload=155951]: Done uploading piece. err: <nil> Aug 14 23:22:31.682682128 (149h56m26.113762259s) [noise=true , address=104.36.82.18:4396 , piece_id=IMBHFLCYQM2FQRL5DVQTLO4KXUCOMDK67HTKXXXPXBKPJMK67IGQ, seg_pos={0 0}, upload=155951]: Done uploading piece. err: <nil> Aug 14 23:22:31.706798873 (149h56m26.137879004s) [noise=true , address=104.36.82.5:4848 , piece_id=PIK6FZM5DLZU5QCZV7DPBXTVSLMBXWENMERD6NOLL6FZ4F56MIMA, seg_pos={0 0}, upload=155951]: Done uploading piece. err: <nil> Aug 14 23:22:31.719247882 (149h56m26.150328014s) [noise=true , address=77.90.31.19:4868 , piece_id=2EXK67T4I56LCKDOWXUCAB3VNXEZ5FO4M2ACVFJMH2WJFU5KSECQ, seg_pos={0 0}, upload=155951]: Done uploading piece. err: <nil> Aug 14 23:22:31.721246286 (149h56m26.152326417s) [noise=true , address=79.127.201.215:4359 , piece_id=RLMOL3JTDISIDESBECK2MSBB7TYE6KUN6OY7KFDLD5ZKOWWO4UJQ, seg_pos={0 0}, upload=155951]: Done uploading piece. err: <nil> Aug 14 23:22:31.758341282 (149h56m26.189421413s) [noise=true , address=104.36.82.5:4853 , piece_id=7FTCM4PE3U7B7HIKMUKFZKBR66WSFPZHM56PPWTE364NPL4GX35A, seg_pos={0 0}, upload=155951]: Done uploading piece. err: <nil> Aug 14 23:22:31.794838284 (149h56m26.225918406s) [noise=true , address=77.90.31.17:4800 , piece_id=ATPVNKSAFSB5I4WGJ3UGZUW3DUKSOZ56H3Z4J3ZV6TB7ALAWUMEA, seg_pos={0 0}, upload=155951]: Done uploading piece. err: <nil> Aug 14 23:22:31.855750842 (149h56m26.286830973s) [noise=true , address=77.90.31.16:4759 , piece_id=LWQ3CNAYFISJB524Z7G7MPRJL7HGXTJDCK6NJF42XMSTZYA7BIXA, seg_pos={0 0}, upload=155951]: Done uploading piece. err: <nil> Aug 14 23:22:31.864354124 (149h56m26.295434255s) [noise=true , address=104.36.82.4:4817 , piece_id=ZHSFAM4OM7KE57YZCQ6WID2VJA254D2TF63RDH2BZFD5IEVFJDMQ, seg_pos={0 0}, upload=155951]: Done uploading piece. err: <nil> Aug 14 23:22:31.882957379 (149h56m26.3140375s) [noise=true , address=104.36.82.19:4412 , piece_id=MWJZAVQVIULLOW2RUFCZI4DUCMGSBIJTEGEETYLGBRV5ZUWHI6ZQ, seg_pos={0 0}, upload=155951]: Done uploading piece. err: <nil> Aug 14 23:22:31.895810972 (149h56m26.326891103s) [noise=true , address=104.36.82.13:4194 , piece_id=TMQM53UTJLZKJFU4Q7E32MLFAQDSEHF7OBZNA5HBP3MVP2PAO6EA, seg_pos={0 0}, upload=155951]: Done uploading piece. err: <nil> Aug 14 23:22:31.895826693 (149h56m26.326906814s) [seg_pos={0 0}, upload=155951]: Segment reached optimal threshold of 14 pieces. Aug 14 23:22:31.896139110 (149h56m26.327219241s) [noise=true , address=104.36.82.44:4890 , piece_id=I6IIIYJGUQ6YZHXOMRWXJMPXVP6GFPZCT5USD6TWFETSUSR5FEXA, seg_pos={0 0}, upload=155951]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XYhMcqH63UiHYE4ofxDxjXz2HMvN1RfQjgxxxHcUst7P3aN7M): protocol: expected piece hash; context canceled; EOF Aug 14 23:22:31.896241717 (149h56m26.327321848s) [noise=true , address=104.36.82.58:4290 , piece_id=TZ3HCARZKI2TDBQZ3ZYTQRMTY7O3DUZC7HNKXD2HDRVPW4SZLVFA, seg_pos={0 0}, upload=155951]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YieSs1jRT5hKVKc7DuME4rFeX2BmeNngjBaGoB2hRrNwiLakv): protocol: rpc: dial tcp 104.36.82.58:4290: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Aug 14 23:22:31.896268748 (149h56m26.32734889s) [noise=true , address=104.36.82.35:4606 , piece_id=BDNE264H6CG2UWJLXWGOHXOPAKX2HLBXNQMVGKPZCVAOK4XFCILA, seg_pos={0 0}, upload=155951]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iPDQbkaZ3jmN5pSD8V8btwuXh1hx1hhYVNL14JzXf4dQXdVsW): protocol: write tcp 188.166.225.170:35578->104.36.82.35:4606: use of closed network connection; write tcp 188.166.225.170:35578->104.36.82.35:4606: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35578->104.36.82.35:4606: use of closed network connection Aug 14 23:22:31.896307172 (149h56m26.327387303s) [noise=true , address=104.36.82.14:4239 , piece_id=KU3A65MKNSI3IGRKUKOAF5ZMN752AJJOLL3Z277AOHUXVDXC4XGQ, seg_pos={0 0}, upload=155951]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pTRYQDUQVz3nNo46TfMeaihJoP2zvTMfgvTNjUMF8iePz5MvV): protocol: read tcp 188.166.225.170:42008->104.36.82.14:4239: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 14 23:22:31.896336297 (149h56m26.327416428s) [seg_pos={0 0}, upload=155951]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 14 23:22:31.896404488 (149h56m26.327484609s) [upload=155951]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 14 23:22:31.896408416 (149h56m26.327488547s) [upload=155951]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 23:22:32.216485901 (149h56m26.647566032s) [upload=155951]: Done uploading segments... Aug 14 23:22:32.216505529 (149h56m26.64758566s) [upload=155951]: Upload finished. err: <nil> Duration: 4.248892877s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 25 out of 60 is failed (threshold=3) [..XXXXXXXXXXXXXXXXXXXXXXXXX.................................] duration: 6.159671358s FAIL (2025-08-14 23:22:31 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.159690064s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..................................X.......X.................] duration: 2.197307025s FAIL (2025-08-14 23:21:53 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 14 23:09:30.496311157 (149h43m24.927391288s) [upload=155721]: Starting upload Aug 14 23:09:30.496358919 (149h43m24.92743905s) [upload=155721]: Done starting upload Aug 14 23:09:30.496409976 (149h43m24.927490107s) [upload=155721]: Uploading segments... Aug 14 23:09:30.496446436 (149h43m24.927526567s) [upload=155721]: Got next segment. Inline: true Aug 14 23:09:30.496450264 (149h43m24.927530395s) [upload=155721]: Waiting for error group managing segments... Aug 14 23:09:30.496483657 (149h43m24.927563788s) [upload=155721]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 23:09:30.496487354 (149h43m24.927567485s) [upload=155721]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 23:09:30.496489648 (149h43m24.927569779s) [upload=155721]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 23:09:33.939233724 (149h43m28.370313845s) [upload=155721]: Done uploading segments... Aug 14 23:09:33.939252460 (149h43m28.370332591s) [upload=155721]: Upload finished. err: <nil> Duration:* 2.197332734s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 783.436422ms FAIL (2025-08-14 23:21:51 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": remote error: tls: internal error Duration: 783.469025ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........................................X.............X....] duration: 6.013354553s FAIL (2025-08-14 23:21:28 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 14 23:18:11.285255330 (149h52m5.716335461s) [upload=155873]: Starting upload Aug 14 23:18:11.285291730 (149h52m5.716371861s) [upload=155873]: Done starting upload Aug 14 23:18:11.285433711 (149h52m5.716513842s) [upload=155873]: Uploading segments... Aug 14 23:18:11.285906657 (149h52m5.716986778s) [upload=155873]: Got next segment. Inline: false Aug 14 23:18:11.285948577 (149h52m5.717028698s) [upload=155873]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 23:18:11.285953456 (149h52m5.717033587s) [upload=155873]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 23:18:11.816706301 (149h52m6.247786432s) [seg_pos={0 0}, upload=155873]: Begin upload segment... Aug 14 23:18:11.816747641 (149h52m6.247827772s) [seg_pos={0 0}, upload=155873]: Done begin upload segment. Aug 14 23:18:11.816768250 (149h52m6.247848381s) [noise=true , address=77.90.31.21:4911 , piece_id=ER3ZKTLUF5NQHUR5XXW4S32TE5MTXS24U7QDCX3TOMJ4EGTVF2LA, seg_pos={0 0}, upload=155873]: Uploading piece... Aug 14 23:18:11.816782547 (149h52m6.247862668s) [noise=true , address=79.127.220.101:4070 , piece_id=M5NGSQVNFOTLQWKKDH7ALCUGYOR2RPZ2ZTL6P3CQHXRF3IAHSFUA, seg_pos={0 0}, upload=155873]: Uploading piece... Aug 14 23:18:11.817151012 (149h52m6.248231143s) [noise=true , address=104.36.82.58:4269 , piece_id=H3TQVXZJBQOWSGG23GFGOHCRCGMBKYC2S53CZJKAB63WDKABG5BA, seg_pos={0 0}, upload=155873]: Uploading piece... Aug 14 23:18:11.817175890 (149h52m6.248256021s) [noise=true , address=104.36.82.47:4520 , piece_id=OYNEA5FZ3UXLLOCS3CU6XKJ3RA5BYHWOWQLKQLFGQLNEIQOUM43A, seg_pos={0 0}, upload=155873]: Uploading piece... Aug 14 23:18:11.817424455 (149h52m6.248504576s) [noise=true , address=79.127.201.215:4331 , piece_id=Y7EOIIRNBGMSIQR7GJPPHN5QZB7LLVZYISET5ILGLIAAN7BL6JGA, seg_pos={0 0}, upload=155873]: Uploading piece... Aug 14 23:18:11.817510780 (149h52m6.248590911s) [noise=true , address=104.36.82.2:4739 , piece_id=AGV73SK24H4HEXH5WIKBJ4NK6VD2N3WBM77HP6GJARJOKUKRAG6A, seg_pos={0 0}, upload=155873]: Uploading piece... Aug 14 23:18:11.817686267 (149h52m6.248766398s) [noise=true , address=79.127.201.215:4344 , piece_id=SGROEDDBSO2PMEFGPLH3RXFGJ43BKZFJBGYA6HKFLOUWU3VI4T7Q, seg_pos={0 0}, upload=155873]: Uploading piece... Aug 14 23:18:11.817826956 (149h52m6.248907087s) [noise=true , address=104.36.82.39:4741 , piece_id=XVVLN66473RBT4DOY4MY7CIGGTWC5YMMNVKOKIL6E2AVR4ZS4KLQ, seg_pos={0 0}, upload=155873]: Uploading piece... Aug 14 23:18:11.817970600 (149h52m6.249050731s) [noise=true , address=104.36.82.39:4756 , piece_id=63QZAFEV5G54JFJ5SPPPFQ2WHQ2FOJHMKZ5DFLYI4VD5MAFYM7JA, seg_pos={0 0}, upload=155873]: Uploading piece... Aug 14 23:18:11.818088265 (149h52m6.249168396s) [noise=true , address=104.36.82.36:4628 , piece_id=2JGXAHXMAHVXAJB56VPEREVFHEMLK7DZBFEZH2OUCDBIABWHFDLA, seg_pos={0 0}, upload=155873]: Uploading piece... Aug 14 23:18:11.818200621 (149h52m6.249280752s) [noise=true , address=77.90.31.21:4891 , piece_id=EZZYABMFQCXIAMYBFNJGFWOYMI53R77BFVKH5ZNFNVABIAF6OIFQ, seg_pos={0 0}, upload=155873]: Uploading piece... Aug 14 23:18:11.818328735 (149h52m6.249408867s) [noise=true , address=104.36.82.60:4343 , piece_id=4V6LUEAVQDDJEJ4UCFLXMIFWGFZDP3JBKM33HBQHXDHLYHQCZIVQ, seg_pos={0 0}, upload=155873]: Uploading piece... Aug 14 23:18:11.818416072 (149h52m6.249496203s) [noise=true , address=104.36.82.17:4344 , piece_id=XSCXTZXXE53KZQGZZP443WT5QBT4XDHEK6LPC5PD7MLPO7X5NOUQ, seg_pos={0 0}, upload=155873]: Uploading piece... Aug 14 23:18:11.818569847 (149h52m6.249649978s) [noise=true , address=64.49.13.169:4705 , piece_id=6YXBT4QMYLHUHO2A2NQD6UEPRGQUASR7ATW5ETKA7Y5MGHHB2QWQ, seg_pos={0 0}, upload=155873]: Uploading piece... Aug 14 23:18:11.818624071 (149h52m6.249704192s) [noise=true , address=77.90.31.13:4656 , piece_id=RUQ24GXBIDKZVPRUXW4EU6S5RVEM6VYP4ICKGTRLSH5XK5XSWGGQ, seg_pos={0 0}, upload=155873]: Uploading piece... Aug 14 23:18:11.818824714 (149h52m6.249904845s) [noise=true , address=104.36.82.8:4977 , piece_id=4WAA2SO3Y5QZKBLCYYSVVJAX5MFH5Q3VXAZVKFMF76ZC232ONCRQ, seg_pos={0 0}, upload=155873]: Uploading piece... Aug 14 23:18:11.818848340 (149h52m6.249928471s) [noise=true , address=77.90.31.10:4528 , piece_id=GNG2MLDZAEGCKIVFFXCF6S6OBW34RV34QOKYA7YWSWTIJWMULDHQ, seg_pos={0 0}, upload=155873]: Uploading piece... Aug 14 23:18:11.819054745 (149h52m6.250134876s) [noise=true , address=77.90.31.15:4703 , piece_id=BCG3GZ5HL7DUA66HXLKXNT25ZXVNGXOUDX42SGQWZGEONKJOXP4A, seg_pos={0 0}, upload=155873]: Uploading piece... Aug 14 23:18:12.980997930 (149h52m7.412078061s) [upload=155873]: Next returned nil segment Aug 14 23:18:12.981011926 (149h52m7.412092057s) [upload=155873]: Waiting for error group managing segments... Aug 14 23:18:13.276871855 (149h52m7.707951976s) [noise=true , address=64.49.13.169:4705 , piece_id=6YXBT4QMYLHUHO2A2NQD6UEPRGQUASR7ATW5ETKA7Y5MGHHB2QWQ, seg_pos={0 0}, upload=155873]: Done uploading piece. err: <nil> Aug 14 23:18:13.666642219 (149h52m8.09772235s) [noise=true , address=79.127.220.101:4070 , piece_id=M5NGSQVNFOTLQWKKDH7ALCUGYOR2RPZ2ZTL6P3CQHXRF3IAHSFUA, seg_pos={0 0}, upload=155873]: Done uploading piece. err: <nil> Aug 14 23:18:13.738090556 (149h52m8.169170687s) [noise=true , address=104.36.82.47:4520 , piece_id=OYNEA5FZ3UXLLOCS3CU6XKJ3RA5BYHWOWQLKQLFGQLNEIQOUM43A, seg_pos={0 0}, upload=155873]: Done uploading piece. err: <nil> Aug 14 23:18:13.752980967 (149h52m8.184061098s) [noise=true , address=77.90.31.21:4891 , piece_id=EZZYABMFQCXIAMYBFNJGFWOYMI53R77BFVKH5ZNFNVABIAF6OIFQ, seg_pos={0 0}, upload=155873]: Done uploading piece. err: <nil> Aug 14 23:18:13.803546267 (149h52m8.234626398s) [noise=true , address=79.127.201.215:4331 , piece_id=Y7EOIIRNBGMSIQR7GJPPHN5QZB7LLVZYISET5ILGLIAAN7BL6JGA, seg_pos={0 0}, upload=155873]: Done uploading piece. err: <nil> Aug 14 23:18:13.816343443 (149h52m8.247423564s) [noise=true , address=79.127.201.215:4344 , piece_id=SGROEDDBSO2PMEFGPLH3RXFGJ43BKZFJBGYA6HKFLOUWU3VI4T7Q, seg_pos={0 0}, upload=155873]: Done uploading piece. err: <nil> Aug 14 23:18:13.830983324 (149h52m8.262063455s) [noise=true , address=77.90.31.10:4528 , piece_id=GNG2MLDZAEGCKIVFFXCF6S6OBW34RV34QOKYA7YWSWTIJWMULDHQ, seg_pos={0 0}, upload=155873]: Done uploading piece. err: <nil> Aug 14 23:18:13.840162688 (149h52m8.271242819s) [noise=true , address=104.36.82.8:4977 , piece_id=4WAA2SO3Y5QZKBLCYYSVVJAX5MFH5Q3VXAZVKFMF76ZC232ONCRQ, seg_pos={0 0}, upload=155873]: Done uploading piece. err: <nil> Aug 14 23:18:13.844557346 (149h52m8.275637477s) [noise=true , address=104.36.82.58:4269 , piece_id=H3TQVXZJBQOWSGG23GFGOHCRCGMBKYC2S53CZJKAB63WDKABG5BA, seg_pos={0 0}, upload=155873]: Done uploading piece. err: <nil> Aug 14 23:18:13.851464693 (149h52m8.282544824s) [noise=true , address=77.90.31.15:4703 , piece_id=BCG3GZ5HL7DUA66HXLKXNT25ZXVNGXOUDX42SGQWZGEONKJOXP4A, seg_pos={0 0}, upload=155873]: Done uploading piece. err: <nil> Aug 14 23:18:13.884394068 (149h52m8.315474199s) [noise=true , address=104.36.82.17:4344 , piece_id=XSCXTZXXE53KZQGZZP443WT5QBT4XDHEK6LPC5PD7MLPO7X5NOUQ, seg_pos={0 0}, upload=155873]: Done uploading piece. err: <nil> Aug 14 23:18:13.913393204 (149h52m8.344473325s) [noise=true , address=104.36.82.2:4739 , piece_id=AGV73SK24H4HEXH5WIKBJ4NK6VD2N3WBM77HP6GJARJOKUKRAG6A, seg_pos={0 0}, upload=155873]: Done uploading piece. err: <nil> Aug 14 23:18:13.958646701 (149h52m8.389726832s) [noise=true , address=104.36.82.39:4756 , piece_id=63QZAFEV5G54JFJ5SPPPFQ2WHQ2FOJHMKZ5DFLYI4VD5MAFYM7JA, seg_pos={0 0}, upload=155873]: Done uploading piece. err: <nil> Aug 14 23:18:14.023205435 (149h52m8.454285566s) [noise=true , address=77.90.31.13:4656 , piece_id=RUQ24GXBIDKZVPRUXW4EU6S5RVEM6VYP4ICKGTRLSH5XK5XSWGGQ, seg_pos={0 0}, upload=155873]: Done uploading piece. err: <nil> Aug 14 23:18:14.023224372 (149h52m8.454304513s) [seg_pos={0 0}, upload=155873]: Segment reached optimal threshold of 14 pieces. Aug 14 23:18:14.023414856 (149h52m8.454494987s) [noise=true , address=77.90.31.21:4911 , piece_id=ER3ZKTLUF5NQHUR5XXW4S32TE5MTXS24U7QDCX3TOMJ4EGTVF2LA, seg_pos={0 0}, upload=155873]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cxBiYLx8eWayRmXGXzNyRKAMLEcL7gJ7VU4wLvKhN2nCQbqwf): protocol: expected piece hash; context canceled; EOF Aug 14 23:18:14.023537682 (149h52m8.454617813s) [noise=true , address=104.36.82.39:4741 , piece_id=XVVLN66473RBT4DOY4MY7CIGGTWC5YMMNVKOKIL6E2AVR4ZS4KLQ, seg_pos={0 0}, upload=155873]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BHrpBwAi3KLWjuDsh4DPSRmaRzzexm9FYgRyJT6mXRMxDMeFY): protocol: expected piece hash; context canceled; EOF Aug 14 23:18:14.023605010 (149h52m8.454685141s) [noise=true , address=104.36.82.36:4628 , piece_id=2JGXAHXMAHVXAJB56VPEREVFHEMLK7DZBFEZH2OUCDBIABWHFDLA, seg_pos={0 0}, upload=155873]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y9h3t9CQKukCffvjBC6XugNBCHguXyANBSqj6Qr98sqmPiqsp): protocol: write tcp 188.166.225.170:46382->104.36.82.36:4628: use of closed network connection; write tcp 188.166.225.170:46382->104.36.82.36:4628: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46382->104.36.82.36:4628: use of closed network connection Aug 14 23:18:14.023658643 (149h52m8.454738774s) [noise=true , address=104.36.82.60:4343 , piece_id=4V6LUEAVQDDJEJ4UCFLXMIFWGFZDP3JBKM33HBQHXDHLYHQCZIVQ, seg_pos={0 0}, upload=155873]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16EsEMRW53sjKVag2WpSDGLhELyE2bSXyW4aAurCvDFKRNkXuf): protocol: write tcp 188.166.225.170:56790->104.36.82.60:4343: use of closed network connection; write tcp 188.166.225.170:56790->104.36.82.60:4343: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56790->104.36.82.60:4343: use of closed network connection Aug 14 23:18:14.023667279 (149h52m8.45474741s) [seg_pos={0 0}, upload=155873]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 14 23:18:14.023717225 (149h52m8.454797356s) [upload=155873]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 14 23:18:14.023720942 (149h52m8.454801073s) [upload=155873]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 23:18:14.707669137 (149h52m9.138749288s) [upload=155873]: Done uploading segments... Aug 14 23:18:14.707727238 (149h52m9.138807369s) [upload=155873]: Upload finished. err: <nil> Duration: 6.013381053s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 26 out of 60 is failed (threshold=3) [X..XXXXXXXXXXXXXXXXXXXXXXXXX................................] duration: 6.265749616s FAIL (2025-08-14 23:21:27 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.265772842s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...................................X.......X................] duration: 2.209411799s FAIL (2025-08-14 23:21:17 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 14 23:09:30.496311157 (149h43m24.927391288s) [upload=155721]: Starting upload Aug 14 23:09:30.496358919 (149h43m24.92743905s) [upload=155721]: Done starting upload Aug 14 23:09:30.496409976 (149h43m24.927490107s) [upload=155721]: Uploading segments... Aug 14 23:09:30.496446436 (149h43m24.927526567s) [upload=155721]: Got next segment. Inline: true Aug 14 23:09:30.496450264 (149h43m24.927530395s) [upload=155721]: Waiting for error group managing segments... Aug 14 23:09:30.496483657 (149h43m24.927563788s) [upload=155721]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 23:09:30.496487354 (149h43m24.927567485s) [upload=155721]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 23:09:30.496489648 (149h43m24.927569779s) [upload=155721]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 23:09:33.939233724 (149h43m28.370313845s) [upload=155721]: Done uploading segments... Aug 14 23:09:33.939252460 (149h43m28.370332591s) [upload=155721]: Upload finished. err: <nil> Duration:* 2.209442047s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [X...................................X.......X...............] duration: 2.147666295s FAIL (2025-08-14 23:21:00 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 14 23:09:30.496311157 (149h43m24.927391288s) [upload=155721]: Starting upload Aug 14 23:09:30.496358919 (149h43m24.92743905s) [upload=155721]: Done starting upload Aug 14 23:09:30.496409976 (149h43m24.927490107s) [upload=155721]: Uploading segments... Aug 14 23:09:30.496446436 (149h43m24.927526567s) [upload=155721]: Got next segment. Inline: true Aug 14 23:09:30.496450264 (149h43m24.927530395s) [upload=155721]: Waiting for error group managing segments... Aug 14 23:09:30.496483657 (149h43m24.927563788s) [upload=155721]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 23:09:30.496487354 (149h43m24.927567485s) [upload=155721]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 23:09:30.496489648 (149h43m24.927569779s) [upload=155721]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 23:09:33.939233724 (149h43m28.370313845s) [upload=155721]: Done uploading segments... Aug 14 23:09:33.939252460 (149h43m28.370332591s) [upload=155721]: Upload finished. err: <nil> Duration:* 2.147688799s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 26 out of 60 is failed (threshold=3) [.X..XXXXXXXXXXXXXXXXXXXXXXXXX...............................] duration: 6.373288196s FAIL (2025-08-14 23:21:00 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.373307954s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........................................X.............X...] duration: 6.410523051s FAIL (2025-08-14 23:20:58 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 14 23:18:11.285255330 (149h52m5.716335461s) [upload=155873]: Starting upload Aug 14 23:18:11.285291730 (149h52m5.716371861s) [upload=155873]: Done starting upload Aug 14 23:18:11.285433711 (149h52m5.716513842s) [upload=155873]: Uploading segments... Aug 14 23:18:11.285906657 (149h52m5.716986778s) [upload=155873]: Got next segment. Inline: false Aug 14 23:18:11.285948577 (149h52m5.717028698s) [upload=155873]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 23:18:11.285953456 (149h52m5.717033587s) [upload=155873]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 23:18:11.816706301 (149h52m6.247786432s) [seg_pos={0 0}, upload=155873]: Begin upload segment... Aug 14 23:18:11.816747641 (149h52m6.247827772s) [seg_pos={0 0}, upload=155873]: Done begin upload segment. Aug 14 23:18:11.816768250 (149h52m6.247848381s) [noise=true , address=77.90.31.21:4911 , piece_id=ER3ZKTLUF5NQHUR5XXW4S32TE5MTXS24U7QDCX3TOMJ4EGTVF2LA, seg_pos={0 0}, upload=155873]: Uploading piece... Aug 14 23:18:11.816782547 (149h52m6.247862668s) [noise=true , address=79.127.220.101:4070 , piece_id=M5NGSQVNFOTLQWKKDH7ALCUGYOR2RPZ2ZTL6P3CQHXRF3IAHSFUA, seg_pos={0 0}, upload=155873]: Uploading piece... Aug 14 23:18:11.817151012 (149h52m6.248231143s) [noise=true , address=104.36.82.58:4269 , piece_id=H3TQVXZJBQOWSGG23GFGOHCRCGMBKYC2S53CZJKAB63WDKABG5BA, seg_pos={0 0}, upload=155873]: Uploading piece... Aug 14 23:18:11.817175890 (149h52m6.248256021s) [noise=true , address=104.36.82.47:4520 , piece_id=OYNEA5FZ3UXLLOCS3CU6XKJ3RA5BYHWOWQLKQLFGQLNEIQOUM43A, seg_pos={0 0}, upload=155873]: Uploading piece... Aug 14 23:18:11.817424455 (149h52m6.248504576s) [noise=true , address=79.127.201.215:4331 , piece_id=Y7EOIIRNBGMSIQR7GJPPHN5QZB7LLVZYISET5ILGLIAAN7BL6JGA, seg_pos={0 0}, upload=155873]: Uploading piece... Aug 14 23:18:11.817510780 (149h52m6.248590911s) [noise=true , address=104.36.82.2:4739 , piece_id=AGV73SK24H4HEXH5WIKBJ4NK6VD2N3WBM77HP6GJARJOKUKRAG6A, seg_pos={0 0}, upload=155873]: Uploading piece... Aug 14 23:18:11.817686267 (149h52m6.248766398s) [noise=true , address=79.127.201.215:4344 , piece_id=SGROEDDBSO2PMEFGPLH3RXFGJ43BKZFJBGYA6HKFLOUWU3VI4T7Q, seg_pos={0 0}, upload=155873]: Uploading piece... Aug 14 23:18:11.817826956 (149h52m6.248907087s) [noise=true , address=104.36.82.39:4741 , piece_id=XVVLN66473RBT4DOY4MY7CIGGTWC5YMMNVKOKIL6E2AVR4ZS4KLQ, seg_pos={0 0}, upload=155873]: Uploading piece... Aug 14 23:18:11.817970600 (149h52m6.249050731s) [noise=true , address=104.36.82.39:4756 , piece_id=63QZAFEV5G54JFJ5SPPPFQ2WHQ2FOJHMKZ5DFLYI4VD5MAFYM7JA, seg_pos={0 0}, upload=155873]: Uploading piece... Aug 14 23:18:11.818088265 (149h52m6.249168396s) [noise=true , address=104.36.82.36:4628 , piece_id=2JGXAHXMAHVXAJB56VPEREVFHEMLK7DZBFEZH2OUCDBIABWHFDLA, seg_pos={0 0}, upload=155873]: Uploading piece... Aug 14 23:18:11.818200621 (149h52m6.249280752s) [noise=true , address=77.90.31.21:4891 , piece_id=EZZYABMFQCXIAMYBFNJGFWOYMI53R77BFVKH5ZNFNVABIAF6OIFQ, seg_pos={0 0}, upload=155873]: Uploading piece... Aug 14 23:18:11.818328735 (149h52m6.249408867s) [noise=true , address=104.36.82.60:4343 , piece_id=4V6LUEAVQDDJEJ4UCFLXMIFWGFZDP3JBKM33HBQHXDHLYHQCZIVQ, seg_pos={0 0}, upload=155873]: Uploading piece... Aug 14 23:18:11.818416072 (149h52m6.249496203s) [noise=true , address=104.36.82.17:4344 , piece_id=XSCXTZXXE53KZQGZZP443WT5QBT4XDHEK6LPC5PD7MLPO7X5NOUQ, seg_pos={0 0}, upload=155873]: Uploading piece... Aug 14 23:18:11.818569847 (149h52m6.249649978s) [noise=true , address=64.49.13.169:4705 , piece_id=6YXBT4QMYLHUHO2A2NQD6UEPRGQUASR7ATW5ETKA7Y5MGHHB2QWQ, seg_pos={0 0}, upload=155873]: Uploading piece... Aug 14 23:18:11.818624071 (149h52m6.249704192s) [noise=true , address=77.90.31.13:4656 , piece_id=RUQ24GXBIDKZVPRUXW4EU6S5RVEM6VYP4ICKGTRLSH5XK5XSWGGQ, seg_pos={0 0}, upload=155873]: Uploading piece... Aug 14 23:18:11.818824714 (149h52m6.249904845s) [noise=true , address=104.36.82.8:4977 , piece_id=4WAA2SO3Y5QZKBLCYYSVVJAX5MFH5Q3VXAZVKFMF76ZC232ONCRQ, seg_pos={0 0}, upload=155873]: Uploading piece... Aug 14 23:18:11.818848340 (149h52m6.249928471s) [noise=true , address=77.90.31.10:4528 , piece_id=GNG2MLDZAEGCKIVFFXCF6S6OBW34RV34QOKYA7YWSWTIJWMULDHQ, seg_pos={0 0}, upload=155873]: Uploading piece... Aug 14 23:18:11.819054745 (149h52m6.250134876s) [noise=true , address=77.90.31.15:4703 , piece_id=BCG3GZ5HL7DUA66HXLKXNT25ZXVNGXOUDX42SGQWZGEONKJOXP4A, seg_pos={0 0}, upload=155873]: Uploading piece... Aug 14 23:18:12.980997930 (149h52m7.412078061s) [upload=155873]: Next returned nil segment Aug 14 23:18:12.981011926 (149h52m7.412092057s) [upload=155873]: Waiting for error group managing segments... Aug 14 23:18:13.276871855 (149h52m7.707951976s) [noise=true , address=64.49.13.169:4705 , piece_id=6YXBT4QMYLHUHO2A2NQD6UEPRGQUASR7ATW5ETKA7Y5MGHHB2QWQ, seg_pos={0 0}, upload=155873]: Done uploading piece. err: <nil> Aug 14 23:18:13.666642219 (149h52m8.09772235s) [noise=true , address=79.127.220.101:4070 , piece_id=M5NGSQVNFOTLQWKKDH7ALCUGYOR2RPZ2ZTL6P3CQHXRF3IAHSFUA, seg_pos={0 0}, upload=155873]: Done uploading piece. err: <nil> Aug 14 23:18:13.738090556 (149h52m8.169170687s) [noise=true , address=104.36.82.47:4520 , piece_id=OYNEA5FZ3UXLLOCS3CU6XKJ3RA5BYHWOWQLKQLFGQLNEIQOUM43A, seg_pos={0 0}, upload=155873]: Done uploading piece. err: <nil> Aug 14 23:18:13.752980967 (149h52m8.184061098s) [noise=true , address=77.90.31.21:4891 , piece_id=EZZYABMFQCXIAMYBFNJGFWOYMI53R77BFVKH5ZNFNVABIAF6OIFQ, seg_pos={0 0}, upload=155873]: Done uploading piece. err: <nil> Aug 14 23:18:13.803546267 (149h52m8.234626398s) [noise=true , address=79.127.201.215:4331 , piece_id=Y7EOIIRNBGMSIQR7GJPPHN5QZB7LLVZYISET5ILGLIAAN7BL6JGA, seg_pos={0 0}, upload=155873]: Done uploading piece. err: <nil> Aug 14 23:18:13.816343443 (149h52m8.247423564s) [noise=true , address=79.127.201.215:4344 , piece_id=SGROEDDBSO2PMEFGPLH3RXFGJ43BKZFJBGYA6HKFLOUWU3VI4T7Q, seg_pos={0 0}, upload=155873]: Done uploading piece. err: <nil> Aug 14 23:18:13.830983324 (149h52m8.262063455s) [noise=true , address=77.90.31.10:4528 , piece_id=GNG2MLDZAEGCKIVFFXCF6S6OBW34RV34QOKYA7YWSWTIJWMULDHQ, seg_pos={0 0}, upload=155873]: Done uploading piece. err: <nil> Aug 14 23:18:13.840162688 (149h52m8.271242819s) [noise=true , address=104.36.82.8:4977 , piece_id=4WAA2SO3Y5QZKBLCYYSVVJAX5MFH5Q3VXAZVKFMF76ZC232ONCRQ, seg_pos={0 0}, upload=155873]: Done uploading piece. err: <nil> Aug 14 23:18:13.844557346 (149h52m8.275637477s) [noise=true , address=104.36.82.58:4269 , piece_id=H3TQVXZJBQOWSGG23GFGOHCRCGMBKYC2S53CZJKAB63WDKABG5BA, seg_pos={0 0}, upload=155873]: Done uploading piece. err: <nil> Aug 14 23:18:13.851464693 (149h52m8.282544824s) [noise=true , address=77.90.31.15:4703 , piece_id=BCG3GZ5HL7DUA66HXLKXNT25ZXVNGXOUDX42SGQWZGEONKJOXP4A, seg_pos={0 0}, upload=155873]: Done uploading piece. err: <nil> Aug 14 23:18:13.884394068 (149h52m8.315474199s) [noise=true , address=104.36.82.17:4344 , piece_id=XSCXTZXXE53KZQGZZP443WT5QBT4XDHEK6LPC5PD7MLPO7X5NOUQ, seg_pos={0 0}, upload=155873]: Done uploading piece. err: <nil> Aug 14 23:18:13.913393204 (149h52m8.344473325s) [noise=true , address=104.36.82.2:4739 , piece_id=AGV73SK24H4HEXH5WIKBJ4NK6VD2N3WBM77HP6GJARJOKUKRAG6A, seg_pos={0 0}, upload=155873]: Done uploading piece. err: <nil> Aug 14 23:18:13.958646701 (149h52m8.389726832s) [noise=true , address=104.36.82.39:4756 , piece_id=63QZAFEV5G54JFJ5SPPPFQ2WHQ2FOJHMKZ5DFLYI4VD5MAFYM7JA, seg_pos={0 0}, upload=155873]: Done uploading piece. err: <nil> Aug 14 23:18:14.023205435 (149h52m8.454285566s) [noise=true , address=77.90.31.13:4656 , piece_id=RUQ24GXBIDKZVPRUXW4EU6S5RVEM6VYP4ICKGTRLSH5XK5XSWGGQ, seg_pos={0 0}, upload=155873]: Done uploading piece. err: <nil> Aug 14 23:18:14.023224372 (149h52m8.454304513s) [seg_pos={0 0}, upload=155873]: Segment reached optimal threshold of 14 pieces. Aug 14 23:18:14.023414856 (149h52m8.454494987s) [noise=true , address=77.90.31.21:4911 , piece_id=ER3ZKTLUF5NQHUR5XXW4S32TE5MTXS24U7QDCX3TOMJ4EGTVF2LA, seg_pos={0 0}, upload=155873]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cxBiYLx8eWayRmXGXzNyRKAMLEcL7gJ7VU4wLvKhN2nCQbqwf): protocol: expected piece hash; context canceled; EOF Aug 14 23:18:14.023537682 (149h52m8.454617813s) [noise=true , address=104.36.82.39:4741 , piece_id=XVVLN66473RBT4DOY4MY7CIGGTWC5YMMNVKOKIL6E2AVR4ZS4KLQ, seg_pos={0 0}, upload=155873]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BHrpBwAi3KLWjuDsh4DPSRmaRzzexm9FYgRyJT6mXRMxDMeFY): protocol: expected piece hash; context canceled; EOF Aug 14 23:18:14.023605010 (149h52m8.454685141s) [noise=true , address=104.36.82.36:4628 , piece_id=2JGXAHXMAHVXAJB56VPEREVFHEMLK7DZBFEZH2OUCDBIABWHFDLA, seg_pos={0 0}, upload=155873]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y9h3t9CQKukCffvjBC6XugNBCHguXyANBSqj6Qr98sqmPiqsp): protocol: write tcp 188.166.225.170:46382->104.36.82.36:4628: use of closed network connection; write tcp 188.166.225.170:46382->104.36.82.36:4628: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46382->104.36.82.36:4628: use of closed network connection Aug 14 23:18:14.023658643 (149h52m8.454738774s) [noise=true , address=104.36.82.60:4343 , piece_id=4V6LUEAVQDDJEJ4UCFLXMIFWGFZDP3JBKM33HBQHXDHLYHQCZIVQ, seg_pos={0 0}, upload=155873]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16EsEMRW53sjKVag2WpSDGLhELyE2bSXyW4aAurCvDFKRNkXuf): protocol: write tcp 188.166.225.170:56790->104.36.82.60:4343: use of closed network connection; write tcp 188.166.225.170:56790->104.36.82.60:4343: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56790->104.36.82.60:4343: use of closed network connection Aug 14 23:18:14.023667279 (149h52m8.45474741s) [seg_pos={0 0}, upload=155873]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 14 23:18:14.023717225 (149h52m8.454797356s) [upload=155873]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 14 23:18:14.023720942 (149h52m8.454801073s) [upload=155873]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 23:18:14.707669137 (149h52m9.138749288s) [upload=155873]: Done uploading segments... Aug 14 23:18:14.707727238 (149h52m9.138807369s) [upload=155873]: Upload finished. err: <nil> Duration: 6.41055406s core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)