Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [............................X....X...................X.X....] duration: 6.263220695s FAIL (2025-08-14 19:39:15 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 359dba9513878916461178e686c37e9de1c2a6a775e5609c6ded8301d5d9f3cb != before 7564846a546ab95996504ce6d130f23da6186f0a68402887849656db4a499a42 ======LOGS====== Aug 14 19:36:46.697679574 (146h10m41.128759705s) [upload=152050]: Starting upload Aug 14 19:36:46.697739058 (146h10m41.128819189s) [upload=152050]: Done starting upload Aug 14 19:36:46.697858285 (146h10m41.128938406s) [upload=152050]: Uploading segments... Aug 14 19:36:46.697991290 (146h10m41.129071421s) [upload=152050]: Got next segment. Inline: false Aug 14 19:36:46.698021317 (146h10m41.129101448s) [upload=152050]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 19:36:46.698025666 (146h10m41.129105797s) [upload=152050]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 19:36:47.272229084 (146h10m41.703309205s) [seg_pos={0 0}, upload=152050]: Begin upload segment... Aug 14 19:36:47.272277276 (146h10m41.703357397s) [seg_pos={0 0}, upload=152050]: Done begin upload segment. Aug 14 19:36:47.272299538 (146h10m41.703379669s) [noise=true , address=104.36.82.16:4304 , piece_id=CJGYO6LGDA2TRXFS5K7PFBLE2WGLP3YEYKRN7MLGKN6O5YYEM6HA, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.272367018 (146h10m41.703447149s) [noise=true , address=45.91.116.10:4098 , piece_id=GVHNGR6VDGKFRUAVMOUIXSJ2XVCRIRQ2AXO5TXZXQJBNZRHAMCXQ, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.272672813 (146h10m41.703752944s) [noise=true , address=104.36.82.62:4427 , piece_id=K4RKZ5YSFLA5OXAJOMX2EKIOVHPESPLJWB5MIB55UBOTRK2KCVNQ, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.272909987 (146h10m41.703990118s) [noise=true , address=77.90.31.11:4564 , piece_id=ZI6WHVPYE3ZSFIPGOVJYV34O3KWYYR7H32GC56TJERBV5RMS5FPQ, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.272960793 (146h10m41.704040914s) [noise=true , address=104.36.82.58:4270 , piece_id=32CSIPJG3BXGUB5MCNHFSJSCCZF7CXWRBDHG3FC3TJK53GX2QHZQ, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.273201454 (146h10m41.704281585s) [noise=true , address=104.36.82.3:4793 , piece_id=TYN4AFQQ3UA5MDHMQ3XOU7T52JWZBUK5DU44BXDMZ6C5LESFYINA, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.273241170 (146h10m41.704321301s) [noise=true , address=77.90.31.15:4714 , piece_id=K6BZWO76LWNIKWBPOWFM3EMW673THPZR3DZG64TILQKEBRNV5IMQ, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.273482181 (146h10m41.704562302s) [noise=true , address=104.36.82.4:4833 , piece_id=P6NINOEWKUMNNAVY5ZNAYOG657GQIVJQL4A6WV37KNLFQVGIJDYQ, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.273594406 (146h10m41.704674537s) [noise=true , address=104.36.82.59:4305 , piece_id=5X74TLXRPQXOMJBZ5ACJH2AJSIARHTG4YTRYH7JPGCBKOLJ7ULHA, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.273754923 (146h10m41.704835044s) [noise=true , address=79.127.220.97:4372 , piece_id=45FMSDFL5C4YFMVJGW2P4TGEUPFAIQTLUDAHO2UGS67WI2JBVVWQ, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.273905010 (146h10m41.704985141s) [noise=true , address=104.36.82.35:4582 , piece_id=MH6VDMP6L3XFBFS6PL6ZB6GHTYYD2ZU5EK5V5MDSV4UVJV4ZNMTA, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.274015352 (146h10m41.705095483s) [noise=true , address=104.36.82.47:4536 , piece_id=FWS3PLQH6L7GMBKM2HFS6NZMMHZI2NTVZJKZLWK6ATMEWDGSUFVQ, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.274118509 (146h10m41.70519864s) [noise=true , address=77.90.31.11:4571 , piece_id=RW6SC5EYX5AGOZLEGFEMTYVJLTVYY3MKXSCKYKXQTHGUXV37LJAA, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.274250973 (146h10m41.705331094s) [noise=true , address=66.23.193.175:4555 , piece_id=RDEDVZGRCDCHGNOC22C3B2YQ3AD4ZMMJG4OP5EZRTLZ673AVNUKA, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.274351424 (146h10m41.705431555s) [noise=true , address=77.90.31.17:4795 , piece_id=BNO3U3OUDGF4I37OTE3WIKWWPOJ65VUCLD3EEQ4UXB4XXO2E7B5Q, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.274471164 (146h10m41.705551295s) [noise=true , address=104.36.82.37:4659 , piece_id=Z2DBEQH3XZLEZV44G23SV2WL42TY4IVE7X2JNCNEOOO6WF2FLAWQ, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.274572918 (146h10m41.705653039s) [noise=true , address=104.36.82.60:4355 , piece_id=Q3CA65BVU6PUTDO72M2HX42QML32YG44EEIHGYNQJFQHL4LWINUA, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.274784413 (146h10m41.705864554s) [noise=true , address=104.36.82.58:4285 , piece_id=XCEL3BYOHATFRFAE6M3URMSWXMXSH3GPXLINGOQ4FHJOMKP2RLCA, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:48.489051306 (146h10m42.920131427s) [upload=152050]: Next returned nil segment Aug 14 19:36:48.489068640 (146h10m42.920148771s) [upload=152050]: Waiting for error group managing segments... Aug 14 19:36:48.798943262 (146h10m43.230023393s) [noise=true , address=66.23.193.175:4555 , piece_id=RDEDVZGRCDCHGNOC22C3B2YQ3AD4ZMMJG4OP5EZRTLZ673AVNUKA, seg_pos={0 0}, upload=152050]: Done uploading piece. err: <nil> Aug 14 19:36:49.167891547 (146h10m43.598971678s) [noise=true , address=79.127.220.97:4372 , piece_id=45FMSDFL5C4YFMVJGW2P4TGEUPFAIQTLUDAHO2UGS67WI2JBVVWQ, seg_pos={0 0}, upload=152050]: Done uploading piece. err: <nil> Aug 14 19:36:49.195493900 (146h10m43.626574031s) [noise=true , address=104.36.82.37:4659 , piece_id=Z2DBEQH3XZLEZV44G23SV2WL42TY4IVE7X2JNCNEOOO6WF2FLAWQ, seg_pos={0 0}, upload=152050]: Done uploading piece. err: <nil> Aug 14 19:36:49.198922380 (146h10m43.630002652s) [noise=true , address=77.90.31.11:4571 , piece_id=RW6SC5EYX5AGOZLEGFEMTYVJLTVYY3MKXSCKYKXQTHGUXV37LJAA, seg_pos={0 0}, upload=152050]: Done uploading piece. err: <nil> Aug 14 19:36:49.202830589 (146h10m43.63391072s) [noise=true , address=104.36.82.47:4536 , piece_id=FWS3PLQH6L7GMBKM2HFS6NZMMHZI2NTVZJKZLWK6ATMEWDGSUFVQ, seg_pos={0 0}, upload=152050]: Done uploading piece. err: <nil> Aug 14 19:36:49.205535724 (146h10m43.636615845s) [noise=true , address=77.90.31.11:4564 , piece_id=ZI6WHVPYE3ZSFIPGOVJYV34O3KWYYR7H32GC56TJERBV5RMS5FPQ, seg_pos={0 0}, upload=152050]: Done uploading piece. err: <nil> Aug 14 19:36:49.208010330 (146h10m43.639090461s) [noise=true , address=104.36.82.62:4427 , piece_id=K4RKZ5YSFLA5OXAJOMX2EKIOVHPESPLJWB5MIB55UBOTRK2KCVNQ, seg_pos={0 0}, upload=152050]: Done uploading piece. err: <nil> Aug 14 19:36:49.243704887 (146h10m43.674785018s) [noise=true , address=104.36.82.58:4285 , piece_id=XCEL3BYOHATFRFAE6M3URMSWXMXSH3GPXLINGOQ4FHJOMKP2RLCA, seg_pos={0 0}, upload=152050]: Done uploading piece. err: <nil> Aug 14 19:36:49.260992826 (146h10m43.692072957s) [noise=true , address=77.90.31.15:4714 , piece_id=K6BZWO76LWNIKWBPOWFM3EMW673THPZR3DZG64TILQKEBRNV5IMQ, seg_pos={0 0}, upload=152050]: Done uploading piece. err: <nil> Aug 14 19:36:49.263322674 (146h10m43.694402805s) [noise=true , address=104.36.82.59:4305 , piece_id=5X74TLXRPQXOMJBZ5ACJH2AJSIARHTG4YTRYH7JPGCBKOLJ7ULHA, seg_pos={0 0}, upload=152050]: Done uploading piece. err: <nil> Aug 14 19:36:49.271150021 (146h10m43.702230152s) [noise=true , address=77.90.31.17:4795 , piece_id=BNO3U3OUDGF4I37OTE3WIKWWPOJ65VUCLD3EEQ4UXB4XXO2E7B5Q, seg_pos={0 0}, upload=152050]: Done uploading piece. err: <nil> Aug 14 19:36:49.352018554 (146h10m43.783098685s) [noise=true , address=104.36.82.3:4793 , piece_id=TYN4AFQQ3UA5MDHMQ3XOU7T52JWZBUK5DU44BXDMZ6C5LESFYINA, seg_pos={0 0}, upload=152050]: Done uploading piece. err: <nil> Aug 14 19:36:49.368588209 (146h10m43.79966834s) [noise=true , address=104.36.82.16:4304 , piece_id=CJGYO6LGDA2TRXFS5K7PFBLE2WGLP3YEYKRN7MLGKN6O5YYEM6HA, seg_pos={0 0}, upload=152050]: Done uploading piece. err: <nil> Aug 14 19:36:49.382358587 (146h10m43.813438718s) [noise=true , address=104.36.82.4:4833 , piece_id=P6NINOEWKUMNNAVY5ZNAYOG657GQIVJQL4A6WV37KNLFQVGIJDYQ, seg_pos={0 0}, upload=152050]: Done uploading piece. err: <nil> Aug 14 19:36:49.382426116 (146h10m43.813506247s) [seg_pos={0 0}, upload=152050]: Segment reached optimal threshold of 14 pieces. Aug 14 19:36:49.382653862 (146h10m43.813733993s) [noise=true , address=104.36.82.60:4355 , piece_id=Q3CA65BVU6PUTDO72M2HX42QML32YG44EEIHGYNQJFQHL4LWINUA, seg_pos={0 0}, upload=152050]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eA7ZLTkgGyCRsnQSEC8oYM3y9oeB5MQ4FUueJNMb4FLZueNv2): protocol: expected piece hash; context canceled; EOF Aug 14 19:36:49.382715459 (146h10m43.81379559s) [noise=true , address=104.36.82.58:4270 , piece_id=32CSIPJG3BXGUB5MCNHFSJSCCZF7CXWRBDHG3FC3TJK53GX2QHZQ, seg_pos={0 0}, upload=152050]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sJfMr1nMTpizd5PZ2bZ6M8tZWhFL2ukdJ3cNSRQtdUHNJhg81): protocol: expected piece hash; context canceled; EOF Aug 14 19:36:49.382756268 (146h10m43.813836399s) [noise=true , address=45.91.116.10:4098 , piece_id=GVHNGR6VDGKFRUAVMOUIXSJ2XVCRIRQ2AXO5TXZXQJBNZRHAMCXQ, seg_pos={0 0}, upload=152050]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ji2HtjJ47F98PDMF35jMakxPqNMRBFGRQpNP8sWKrGdWxe2Yb): protocol: write tcp 188.166.225.170:40964->45.91.116.10:4098: use of closed network connection; write tcp 188.166.225.170:40964->45.91.116.10:4098: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40964->45.91.116.10:4098: use of closed network connection Aug 14 19:36:49.382765906 (146h10m43.813846037s) [noise=true , address=104.36.82.35:4582 , piece_id=MH6VDMP6L3XFBFS6PL6ZB6GHTYYD2ZU5EK5V5MDSV4UVJV4ZNMTA, seg_pos={0 0}, upload=152050]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa): protocol: write tcp 188.166.225.170:45012->104.36.82.35:4582: use of closed network connection; write tcp 188.166.225.170:45012->104.36.82.35:4582: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45012->104.36.82.35:4582: use of closed network connection Aug 14 19:36:49.382776597 (146h10m43.813856718s) [seg_pos={0 0}, upload=152050]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 14 19:36:49.382863303 (146h10m43.813943424s) [upload=152050]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 14 19:36:49.382867841 (146h10m43.813947972s) [upload=152050]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 19:36:50.087438133 (146h10m44.518518264s) [upload=152050]: Done uploading segments... Aug 14 19:36:50.087456277 (146h10m44.518536398s) [upload=152050]: Upload finished. err: <nil> Duration: 6.263244691s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 2.473219202s FAIL (2025-08-14 19:38:58 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 14 19:07:41.786508305 (145h41m36.217588436s) [upload=151546]: Starting upload Aug 14 19:07:41.786586363 (145h41m36.217666494s) [upload=151546]: Done starting upload Aug 14 19:07:41.786650096 (145h41m36.217730237s) [upload=151546]: Uploading segments... Aug 14 19:07:41.786691344 (145h41m36.217771475s) [upload=151546]: Got next segment. Inline: true Aug 14 19:07:41.786695231 (145h41m36.217775353s) [upload=151546]: Waiting for error group managing segments... Aug 14 19:07:41.786736050 (145h41m36.217816181s) [upload=151546]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 19:07:41.786740278 (145h41m36.217820409s) [upload=151546]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 19:07:41.786742793 (145h41m36.217822924s) [upload=151546]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 19:07:42.077859232 (145h41m36.508939363s) [upload=151546]: Done uploading segments... Aug 14 19:07:42.077877176 (145h41m36.508957307s) [upload=151546]: Upload finished. err: <nil> Duration:* 2.473243277s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.............................X....X...................X.X...] duration: 6.408840234s FAIL (2025-08-14 19:38:30 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 359dba9513878916461178e686c37e9de1c2a6a775e5609c6ded8301d5d9f3cb != before 7564846a546ab95996504ce6d130f23da6186f0a68402887849656db4a499a42 ======LOGS====== Aug 14 19:36:46.697679574 (146h10m41.128759705s) [upload=152050]: Starting upload Aug 14 19:36:46.697739058 (146h10m41.128819189s) [upload=152050]: Done starting upload Aug 14 19:36:46.697858285 (146h10m41.128938406s) [upload=152050]: Uploading segments... Aug 14 19:36:46.697991290 (146h10m41.129071421s) [upload=152050]: Got next segment. Inline: false Aug 14 19:36:46.698021317 (146h10m41.129101448s) [upload=152050]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 19:36:46.698025666 (146h10m41.129105797s) [upload=152050]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 19:36:47.272229084 (146h10m41.703309205s) [seg_pos={0 0}, upload=152050]: Begin upload segment... Aug 14 19:36:47.272277276 (146h10m41.703357397s) [seg_pos={0 0}, upload=152050]: Done begin upload segment. Aug 14 19:36:47.272299538 (146h10m41.703379669s) [noise=true , address=104.36.82.16:4304 , piece_id=CJGYO6LGDA2TRXFS5K7PFBLE2WGLP3YEYKRN7MLGKN6O5YYEM6HA, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.272367018 (146h10m41.703447149s) [noise=true , address=45.91.116.10:4098 , piece_id=GVHNGR6VDGKFRUAVMOUIXSJ2XVCRIRQ2AXO5TXZXQJBNZRHAMCXQ, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.272672813 (146h10m41.703752944s) [noise=true , address=104.36.82.62:4427 , piece_id=K4RKZ5YSFLA5OXAJOMX2EKIOVHPESPLJWB5MIB55UBOTRK2KCVNQ, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.272909987 (146h10m41.703990118s) [noise=true , address=77.90.31.11:4564 , piece_id=ZI6WHVPYE3ZSFIPGOVJYV34O3KWYYR7H32GC56TJERBV5RMS5FPQ, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.272960793 (146h10m41.704040914s) [noise=true , address=104.36.82.58:4270 , piece_id=32CSIPJG3BXGUB5MCNHFSJSCCZF7CXWRBDHG3FC3TJK53GX2QHZQ, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.273201454 (146h10m41.704281585s) [noise=true , address=104.36.82.3:4793 , piece_id=TYN4AFQQ3UA5MDHMQ3XOU7T52JWZBUK5DU44BXDMZ6C5LESFYINA, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.273241170 (146h10m41.704321301s) [noise=true , address=77.90.31.15:4714 , piece_id=K6BZWO76LWNIKWBPOWFM3EMW673THPZR3DZG64TILQKEBRNV5IMQ, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.273482181 (146h10m41.704562302s) [noise=true , address=104.36.82.4:4833 , piece_id=P6NINOEWKUMNNAVY5ZNAYOG657GQIVJQL4A6WV37KNLFQVGIJDYQ, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.273594406 (146h10m41.704674537s) [noise=true , address=104.36.82.59:4305 , piece_id=5X74TLXRPQXOMJBZ5ACJH2AJSIARHTG4YTRYH7JPGCBKOLJ7ULHA, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.273754923 (146h10m41.704835044s) [noise=true , address=79.127.220.97:4372 , piece_id=45FMSDFL5C4YFMVJGW2P4TGEUPFAIQTLUDAHO2UGS67WI2JBVVWQ, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.273905010 (146h10m41.704985141s) [noise=true , address=104.36.82.35:4582 , piece_id=MH6VDMP6L3XFBFS6PL6ZB6GHTYYD2ZU5EK5V5MDSV4UVJV4ZNMTA, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.274015352 (146h10m41.705095483s) [noise=true , address=104.36.82.47:4536 , piece_id=FWS3PLQH6L7GMBKM2HFS6NZMMHZI2NTVZJKZLWK6ATMEWDGSUFVQ, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.274118509 (146h10m41.70519864s) [noise=true , address=77.90.31.11:4571 , piece_id=RW6SC5EYX5AGOZLEGFEMTYVJLTVYY3MKXSCKYKXQTHGUXV37LJAA, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.274250973 (146h10m41.705331094s) [noise=true , address=66.23.193.175:4555 , piece_id=RDEDVZGRCDCHGNOC22C3B2YQ3AD4ZMMJG4OP5EZRTLZ673AVNUKA, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.274351424 (146h10m41.705431555s) [noise=true , address=77.90.31.17:4795 , piece_id=BNO3U3OUDGF4I37OTE3WIKWWPOJ65VUCLD3EEQ4UXB4XXO2E7B5Q, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.274471164 (146h10m41.705551295s) [noise=true , address=104.36.82.37:4659 , piece_id=Z2DBEQH3XZLEZV44G23SV2WL42TY4IVE7X2JNCNEOOO6WF2FLAWQ, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.274572918 (146h10m41.705653039s) [noise=true , address=104.36.82.60:4355 , piece_id=Q3CA65BVU6PUTDO72M2HX42QML32YG44EEIHGYNQJFQHL4LWINUA, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.274784413 (146h10m41.705864554s) [noise=true , address=104.36.82.58:4285 , piece_id=XCEL3BYOHATFRFAE6M3URMSWXMXSH3GPXLINGOQ4FHJOMKP2RLCA, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:48.489051306 (146h10m42.920131427s) [upload=152050]: Next returned nil segment Aug 14 19:36:48.489068640 (146h10m42.920148771s) [upload=152050]: Waiting for error group managing segments... Aug 14 19:36:48.798943262 (146h10m43.230023393s) [noise=true , address=66.23.193.175:4555 , piece_id=RDEDVZGRCDCHGNOC22C3B2YQ3AD4ZMMJG4OP5EZRTLZ673AVNUKA, seg_pos={0 0}, upload=152050]: Done uploading piece. err: <nil> Aug 14 19:36:49.167891547 (146h10m43.598971678s) [noise=true , address=79.127.220.97:4372 , piece_id=45FMSDFL5C4YFMVJGW2P4TGEUPFAIQTLUDAHO2UGS67WI2JBVVWQ, seg_pos={0 0}, upload=152050]: Done uploading piece. err: <nil> Aug 14 19:36:49.195493900 (146h10m43.626574031s) [noise=true , address=104.36.82.37:4659 , piece_id=Z2DBEQH3XZLEZV44G23SV2WL42TY4IVE7X2JNCNEOOO6WF2FLAWQ, seg_pos={0 0}, upload=152050]: Done uploading piece. err: <nil> Aug 14 19:36:49.198922380 (146h10m43.630002652s) [noise=true , address=77.90.31.11:4571 , piece_id=RW6SC5EYX5AGOZLEGFEMTYVJLTVYY3MKXSCKYKXQTHGUXV37LJAA, seg_pos={0 0}, upload=152050]: Done uploading piece. err: <nil> Aug 14 19:36:49.202830589 (146h10m43.63391072s) [noise=true , address=104.36.82.47:4536 , piece_id=FWS3PLQH6L7GMBKM2HFS6NZMMHZI2NTVZJKZLWK6ATMEWDGSUFVQ, seg_pos={0 0}, upload=152050]: Done uploading piece. err: <nil> Aug 14 19:36:49.205535724 (146h10m43.636615845s) [noise=true , address=77.90.31.11:4564 , piece_id=ZI6WHVPYE3ZSFIPGOVJYV34O3KWYYR7H32GC56TJERBV5RMS5FPQ, seg_pos={0 0}, upload=152050]: Done uploading piece. err: <nil> Aug 14 19:36:49.208010330 (146h10m43.639090461s) [noise=true , address=104.36.82.62:4427 , piece_id=K4RKZ5YSFLA5OXAJOMX2EKIOVHPESPLJWB5MIB55UBOTRK2KCVNQ, seg_pos={0 0}, upload=152050]: Done uploading piece. err: <nil> Aug 14 19:36:49.243704887 (146h10m43.674785018s) [noise=true , address=104.36.82.58:4285 , piece_id=XCEL3BYOHATFRFAE6M3URMSWXMXSH3GPXLINGOQ4FHJOMKP2RLCA, seg_pos={0 0}, upload=152050]: Done uploading piece. err: <nil> Aug 14 19:36:49.260992826 (146h10m43.692072957s) [noise=true , address=77.90.31.15:4714 , piece_id=K6BZWO76LWNIKWBPOWFM3EMW673THPZR3DZG64TILQKEBRNV5IMQ, seg_pos={0 0}, upload=152050]: Done uploading piece. err: <nil> Aug 14 19:36:49.263322674 (146h10m43.694402805s) [noise=true , address=104.36.82.59:4305 , piece_id=5X74TLXRPQXOMJBZ5ACJH2AJSIARHTG4YTRYH7JPGCBKOLJ7ULHA, seg_pos={0 0}, upload=152050]: Done uploading piece. err: <nil> Aug 14 19:36:49.271150021 (146h10m43.702230152s) [noise=true , address=77.90.31.17:4795 , piece_id=BNO3U3OUDGF4I37OTE3WIKWWPOJ65VUCLD3EEQ4UXB4XXO2E7B5Q, seg_pos={0 0}, upload=152050]: Done uploading piece. err: <nil> Aug 14 19:36:49.352018554 (146h10m43.783098685s) [noise=true , address=104.36.82.3:4793 , piece_id=TYN4AFQQ3UA5MDHMQ3XOU7T52JWZBUK5DU44BXDMZ6C5LESFYINA, seg_pos={0 0}, upload=152050]: Done uploading piece. err: <nil> Aug 14 19:36:49.368588209 (146h10m43.79966834s) [noise=true , address=104.36.82.16:4304 , piece_id=CJGYO6LGDA2TRXFS5K7PFBLE2WGLP3YEYKRN7MLGKN6O5YYEM6HA, seg_pos={0 0}, upload=152050]: Done uploading piece. err: <nil> Aug 14 19:36:49.382358587 (146h10m43.813438718s) [noise=true , address=104.36.82.4:4833 , piece_id=P6NINOEWKUMNNAVY5ZNAYOG657GQIVJQL4A6WV37KNLFQVGIJDYQ, seg_pos={0 0}, upload=152050]: Done uploading piece. err: <nil> Aug 14 19:36:49.382426116 (146h10m43.813506247s) [seg_pos={0 0}, upload=152050]: Segment reached optimal threshold of 14 pieces. Aug 14 19:36:49.382653862 (146h10m43.813733993s) [noise=true , address=104.36.82.60:4355 , piece_id=Q3CA65BVU6PUTDO72M2HX42QML32YG44EEIHGYNQJFQHL4LWINUA, seg_pos={0 0}, upload=152050]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eA7ZLTkgGyCRsnQSEC8oYM3y9oeB5MQ4FUueJNMb4FLZueNv2): protocol: expected piece hash; context canceled; EOF Aug 14 19:36:49.382715459 (146h10m43.81379559s) [noise=true , address=104.36.82.58:4270 , piece_id=32CSIPJG3BXGUB5MCNHFSJSCCZF7CXWRBDHG3FC3TJK53GX2QHZQ, seg_pos={0 0}, upload=152050]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sJfMr1nMTpizd5PZ2bZ6M8tZWhFL2ukdJ3cNSRQtdUHNJhg81): protocol: expected piece hash; context canceled; EOF Aug 14 19:36:49.382756268 (146h10m43.813836399s) [noise=true , address=45.91.116.10:4098 , piece_id=GVHNGR6VDGKFRUAVMOUIXSJ2XVCRIRQ2AXO5TXZXQJBNZRHAMCXQ, seg_pos={0 0}, upload=152050]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ji2HtjJ47F98PDMF35jMakxPqNMRBFGRQpNP8sWKrGdWxe2Yb): protocol: write tcp 188.166.225.170:40964->45.91.116.10:4098: use of closed network connection; write tcp 188.166.225.170:40964->45.91.116.10:4098: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40964->45.91.116.10:4098: use of closed network connection Aug 14 19:36:49.382765906 (146h10m43.813846037s) [noise=true , address=104.36.82.35:4582 , piece_id=MH6VDMP6L3XFBFS6PL6ZB6GHTYYD2ZU5EK5V5MDSV4UVJV4ZNMTA, seg_pos={0 0}, upload=152050]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa): protocol: write tcp 188.166.225.170:45012->104.36.82.35:4582: use of closed network connection; write tcp 188.166.225.170:45012->104.36.82.35:4582: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45012->104.36.82.35:4582: use of closed network connection Aug 14 19:36:49.382776597 (146h10m43.813856718s) [seg_pos={0 0}, upload=152050]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 14 19:36:49.382863303 (146h10m43.813943424s) [upload=152050]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 14 19:36:49.382867841 (146h10m43.813947972s) [upload=152050]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 19:36:50.087438133 (146h10m44.518518264s) [upload=152050]: Done uploading segments... Aug 14 19:36:50.087456277 (146h10m44.518536398s) [upload=152050]: Upload finished. err: <nil> Duration: 6.408865822s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..............................X....X...................X.X..] duration: 6.587143999s FAIL (2025-08-14 19:38:08 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 359dba9513878916461178e686c37e9de1c2a6a775e5609c6ded8301d5d9f3cb != before 7564846a546ab95996504ce6d130f23da6186f0a68402887849656db4a499a42 ======LOGS====== Aug 14 19:36:46.697679574 (146h10m41.128759705s) [upload=152050]: Starting upload Aug 14 19:36:46.697739058 (146h10m41.128819189s) [upload=152050]: Done starting upload Aug 14 19:36:46.697858285 (146h10m41.128938406s) [upload=152050]: Uploading segments... Aug 14 19:36:46.697991290 (146h10m41.129071421s) [upload=152050]: Got next segment. Inline: false Aug 14 19:36:46.698021317 (146h10m41.129101448s) [upload=152050]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 19:36:46.698025666 (146h10m41.129105797s) [upload=152050]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 19:36:47.272229084 (146h10m41.703309205s) [seg_pos={0 0}, upload=152050]: Begin upload segment... Aug 14 19:36:47.272277276 (146h10m41.703357397s) [seg_pos={0 0}, upload=152050]: Done begin upload segment. Aug 14 19:36:47.272299538 (146h10m41.703379669s) [noise=true , address=104.36.82.16:4304 , piece_id=CJGYO6LGDA2TRXFS5K7PFBLE2WGLP3YEYKRN7MLGKN6O5YYEM6HA, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.272367018 (146h10m41.703447149s) [noise=true , address=45.91.116.10:4098 , piece_id=GVHNGR6VDGKFRUAVMOUIXSJ2XVCRIRQ2AXO5TXZXQJBNZRHAMCXQ, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.272672813 (146h10m41.703752944s) [noise=true , address=104.36.82.62:4427 , piece_id=K4RKZ5YSFLA5OXAJOMX2EKIOVHPESPLJWB5MIB55UBOTRK2KCVNQ, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.272909987 (146h10m41.703990118s) [noise=true , address=77.90.31.11:4564 , piece_id=ZI6WHVPYE3ZSFIPGOVJYV34O3KWYYR7H32GC56TJERBV5RMS5FPQ, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.272960793 (146h10m41.704040914s) [noise=true , address=104.36.82.58:4270 , piece_id=32CSIPJG3BXGUB5MCNHFSJSCCZF7CXWRBDHG3FC3TJK53GX2QHZQ, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.273201454 (146h10m41.704281585s) [noise=true , address=104.36.82.3:4793 , piece_id=TYN4AFQQ3UA5MDHMQ3XOU7T52JWZBUK5DU44BXDMZ6C5LESFYINA, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.273241170 (146h10m41.704321301s) [noise=true , address=77.90.31.15:4714 , piece_id=K6BZWO76LWNIKWBPOWFM3EMW673THPZR3DZG64TILQKEBRNV5IMQ, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.273482181 (146h10m41.704562302s) [noise=true , address=104.36.82.4:4833 , piece_id=P6NINOEWKUMNNAVY5ZNAYOG657GQIVJQL4A6WV37KNLFQVGIJDYQ, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.273594406 (146h10m41.704674537s) [noise=true , address=104.36.82.59:4305 , piece_id=5X74TLXRPQXOMJBZ5ACJH2AJSIARHTG4YTRYH7JPGCBKOLJ7ULHA, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.273754923 (146h10m41.704835044s) [noise=true , address=79.127.220.97:4372 , piece_id=45FMSDFL5C4YFMVJGW2P4TGEUPFAIQTLUDAHO2UGS67WI2JBVVWQ, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.273905010 (146h10m41.704985141s) [noise=true , address=104.36.82.35:4582 , piece_id=MH6VDMP6L3XFBFS6PL6ZB6GHTYYD2ZU5EK5V5MDSV4UVJV4ZNMTA, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.274015352 (146h10m41.705095483s) [noise=true , address=104.36.82.47:4536 , piece_id=FWS3PLQH6L7GMBKM2HFS6NZMMHZI2NTVZJKZLWK6ATMEWDGSUFVQ, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.274118509 (146h10m41.70519864s) [noise=true , address=77.90.31.11:4571 , piece_id=RW6SC5EYX5AGOZLEGFEMTYVJLTVYY3MKXSCKYKXQTHGUXV37LJAA, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.274250973 (146h10m41.705331094s) [noise=true , address=66.23.193.175:4555 , piece_id=RDEDVZGRCDCHGNOC22C3B2YQ3AD4ZMMJG4OP5EZRTLZ673AVNUKA, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.274351424 (146h10m41.705431555s) [noise=true , address=77.90.31.17:4795 , piece_id=BNO3U3OUDGF4I37OTE3WIKWWPOJ65VUCLD3EEQ4UXB4XXO2E7B5Q, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.274471164 (146h10m41.705551295s) [noise=true , address=104.36.82.37:4659 , piece_id=Z2DBEQH3XZLEZV44G23SV2WL42TY4IVE7X2JNCNEOOO6WF2FLAWQ, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.274572918 (146h10m41.705653039s) [noise=true , address=104.36.82.60:4355 , piece_id=Q3CA65BVU6PUTDO72M2HX42QML32YG44EEIHGYNQJFQHL4LWINUA, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.274784413 (146h10m41.705864554s) [noise=true , address=104.36.82.58:4285 , piece_id=XCEL3BYOHATFRFAE6M3URMSWXMXSH3GPXLINGOQ4FHJOMKP2RLCA, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:48.489051306 (146h10m42.920131427s) [upload=152050]: Next returned nil segment Aug 14 19:36:48.489068640 (146h10m42.920148771s) [upload=152050]: Waiting for error group managing segments... Aug 14 19:36:48.798943262 (146h10m43.230023393s) [noise=true , address=66.23.193.175:4555 , piece_id=RDEDVZGRCDCHGNOC22C3B2YQ3AD4ZMMJG4OP5EZRTLZ673AVNUKA, seg_pos={0 0}, upload=152050]: Done uploading piece. err: <nil> Aug 14 19:36:49.167891547 (146h10m43.598971678s) [noise=true , address=79.127.220.97:4372 , piece_id=45FMSDFL5C4YFMVJGW2P4TGEUPFAIQTLUDAHO2UGS67WI2JBVVWQ, seg_pos={0 0}, upload=152050]: Done uploading piece. err: <nil> Aug 14 19:36:49.195493900 (146h10m43.626574031s) [noise=true , address=104.36.82.37:4659 , piece_id=Z2DBEQH3XZLEZV44G23SV2WL42TY4IVE7X2JNCNEOOO6WF2FLAWQ, seg_pos={0 0}, upload=152050]: Done uploading piece. err: <nil> Aug 14 19:36:49.198922380 (146h10m43.630002652s) [noise=true , address=77.90.31.11:4571 , piece_id=RW6SC5EYX5AGOZLEGFEMTYVJLTVYY3MKXSCKYKXQTHGUXV37LJAA, seg_pos={0 0}, upload=152050]: Done uploading piece. err: <nil> Aug 14 19:36:49.202830589 (146h10m43.63391072s) [noise=true , address=104.36.82.47:4536 , piece_id=FWS3PLQH6L7GMBKM2HFS6NZMMHZI2NTVZJKZLWK6ATMEWDGSUFVQ, seg_pos={0 0}, upload=152050]: Done uploading piece. err: <nil> Aug 14 19:36:49.205535724 (146h10m43.636615845s) [noise=true , address=77.90.31.11:4564 , piece_id=ZI6WHVPYE3ZSFIPGOVJYV34O3KWYYR7H32GC56TJERBV5RMS5FPQ, seg_pos={0 0}, upload=152050]: Done uploading piece. err: <nil> Aug 14 19:36:49.208010330 (146h10m43.639090461s) [noise=true , address=104.36.82.62:4427 , piece_id=K4RKZ5YSFLA5OXAJOMX2EKIOVHPESPLJWB5MIB55UBOTRK2KCVNQ, seg_pos={0 0}, upload=152050]: Done uploading piece. err: <nil> Aug 14 19:36:49.243704887 (146h10m43.674785018s) [noise=true , address=104.36.82.58:4285 , piece_id=XCEL3BYOHATFRFAE6M3URMSWXMXSH3GPXLINGOQ4FHJOMKP2RLCA, seg_pos={0 0}, upload=152050]: Done uploading piece. err: <nil> Aug 14 19:36:49.260992826 (146h10m43.692072957s) [noise=true , address=77.90.31.15:4714 , piece_id=K6BZWO76LWNIKWBPOWFM3EMW673THPZR3DZG64TILQKEBRNV5IMQ, seg_pos={0 0}, upload=152050]: Done uploading piece. err: <nil> Aug 14 19:36:49.263322674 (146h10m43.694402805s) [noise=true , address=104.36.82.59:4305 , piece_id=5X74TLXRPQXOMJBZ5ACJH2AJSIARHTG4YTRYH7JPGCBKOLJ7ULHA, seg_pos={0 0}, upload=152050]: Done uploading piece. err: <nil> Aug 14 19:36:49.271150021 (146h10m43.702230152s) [noise=true , address=77.90.31.17:4795 , piece_id=BNO3U3OUDGF4I37OTE3WIKWWPOJ65VUCLD3EEQ4UXB4XXO2E7B5Q, seg_pos={0 0}, upload=152050]: Done uploading piece. err: <nil> Aug 14 19:36:49.352018554 (146h10m43.783098685s) [noise=true , address=104.36.82.3:4793 , piece_id=TYN4AFQQ3UA5MDHMQ3XOU7T52JWZBUK5DU44BXDMZ6C5LESFYINA, seg_pos={0 0}, upload=152050]: Done uploading piece. err: <nil> Aug 14 19:36:49.368588209 (146h10m43.79966834s) [noise=true , address=104.36.82.16:4304 , piece_id=CJGYO6LGDA2TRXFS5K7PFBLE2WGLP3YEYKRN7MLGKN6O5YYEM6HA, seg_pos={0 0}, upload=152050]: Done uploading piece. err: <nil> Aug 14 19:36:49.382358587 (146h10m43.813438718s) [noise=true , address=104.36.82.4:4833 , piece_id=P6NINOEWKUMNNAVY5ZNAYOG657GQIVJQL4A6WV37KNLFQVGIJDYQ, seg_pos={0 0}, upload=152050]: Done uploading piece. err: <nil> Aug 14 19:36:49.382426116 (146h10m43.813506247s) [seg_pos={0 0}, upload=152050]: Segment reached optimal threshold of 14 pieces. Aug 14 19:36:49.382653862 (146h10m43.813733993s) [noise=true , address=104.36.82.60:4355 , piece_id=Q3CA65BVU6PUTDO72M2HX42QML32YG44EEIHGYNQJFQHL4LWINUA, seg_pos={0 0}, upload=152050]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eA7ZLTkgGyCRsnQSEC8oYM3y9oeB5MQ4FUueJNMb4FLZueNv2): protocol: expected piece hash; context canceled; EOF Aug 14 19:36:49.382715459 (146h10m43.81379559s) [noise=true , address=104.36.82.58:4270 , piece_id=32CSIPJG3BXGUB5MCNHFSJSCCZF7CXWRBDHG3FC3TJK53GX2QHZQ, seg_pos={0 0}, upload=152050]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sJfMr1nMTpizd5PZ2bZ6M8tZWhFL2ukdJ3cNSRQtdUHNJhg81): protocol: expected piece hash; context canceled; EOF Aug 14 19:36:49.382756268 (146h10m43.813836399s) [noise=true , address=45.91.116.10:4098 , piece_id=GVHNGR6VDGKFRUAVMOUIXSJ2XVCRIRQ2AXO5TXZXQJBNZRHAMCXQ, seg_pos={0 0}, upload=152050]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ji2HtjJ47F98PDMF35jMakxPqNMRBFGRQpNP8sWKrGdWxe2Yb): protocol: write tcp 188.166.225.170:40964->45.91.116.10:4098: use of closed network connection; write tcp 188.166.225.170:40964->45.91.116.10:4098: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40964->45.91.116.10:4098: use of closed network connection Aug 14 19:36:49.382765906 (146h10m43.813846037s) [noise=true , address=104.36.82.35:4582 , piece_id=MH6VDMP6L3XFBFS6PL6ZB6GHTYYD2ZU5EK5V5MDSV4UVJV4ZNMTA, seg_pos={0 0}, upload=152050]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa): protocol: write tcp 188.166.225.170:45012->104.36.82.35:4582: use of closed network connection; write tcp 188.166.225.170:45012->104.36.82.35:4582: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45012->104.36.82.35:4582: use of closed network connection Aug 14 19:36:49.382776597 (146h10m43.813856718s) [seg_pos={0 0}, upload=152050]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 14 19:36:49.382863303 (146h10m43.813943424s) [upload=152050]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 14 19:36:49.382867841 (146h10m43.813947972s) [upload=152050]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 19:36:50.087438133 (146h10m44.518518264s) [upload=152050]: Done uploading segments... Aug 14 19:36:50.087456277 (146h10m44.518536398s) [upload=152050]: Upload finished. err: <nil> Duration: 6.587169298s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 2.524509667s FAIL (2025-08-14 19:37:56 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 14 19:07:41.786508305 (145h41m36.217588436s) [upload=151546]: Starting upload Aug 14 19:07:41.786586363 (145h41m36.217666494s) [upload=151546]: Done starting upload Aug 14 19:07:41.786650096 (145h41m36.217730237s) [upload=151546]: Uploading segments... Aug 14 19:07:41.786691344 (145h41m36.217771475s) [upload=151546]: Got next segment. Inline: true Aug 14 19:07:41.786695231 (145h41m36.217775353s) [upload=151546]: Waiting for error group managing segments... Aug 14 19:07:41.786736050 (145h41m36.217816181s) [upload=151546]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 19:07:41.786740278 (145h41m36.217820409s) [upload=151546]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 19:07:41.786742793 (145h41m36.217822924s) [upload=151546]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 19:07:42.077859232 (145h41m36.508939363s) [upload=151546]: Done uploading segments... Aug 14 19:07:42.077877176 (145h41m36.508957307s) [upload=151546]: Upload finished. err: <nil> Duration:* 2.524536117s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [...............................X....X...................X.X.] duration: 6.064867952s FAIL (2025-08-14 19:37:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 359dba9513878916461178e686c37e9de1c2a6a775e5609c6ded8301d5d9f3cb != before 7564846a546ab95996504ce6d130f23da6186f0a68402887849656db4a499a42 ======LOGS====== Aug 14 19:36:46.697679574 (146h10m41.128759705s) [upload=152050]: Starting upload Aug 14 19:36:46.697739058 (146h10m41.128819189s) [upload=152050]: Done starting upload Aug 14 19:36:46.697858285 (146h10m41.128938406s) [upload=152050]: Uploading segments... Aug 14 19:36:46.697991290 (146h10m41.129071421s) [upload=152050]: Got next segment. Inline: false Aug 14 19:36:46.698021317 (146h10m41.129101448s) [upload=152050]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 19:36:46.698025666 (146h10m41.129105797s) [upload=152050]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 19:36:47.272229084 (146h10m41.703309205s) [seg_pos={0 0}, upload=152050]: Begin upload segment... Aug 14 19:36:47.272277276 (146h10m41.703357397s) [seg_pos={0 0}, upload=152050]: Done begin upload segment. Aug 14 19:36:47.272299538 (146h10m41.703379669s) [noise=true , address=104.36.82.16:4304 , piece_id=CJGYO6LGDA2TRXFS5K7PFBLE2WGLP3YEYKRN7MLGKN6O5YYEM6HA, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.272367018 (146h10m41.703447149s) [noise=true , address=45.91.116.10:4098 , piece_id=GVHNGR6VDGKFRUAVMOUIXSJ2XVCRIRQ2AXO5TXZXQJBNZRHAMCXQ, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.272672813 (146h10m41.703752944s) [noise=true , address=104.36.82.62:4427 , piece_id=K4RKZ5YSFLA5OXAJOMX2EKIOVHPESPLJWB5MIB55UBOTRK2KCVNQ, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.272909987 (146h10m41.703990118s) [noise=true , address=77.90.31.11:4564 , piece_id=ZI6WHVPYE3ZSFIPGOVJYV34O3KWYYR7H32GC56TJERBV5RMS5FPQ, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.272960793 (146h10m41.704040914s) [noise=true , address=104.36.82.58:4270 , piece_id=32CSIPJG3BXGUB5MCNHFSJSCCZF7CXWRBDHG3FC3TJK53GX2QHZQ, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.273201454 (146h10m41.704281585s) [noise=true , address=104.36.82.3:4793 , piece_id=TYN4AFQQ3UA5MDHMQ3XOU7T52JWZBUK5DU44BXDMZ6C5LESFYINA, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.273241170 (146h10m41.704321301s) [noise=true , address=77.90.31.15:4714 , piece_id=K6BZWO76LWNIKWBPOWFM3EMW673THPZR3DZG64TILQKEBRNV5IMQ, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.273482181 (146h10m41.704562302s) [noise=true , address=104.36.82.4:4833 , piece_id=P6NINOEWKUMNNAVY5ZNAYOG657GQIVJQL4A6WV37KNLFQVGIJDYQ, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.273594406 (146h10m41.704674537s) [noise=true , address=104.36.82.59:4305 , piece_id=5X74TLXRPQXOMJBZ5ACJH2AJSIARHTG4YTRYH7JPGCBKOLJ7ULHA, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.273754923 (146h10m41.704835044s) [noise=true , address=79.127.220.97:4372 , piece_id=45FMSDFL5C4YFMVJGW2P4TGEUPFAIQTLUDAHO2UGS67WI2JBVVWQ, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.273905010 (146h10m41.704985141s) [noise=true , address=104.36.82.35:4582 , piece_id=MH6VDMP6L3XFBFS6PL6ZB6GHTYYD2ZU5EK5V5MDSV4UVJV4ZNMTA, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.274015352 (146h10m41.705095483s) [noise=true , address=104.36.82.47:4536 , piece_id=FWS3PLQH6L7GMBKM2HFS6NZMMHZI2NTVZJKZLWK6ATMEWDGSUFVQ, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.274118509 (146h10m41.70519864s) [noise=true , address=77.90.31.11:4571 , piece_id=RW6SC5EYX5AGOZLEGFEMTYVJLTVYY3MKXSCKYKXQTHGUXV37LJAA, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.274250973 (146h10m41.705331094s) [noise=true , address=66.23.193.175:4555 , piece_id=RDEDVZGRCDCHGNOC22C3B2YQ3AD4ZMMJG4OP5EZRTLZ673AVNUKA, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.274351424 (146h10m41.705431555s) [noise=true , address=77.90.31.17:4795 , piece_id=BNO3U3OUDGF4I37OTE3WIKWWPOJ65VUCLD3EEQ4UXB4XXO2E7B5Q, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.274471164 (146h10m41.705551295s) [noise=true , address=104.36.82.37:4659 , piece_id=Z2DBEQH3XZLEZV44G23SV2WL42TY4IVE7X2JNCNEOOO6WF2FLAWQ, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.274572918 (146h10m41.705653039s) [noise=true , address=104.36.82.60:4355 , piece_id=Q3CA65BVU6PUTDO72M2HX42QML32YG44EEIHGYNQJFQHL4LWINUA, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.274784413 (146h10m41.705864554s) [noise=true , address=104.36.82.58:4285 , piece_id=XCEL3BYOHATFRFAE6M3URMSWXMXSH3GPXLINGOQ4FHJOMKP2RLCA, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:48.489051306 (146h10m42.920131427s) [upload=152050]: Next returned nil segment Aug 14 19:36:48.489068640 (146h10m42.920148771s) [upload=152050]: Waiting for error group managing segments... Aug 14 19:36:48.798943262 (146h10m43.230023393s) [noise=true , address=66.23.193.175:4555 , piece_id=RDEDVZGRCDCHGNOC22C3B2YQ3AD4ZMMJG4OP5EZRTLZ673AVNUKA, seg_pos={0 0}, upload=152050]: Done uploading piece. err: <nil> Aug 14 19:36:49.167891547 (146h10m43.598971678s) [noise=true , address=79.127.220.97:4372 , piece_id=45FMSDFL5C4YFMVJGW2P4TGEUPFAIQTLUDAHO2UGS67WI2JBVVWQ, seg_pos={0 0}, upload=152050]: Done uploading piece. err: <nil> Aug 14 19:36:49.195493900 (146h10m43.626574031s) [noise=true , address=104.36.82.37:4659 , piece_id=Z2DBEQH3XZLEZV44G23SV2WL42TY4IVE7X2JNCNEOOO6WF2FLAWQ, seg_pos={0 0}, upload=152050]: Done uploading piece. err: <nil> Aug 14 19:36:49.198922380 (146h10m43.630002652s) [noise=true , address=77.90.31.11:4571 , piece_id=RW6SC5EYX5AGOZLEGFEMTYVJLTVYY3MKXSCKYKXQTHGUXV37LJAA, seg_pos={0 0}, upload=152050]: Done uploading piece. err: <nil> Aug 14 19:36:49.202830589 (146h10m43.63391072s) [noise=true , address=104.36.82.47:4536 , piece_id=FWS3PLQH6L7GMBKM2HFS6NZMMHZI2NTVZJKZLWK6ATMEWDGSUFVQ, seg_pos={0 0}, upload=152050]: Done uploading piece. err: <nil> Aug 14 19:36:49.205535724 (146h10m43.636615845s) [noise=true , address=77.90.31.11:4564 , piece_id=ZI6WHVPYE3ZSFIPGOVJYV34O3KWYYR7H32GC56TJERBV5RMS5FPQ, seg_pos={0 0}, upload=152050]: Done uploading piece. err: <nil> Aug 14 19:36:49.208010330 (146h10m43.639090461s) [noise=true , address=104.36.82.62:4427 , piece_id=K4RKZ5YSFLA5OXAJOMX2EKIOVHPESPLJWB5MIB55UBOTRK2KCVNQ, seg_pos={0 0}, upload=152050]: Done uploading piece. err: <nil> Aug 14 19:36:49.243704887 (146h10m43.674785018s) [noise=true , address=104.36.82.58:4285 , piece_id=XCEL3BYOHATFRFAE6M3URMSWXMXSH3GPXLINGOQ4FHJOMKP2RLCA, seg_pos={0 0}, upload=152050]: Done uploading piece. err: <nil> Aug 14 19:36:49.260992826 (146h10m43.692072957s) [noise=true , address=77.90.31.15:4714 , piece_id=K6BZWO76LWNIKWBPOWFM3EMW673THPZR3DZG64TILQKEBRNV5IMQ, seg_pos={0 0}, upload=152050]: Done uploading piece. err: <nil> Aug 14 19:36:49.263322674 (146h10m43.694402805s) [noise=true , address=104.36.82.59:4305 , piece_id=5X74TLXRPQXOMJBZ5ACJH2AJSIARHTG4YTRYH7JPGCBKOLJ7ULHA, seg_pos={0 0}, upload=152050]: Done uploading piece. err: <nil> Aug 14 19:36:49.271150021 (146h10m43.702230152s) [noise=true , address=77.90.31.17:4795 , piece_id=BNO3U3OUDGF4I37OTE3WIKWWPOJ65VUCLD3EEQ4UXB4XXO2E7B5Q, seg_pos={0 0}, upload=152050]: Done uploading piece. err: <nil> Aug 14 19:36:49.352018554 (146h10m43.783098685s) [noise=true , address=104.36.82.3:4793 , piece_id=TYN4AFQQ3UA5MDHMQ3XOU7T52JWZBUK5DU44BXDMZ6C5LESFYINA, seg_pos={0 0}, upload=152050]: Done uploading piece. err: <nil> Aug 14 19:36:49.368588209 (146h10m43.79966834s) [noise=true , address=104.36.82.16:4304 , piece_id=CJGYO6LGDA2TRXFS5K7PFBLE2WGLP3YEYKRN7MLGKN6O5YYEM6HA, seg_pos={0 0}, upload=152050]: Done uploading piece. err: <nil> Aug 14 19:36:49.382358587 (146h10m43.813438718s) [noise=true , address=104.36.82.4:4833 , piece_id=P6NINOEWKUMNNAVY5ZNAYOG657GQIVJQL4A6WV37KNLFQVGIJDYQ, seg_pos={0 0}, upload=152050]: Done uploading piece. err: <nil> Aug 14 19:36:49.382426116 (146h10m43.813506247s) [seg_pos={0 0}, upload=152050]: Segment reached optimal threshold of 14 pieces. Aug 14 19:36:49.382653862 (146h10m43.813733993s) [noise=true , address=104.36.82.60:4355 , piece_id=Q3CA65BVU6PUTDO72M2HX42QML32YG44EEIHGYNQJFQHL4LWINUA, seg_pos={0 0}, upload=152050]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eA7ZLTkgGyCRsnQSEC8oYM3y9oeB5MQ4FUueJNMb4FLZueNv2): protocol: expected piece hash; context canceled; EOF Aug 14 19:36:49.382715459 (146h10m43.81379559s) [noise=true , address=104.36.82.58:4270 , piece_id=32CSIPJG3BXGUB5MCNHFSJSCCZF7CXWRBDHG3FC3TJK53GX2QHZQ, seg_pos={0 0}, upload=152050]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sJfMr1nMTpizd5PZ2bZ6M8tZWhFL2ukdJ3cNSRQtdUHNJhg81): protocol: expected piece hash; context canceled; EOF Aug 14 19:36:49.382756268 (146h10m43.813836399s) [noise=true , address=45.91.116.10:4098 , piece_id=GVHNGR6VDGKFRUAVMOUIXSJ2XVCRIRQ2AXO5TXZXQJBNZRHAMCXQ, seg_pos={0 0}, upload=152050]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ji2HtjJ47F98PDMF35jMakxPqNMRBFGRQpNP8sWKrGdWxe2Yb): protocol: write tcp 188.166.225.170:40964->45.91.116.10:4098: use of closed network connection; write tcp 188.166.225.170:40964->45.91.116.10:4098: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40964->45.91.116.10:4098: use of closed network connection Aug 14 19:36:49.382765906 (146h10m43.813846037s) [noise=true , address=104.36.82.35:4582 , piece_id=MH6VDMP6L3XFBFS6PL6ZB6GHTYYD2ZU5EK5V5MDSV4UVJV4ZNMTA, seg_pos={0 0}, upload=152050]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa): protocol: write tcp 188.166.225.170:45012->104.36.82.35:4582: use of closed network connection; write tcp 188.166.225.170:45012->104.36.82.35:4582: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45012->104.36.82.35:4582: use of closed network connection Aug 14 19:36:49.382776597 (146h10m43.813856718s) [seg_pos={0 0}, upload=152050]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 14 19:36:49.382863303 (146h10m43.813943424s) [upload=152050]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 14 19:36:49.382867841 (146h10m43.813947972s) [upload=152050]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 19:36:50.087438133 (146h10m44.518518264s) [upload=152050]: Done uploading segments... Aug 14 19:36:50.087456277 (146h10m44.518536398s) [upload=152050]: Upload finished. err: <nil> Duration: 6.064894413s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 1.965758956s FAIL (2025-08-14 19:36:54 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 14 19:07:41.786508305 (145h41m36.217588436s) [upload=151546]: Starting upload Aug 14 19:07:41.786586363 (145h41m36.217666494s) [upload=151546]: Done starting upload Aug 14 19:07:41.786650096 (145h41m36.217730237s) [upload=151546]: Uploading segments... Aug 14 19:07:41.786691344 (145h41m36.217771475s) [upload=151546]: Got next segment. Inline: true Aug 14 19:07:41.786695231 (145h41m36.217775353s) [upload=151546]: Waiting for error group managing segments... Aug 14 19:07:41.786736050 (145h41m36.217816181s) [upload=151546]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 19:07:41.786740278 (145h41m36.217820409s) [upload=151546]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 19:07:41.786742793 (145h41m36.217822924s) [upload=151546]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 19:07:42.077859232 (145h41m36.508939363s) [upload=151546]: Done uploading segments... Aug 14 19:07:42.077877176 (145h41m36.508957307s) [upload=151546]: Upload finished. err: <nil> Duration:* 1.965780066s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [................................X....X...................X.X] duration: 6.802832112s FAIL (2025-08-14 19:36:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 359dba9513878916461178e686c37e9de1c2a6a775e5609c6ded8301d5d9f3cb != before 7564846a546ab95996504ce6d130f23da6186f0a68402887849656db4a499a42 ======LOGS====== Aug 14 19:36:46.697679574 (146h10m41.128759705s) [upload=152050]: Starting upload Aug 14 19:36:46.697739058 (146h10m41.128819189s) [upload=152050]: Done starting upload Aug 14 19:36:46.697858285 (146h10m41.128938406s) [upload=152050]: Uploading segments... Aug 14 19:36:46.697991290 (146h10m41.129071421s) [upload=152050]: Got next segment. Inline: false Aug 14 19:36:46.698021317 (146h10m41.129101448s) [upload=152050]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 19:36:46.698025666 (146h10m41.129105797s) [upload=152050]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 19:36:47.272229084 (146h10m41.703309205s) [seg_pos={0 0}, upload=152050]: Begin upload segment... Aug 14 19:36:47.272277276 (146h10m41.703357397s) [seg_pos={0 0}, upload=152050]: Done begin upload segment. Aug 14 19:36:47.272299538 (146h10m41.703379669s) [noise=true , address=104.36.82.16:4304 , piece_id=CJGYO6LGDA2TRXFS5K7PFBLE2WGLP3YEYKRN7MLGKN6O5YYEM6HA, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.272367018 (146h10m41.703447149s) [noise=true , address=45.91.116.10:4098 , piece_id=GVHNGR6VDGKFRUAVMOUIXSJ2XVCRIRQ2AXO5TXZXQJBNZRHAMCXQ, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.272672813 (146h10m41.703752944s) [noise=true , address=104.36.82.62:4427 , piece_id=K4RKZ5YSFLA5OXAJOMX2EKIOVHPESPLJWB5MIB55UBOTRK2KCVNQ, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.272909987 (146h10m41.703990118s) [noise=true , address=77.90.31.11:4564 , piece_id=ZI6WHVPYE3ZSFIPGOVJYV34O3KWYYR7H32GC56TJERBV5RMS5FPQ, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.272960793 (146h10m41.704040914s) [noise=true , address=104.36.82.58:4270 , piece_id=32CSIPJG3BXGUB5MCNHFSJSCCZF7CXWRBDHG3FC3TJK53GX2QHZQ, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.273201454 (146h10m41.704281585s) [noise=true , address=104.36.82.3:4793 , piece_id=TYN4AFQQ3UA5MDHMQ3XOU7T52JWZBUK5DU44BXDMZ6C5LESFYINA, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.273241170 (146h10m41.704321301s) [noise=true , address=77.90.31.15:4714 , piece_id=K6BZWO76LWNIKWBPOWFM3EMW673THPZR3DZG64TILQKEBRNV5IMQ, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.273482181 (146h10m41.704562302s) [noise=true , address=104.36.82.4:4833 , piece_id=P6NINOEWKUMNNAVY5ZNAYOG657GQIVJQL4A6WV37KNLFQVGIJDYQ, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.273594406 (146h10m41.704674537s) [noise=true , address=104.36.82.59:4305 , piece_id=5X74TLXRPQXOMJBZ5ACJH2AJSIARHTG4YTRYH7JPGCBKOLJ7ULHA, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.273754923 (146h10m41.704835044s) [noise=true , address=79.127.220.97:4372 , piece_id=45FMSDFL5C4YFMVJGW2P4TGEUPFAIQTLUDAHO2UGS67WI2JBVVWQ, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.273905010 (146h10m41.704985141s) [noise=true , address=104.36.82.35:4582 , piece_id=MH6VDMP6L3XFBFS6PL6ZB6GHTYYD2ZU5EK5V5MDSV4UVJV4ZNMTA, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.274015352 (146h10m41.705095483s) [noise=true , address=104.36.82.47:4536 , piece_id=FWS3PLQH6L7GMBKM2HFS6NZMMHZI2NTVZJKZLWK6ATMEWDGSUFVQ, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.274118509 (146h10m41.70519864s) [noise=true , address=77.90.31.11:4571 , piece_id=RW6SC5EYX5AGOZLEGFEMTYVJLTVYY3MKXSCKYKXQTHGUXV37LJAA, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.274250973 (146h10m41.705331094s) [noise=true , address=66.23.193.175:4555 , piece_id=RDEDVZGRCDCHGNOC22C3B2YQ3AD4ZMMJG4OP5EZRTLZ673AVNUKA, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.274351424 (146h10m41.705431555s) [noise=true , address=77.90.31.17:4795 , piece_id=BNO3U3OUDGF4I37OTE3WIKWWPOJ65VUCLD3EEQ4UXB4XXO2E7B5Q, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.274471164 (146h10m41.705551295s) [noise=true , address=104.36.82.37:4659 , piece_id=Z2DBEQH3XZLEZV44G23SV2WL42TY4IVE7X2JNCNEOOO6WF2FLAWQ, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.274572918 (146h10m41.705653039s) [noise=true , address=104.36.82.60:4355 , piece_id=Q3CA65BVU6PUTDO72M2HX42QML32YG44EEIHGYNQJFQHL4LWINUA, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:47.274784413 (146h10m41.705864554s) [noise=true , address=104.36.82.58:4285 , piece_id=XCEL3BYOHATFRFAE6M3URMSWXMXSH3GPXLINGOQ4FHJOMKP2RLCA, seg_pos={0 0}, upload=152050]: Uploading piece... Aug 14 19:36:48.489051306 (146h10m42.920131427s) [upload=152050]: Next returned nil segment Aug 14 19:36:48.489068640 (146h10m42.920148771s) [upload=152050]: Waiting for error group managing segments... Aug 14 19:36:48.798943262 (146h10m43.230023393s) [noise=true , address=66.23.193.175:4555 , piece_id=RDEDVZGRCDCHGNOC22C3B2YQ3AD4ZMMJG4OP5EZRTLZ673AVNUKA, seg_pos={0 0}, upload=152050]: Done uploading piece. err: <nil> Aug 14 19:36:49.167891547 (146h10m43.598971678s) [noise=true , address=79.127.220.97:4372 , piece_id=45FMSDFL5C4YFMVJGW2P4TGEUPFAIQTLUDAHO2UGS67WI2JBVVWQ, seg_pos={0 0}, upload=152050]: Done uploading piece. err: <nil> Aug 14 19:36:49.195493900 (146h10m43.626574031s) [noise=true , address=104.36.82.37:4659 , piece_id=Z2DBEQH3XZLEZV44G23SV2WL42TY4IVE7X2JNCNEOOO6WF2FLAWQ, seg_pos={0 0}, upload=152050]: Done uploading piece. err: <nil> Aug 14 19:36:49.198922380 (146h10m43.630002652s) [noise=true , address=77.90.31.11:4571 , piece_id=RW6SC5EYX5AGOZLEGFEMTYVJLTVYY3MKXSCKYKXQTHGUXV37LJAA, seg_pos={0 0}, upload=152050]: Done uploading piece. err: <nil> Aug 14 19:36:49.202830589 (146h10m43.63391072s) [noise=true , address=104.36.82.47:4536 , piece_id=FWS3PLQH6L7GMBKM2HFS6NZMMHZI2NTVZJKZLWK6ATMEWDGSUFVQ, seg_pos={0 0}, upload=152050]: Done uploading piece. err: <nil> Aug 14 19:36:49.205535724 (146h10m43.636615845s) [noise=true , address=77.90.31.11:4564 , piece_id=ZI6WHVPYE3ZSFIPGOVJYV34O3KWYYR7H32GC56TJERBV5RMS5FPQ, seg_pos={0 0}, upload=152050]: Done uploading piece. err: <nil> Aug 14 19:36:49.208010330 (146h10m43.639090461s) [noise=true , address=104.36.82.62:4427 , piece_id=K4RKZ5YSFLA5OXAJOMX2EKIOVHPESPLJWB5MIB55UBOTRK2KCVNQ, seg_pos={0 0}, upload=152050]: Done uploading piece. err: <nil> Aug 14 19:36:49.243704887 (146h10m43.674785018s) [noise=true , address=104.36.82.58:4285 , piece_id=XCEL3BYOHATFRFAE6M3URMSWXMXSH3GPXLINGOQ4FHJOMKP2RLCA, seg_pos={0 0}, upload=152050]: Done uploading piece. err: <nil> Aug 14 19:36:49.260992826 (146h10m43.692072957s) [noise=true , address=77.90.31.15:4714 , piece_id=K6BZWO76LWNIKWBPOWFM3EMW673THPZR3DZG64TILQKEBRNV5IMQ, seg_pos={0 0}, upload=152050]: Done uploading piece. err: <nil> Aug 14 19:36:49.263322674 (146h10m43.694402805s) [noise=true , address=104.36.82.59:4305 , piece_id=5X74TLXRPQXOMJBZ5ACJH2AJSIARHTG4YTRYH7JPGCBKOLJ7ULHA, seg_pos={0 0}, upload=152050]: Done uploading piece. err: <nil> Aug 14 19:36:49.271150021 (146h10m43.702230152s) [noise=true , address=77.90.31.17:4795 , piece_id=BNO3U3OUDGF4I37OTE3WIKWWPOJ65VUCLD3EEQ4UXB4XXO2E7B5Q, seg_pos={0 0}, upload=152050]: Done uploading piece. err: <nil> Aug 14 19:36:49.352018554 (146h10m43.783098685s) [noise=true , address=104.36.82.3:4793 , piece_id=TYN4AFQQ3UA5MDHMQ3XOU7T52JWZBUK5DU44BXDMZ6C5LESFYINA, seg_pos={0 0}, upload=152050]: Done uploading piece. err: <nil> Aug 14 19:36:49.368588209 (146h10m43.79966834s) [noise=true , address=104.36.82.16:4304 , piece_id=CJGYO6LGDA2TRXFS5K7PFBLE2WGLP3YEYKRN7MLGKN6O5YYEM6HA, seg_pos={0 0}, upload=152050]: Done uploading piece. err: <nil> Aug 14 19:36:49.382358587 (146h10m43.813438718s) [noise=true , address=104.36.82.4:4833 , piece_id=P6NINOEWKUMNNAVY5ZNAYOG657GQIVJQL4A6WV37KNLFQVGIJDYQ, seg_pos={0 0}, upload=152050]: Done uploading piece. err: <nil> Aug 14 19:36:49.382426116 (146h10m43.813506247s) [seg_pos={0 0}, upload=152050]: Segment reached optimal threshold of 14 pieces. Aug 14 19:36:49.382653862 (146h10m43.813733993s) [noise=true , address=104.36.82.60:4355 , piece_id=Q3CA65BVU6PUTDO72M2HX42QML32YG44EEIHGYNQJFQHL4LWINUA, seg_pos={0 0}, upload=152050]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eA7ZLTkgGyCRsnQSEC8oYM3y9oeB5MQ4FUueJNMb4FLZueNv2): protocol: expected piece hash; context canceled; EOF Aug 14 19:36:49.382715459 (146h10m43.81379559s) [noise=true , address=104.36.82.58:4270 , piece_id=32CSIPJG3BXGUB5MCNHFSJSCCZF7CXWRBDHG3FC3TJK53GX2QHZQ, seg_pos={0 0}, upload=152050]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sJfMr1nMTpizd5PZ2bZ6M8tZWhFL2ukdJ3cNSRQtdUHNJhg81): protocol: expected piece hash; context canceled; EOF Aug 14 19:36:49.382756268 (146h10m43.813836399s) [noise=true , address=45.91.116.10:4098 , piece_id=GVHNGR6VDGKFRUAVMOUIXSJ2XVCRIRQ2AXO5TXZXQJBNZRHAMCXQ, seg_pos={0 0}, upload=152050]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ji2HtjJ47F98PDMF35jMakxPqNMRBFGRQpNP8sWKrGdWxe2Yb): protocol: write tcp 188.166.225.170:40964->45.91.116.10:4098: use of closed network connection; write tcp 188.166.225.170:40964->45.91.116.10:4098: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40964->45.91.116.10:4098: use of closed network connection Aug 14 19:36:49.382765906 (146h10m43.813846037s) [noise=true , address=104.36.82.35:4582 , piece_id=MH6VDMP6L3XFBFS6PL6ZB6GHTYYD2ZU5EK5V5MDSV4UVJV4ZNMTA, seg_pos={0 0}, upload=152050]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa): protocol: write tcp 188.166.225.170:45012->104.36.82.35:4582: use of closed network connection; write tcp 188.166.225.170:45012->104.36.82.35:4582: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45012->104.36.82.35:4582: use of closed network connection Aug 14 19:36:49.382776597 (146h10m43.813856718s) [seg_pos={0 0}, upload=152050]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 14 19:36:49.382863303 (146h10m43.813943424s) [upload=152050]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 14 19:36:49.382867841 (146h10m43.813947972s) [upload=152050]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 19:36:50.087438133 (146h10m44.518518264s) [upload=152050]: Done uploading segments... Aug 14 19:36:50.087456277 (146h10m44.518536398s) [upload=152050]: Upload finished. err: <nil> Duration: 6.802859906s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.................................X....X...................X.] duration: 6.974827916s FAIL (2025-08-14 19:36:28 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 19:35:22.554190500 (146h9m16.985270621s) [upload=152028]: Starting upload Aug 14 19:35:22.554229225 (146h9m16.985309346s) [upload=152028]: Done starting upload Aug 14 19:35:22.554397657 (146h9m16.985477778s) [upload=152028]: Uploading segments... Aug 14 19:35:22.554427734 (146h9m16.985507865s) [upload=152028]: Got next segment. Inline: false Aug 14 19:35:22.554451300 (146h9m16.985531421s) [upload=152028]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 19:35:22.554455297 (146h9m16.985535428s) [upload=152028]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 19:35:22.768557098 (146h9m17.199637229s) [upload=152028]: Next segment err: metaclient: Too Many Requests Aug 14 19:35:22.768576887 (146h9m17.199657018s) [upload=152028]: Done uploading segments... Aug 14 19:35:22.768592285 (146h9m17.199672447s) [upload=152028]: Upload finished. err: metaclient: Too Many Requests Duration: 6.974946782s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 1.947001826s FAIL (2025-08-14 19:36:17 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 14 19:07:41.786508305 (145h41m36.217588436s) [upload=151546]: Starting upload Aug 14 19:07:41.786586363 (145h41m36.217666494s) [upload=151546]: Done starting upload Aug 14 19:07:41.786650096 (145h41m36.217730237s) [upload=151546]: Uploading segments... Aug 14 19:07:41.786691344 (145h41m36.217771475s) [upload=151546]: Got next segment. Inline: true Aug 14 19:07:41.786695231 (145h41m36.217775353s) [upload=151546]: Waiting for error group managing segments... Aug 14 19:07:41.786736050 (145h41m36.217816181s) [upload=151546]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 19:07:41.786740278 (145h41m36.217820409s) [upload=151546]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 19:07:41.786742793 (145h41m36.217822924s) [upload=151546]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 19:07:42.077859232 (145h41m36.508939363s) [upload=151546]: Done uploading segments... Aug 14 19:07:42.077877176 (145h41m36.508957307s) [upload=151546]: Upload finished. err: <nil> Duration:* 1.947031722s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..................................X....X...................X] duration: 867.093843ms FAIL (2025-08-14 19:35:22 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 19:35:22.554190500 (146h9m16.985270621s) [upload=152028]: Starting upload Aug 14 19:35:22.554229225 (146h9m16.985309346s) [upload=152028]: Done starting upload Aug 14 19:35:22.554397657 (146h9m16.985477778s) [upload=152028]: Uploading segments... Aug 14 19:35:22.554427734 (146h9m16.985507865s) [upload=152028]: Got next segment. Inline: false Aug 14 19:35:22.554451300 (146h9m16.985531421s) [upload=152028]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 19:35:22.554455297 (146h9m16.985535428s) [upload=152028]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 19:35:22.768557098 (146h9m17.199637229s) [upload=152028]: Next segment err: metaclient: Too Many Requests Aug 14 19:35:22.768576887 (146h9m17.199657018s) [upload=152028]: Done uploading segments... Aug 14 19:35:22.768592285 (146h9m17.199672447s) [upload=152028]: Upload finished. err: metaclient: Too Many Requests Duration: 867.115224ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 1.920888329s FAIL (2025-08-14 19:35:08 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 14 19:07:41.786508305 (145h41m36.217588436s) [upload=151546]: Starting upload Aug 14 19:07:41.786586363 (145h41m36.217666494s) [upload=151546]: Done starting upload Aug 14 19:07:41.786650096 (145h41m36.217730237s) [upload=151546]: Uploading segments... Aug 14 19:07:41.786691344 (145h41m36.217771475s) [upload=151546]: Got next segment. Inline: true Aug 14 19:07:41.786695231 (145h41m36.217775353s) [upload=151546]: Waiting for error group managing segments... Aug 14 19:07:41.786736050 (145h41m36.217816181s) [upload=151546]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 19:07:41.786740278 (145h41m36.217820409s) [upload=151546]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 19:07:41.786742793 (145h41m36.217822924s) [upload=151546]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 19:07:42.077859232 (145h41m36.508939363s) [upload=151546]: Done uploading segments... Aug 14 19:07:42.077877176 (145h41m36.508957307s) [upload=151546]: Upload finished. err: <nil> Duration:* 1.920912536s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...................................X....X...................] duration: 6.001049863s FAIL (2025-08-14 19:34:40 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 19:21:49.307741637 (145h55m43.738821768s) [upload=151794]: Starting upload Aug 14 19:21:49.307822251 (145h55m43.738902382s) [upload=151794]: Done starting upload Aug 14 19:21:49.307927863 (145h55m43.739007994s) [upload=151794]: Uploading segments... Aug 14 19:21:49.308065827 (145h55m43.739145958s) [upload=151794]: Got next segment. Inline: false Aug 14 19:21:49.308095183 (145h55m43.739175304s) [upload=151794]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 19:21:49.308099662 (145h55m43.739179793s) [upload=151794]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 19:21:49.522716839 (145h55m43.95379696s) [upload=151794]: Next segment err: metaclient: Too Many Requests Aug 14 19:21:49.522736748 (145h55m43.953816879s) [upload=151794]: Done uploading segments... Aug 14 19:21:49.522755343 (145h55m43.953835474s) [upload=151794]: Upload finished. err: metaclient: Too Many Requests Duration: 6.001078366s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 2.219207274s FAIL (2025-08-14 19:34:37 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 14 19:07:41.786508305 (145h41m36.217588436s) [upload=151546]: Starting upload Aug 14 19:07:41.786586363 (145h41m36.217666494s) [upload=151546]: Done starting upload Aug 14 19:07:41.786650096 (145h41m36.217730237s) [upload=151546]: Uploading segments... Aug 14 19:07:41.786691344 (145h41m36.217771475s) [upload=151546]: Got next segment. Inline: true Aug 14 19:07:41.786695231 (145h41m36.217775353s) [upload=151546]: Waiting for error group managing segments... Aug 14 19:07:41.786736050 (145h41m36.217816181s) [upload=151546]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 19:07:41.786740278 (145h41m36.217820409s) [upload=151546]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 19:07:41.786742793 (145h41m36.217822924s) [upload=151546]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 19:07:42.077859232 (145h41m36.508939363s) [upload=151546]: Done uploading segments... Aug 14 19:07:42.077877176 (145h41m36.508957307s) [upload=151546]: Upload finished. err: <nil> Duration:* 2.219241038s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [....................................X....X..................] duration: 6.222133174s FAIL (2025-08-14 19:34:19 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 19:21:49.307741637 (145h55m43.738821768s) [upload=151794]: Starting upload Aug 14 19:21:49.307822251 (145h55m43.738902382s) [upload=151794]: Done starting upload Aug 14 19:21:49.307927863 (145h55m43.739007994s) [upload=151794]: Uploading segments... Aug 14 19:21:49.308065827 (145h55m43.739145958s) [upload=151794]: Got next segment. Inline: false Aug 14 19:21:49.308095183 (145h55m43.739175304s) [upload=151794]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 19:21:49.308099662 (145h55m43.739179793s) [upload=151794]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 19:21:49.522716839 (145h55m43.95379696s) [upload=151794]: Next segment err: metaclient: Too Many Requests Aug 14 19:21:49.522736748 (145h55m43.953816879s) [upload=151794]: Done uploading segments... Aug 14 19:21:49.522755343 (145h55m43.953835474s) [upload=151794]: Upload finished. err: metaclient: Too Many Requests Duration: 6.222159263s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....................................X....X.................] duration: 5.859878106s FAIL (2025-08-14 19:33:55 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 19:21:49.307741637 (145h55m43.738821768s) [upload=151794]: Starting upload Aug 14 19:21:49.307822251 (145h55m43.738902382s) [upload=151794]: Done starting upload Aug 14 19:21:49.307927863 (145h55m43.739007994s) [upload=151794]: Uploading segments... Aug 14 19:21:49.308065827 (145h55m43.739145958s) [upload=151794]: Got next segment. Inline: false Aug 14 19:21:49.308095183 (145h55m43.739175304s) [upload=151794]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 19:21:49.308099662 (145h55m43.739179793s) [upload=151794]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 19:21:49.522716839 (145h55m43.95379696s) [upload=151794]: Next segment err: metaclient: Too Many Requests Aug 14 19:21:49.522736748 (145h55m43.953816879s) [upload=151794]: Done uploading segments... Aug 14 19:21:49.522755343 (145h55m43.953835474s) [upload=151794]: Upload finished. err: metaclient: Too Many Requests Duration: 5.859908394s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [X......................X....................................] duration: 2.044593957s FAIL (2025-08-14 19:33:31 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 14 19:07:41.786508305 (145h41m36.217588436s) [upload=151546]: Starting upload Aug 14 19:07:41.786586363 (145h41m36.217666494s) [upload=151546]: Done starting upload Aug 14 19:07:41.786650096 (145h41m36.217730237s) [upload=151546]: Uploading segments... Aug 14 19:07:41.786691344 (145h41m36.217771475s) [upload=151546]: Got next segment. Inline: true Aug 14 19:07:41.786695231 (145h41m36.217775353s) [upload=151546]: Waiting for error group managing segments... Aug 14 19:07:41.786736050 (145h41m36.217816181s) [upload=151546]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 19:07:41.786740278 (145h41m36.217820409s) [upload=151546]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 19:07:41.786742793 (145h41m36.217822924s) [upload=151546]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 19:07:42.077859232 (145h41m36.508939363s) [upload=151546]: Done uploading segments... Aug 14 19:07:42.077877176 (145h41m36.508957307s) [upload=151546]: Upload finished. err: <nil> Duration:* 2.044617993s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [......................................X....X................] duration: 5.996528304s FAIL (2025-08-14 19:33:15 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 19:21:49.307741637 (145h55m43.738821768s) [upload=151794]: Starting upload Aug 14 19:21:49.307822251 (145h55m43.738902382s) [upload=151794]: Done starting upload Aug 14 19:21:49.307927863 (145h55m43.739007994s) [upload=151794]: Uploading segments... Aug 14 19:21:49.308065827 (145h55m43.739145958s) [upload=151794]: Got next segment. Inline: false Aug 14 19:21:49.308095183 (145h55m43.739175304s) [upload=151794]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 19:21:49.308099662 (145h55m43.739179793s) [upload=151794]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 19:21:49.522716839 (145h55m43.95379696s) [upload=151794]: Next segment err: metaclient: Too Many Requests Aug 14 19:21:49.522736748 (145h55m43.953816879s) [upload=151794]: Done uploading segments... Aug 14 19:21:49.522755343 (145h55m43.953835474s) [upload=151794]: Upload finished. err: metaclient: Too Many Requests Duration: 5.996555806s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [X..............] duration: 610.096587ms remote: "tcp:13.233.175.166:443" response headers: Date=Thu, 14 Aug 2025 19:23:35 GMT Content-Type=text/html Content-Length=164 X-Cluster-Name=ap-south-1-prod-hosting-red target: https://www.storj.io/dcs-satellites FAIL (2025-08-14 19:32:55 UTC) orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n" Duration: 610.121144ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [.X.............] duration: 622.196044ms remote: "tcp:13.233.175.166:443" response headers: Date=Thu, 14 Aug 2025 19:23:35 GMT Content-Type=text/html Content-Length=164 X-Cluster-Name=ap-south-1-prod-hosting-red target: https://www.storj.io/dcs-satellites FAIL (2025-08-14 19:32:36 UTC) orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n" Duration: 622.222665ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.X......................X...................................] duration: 2.055331843s FAIL (2025-08-14 19:32:35 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 14 19:07:41.786508305 (145h41m36.217588436s) [upload=151546]: Starting upload Aug 14 19:07:41.786586363 (145h41m36.217666494s) [upload=151546]: Done starting upload Aug 14 19:07:41.786650096 (145h41m36.217730237s) [upload=151546]: Uploading segments... Aug 14 19:07:41.786691344 (145h41m36.217771475s) [upload=151546]: Got next segment. Inline: true Aug 14 19:07:41.786695231 (145h41m36.217775353s) [upload=151546]: Waiting for error group managing segments... Aug 14 19:07:41.786736050 (145h41m36.217816181s) [upload=151546]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 19:07:41.786740278 (145h41m36.217820409s) [upload=151546]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 19:07:41.786742793 (145h41m36.217822924s) [upload=151546]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 19:07:42.077859232 (145h41m36.508939363s) [upload=151546]: Done uploading segments... Aug 14 19:07:42.077877176 (145h41m36.508957307s) [upload=151546]: Upload finished. err: <nil> Duration:* 2.055350458s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......................................X....X...............] duration: 6.158777358s FAIL (2025-08-14 19:32:08 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 19:21:49.307741637 (145h55m43.738821768s) [upload=151794]: Starting upload Aug 14 19:21:49.307822251 (145h55m43.738902382s) [upload=151794]: Done starting upload Aug 14 19:21:49.307927863 (145h55m43.739007994s) [upload=151794]: Uploading segments... Aug 14 19:21:49.308065827 (145h55m43.739145958s) [upload=151794]: Got next segment. Inline: false Aug 14 19:21:49.308095183 (145h55m43.739175304s) [upload=151794]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 19:21:49.308099662 (145h55m43.739179793s) [upload=151794]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 19:21:49.522716839 (145h55m43.95379696s) [upload=151794]: Next segment err: metaclient: Too Many Requests Aug 14 19:21:49.522736748 (145h55m43.953816879s) [upload=151794]: Done uploading segments... Aug 14 19:21:49.522755343 (145h55m43.953835474s) [upload=151794]: Upload finished. err: metaclient: Too Many Requests Duration: 6.158795494s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [..X............] duration: 1.306441741s remote: "tcp:13.233.175.166:443" response headers: Date=Thu, 14 Aug 2025 19:23:35 GMT Content-Type=text/html Content-Length=164 X-Cluster-Name=ap-south-1-prod-hosting-red target: https://www.storj.io/dcs-satellites FAIL (2025-08-14 19:32:07 UTC) orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n" Duration: 1.306466328s core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [X.......................................X....X..............] duration: 6.005986378s FAIL (2025-08-14 19:31:37 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 19:21:49.307741637 (145h55m43.738821768s) [upload=151794]: Starting upload Aug 14 19:21:49.307822251 (145h55m43.738902382s) [upload=151794]: Done starting upload Aug 14 19:21:49.307927863 (145h55m43.739007994s) [upload=151794]: Uploading segments... Aug 14 19:21:49.308065827 (145h55m43.739145958s) [upload=151794]: Got next segment. Inline: false Aug 14 19:21:49.308095183 (145h55m43.739175304s) [upload=151794]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 19:21:49.308099662 (145h55m43.739179793s) [upload=151794]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 19:21:49.522716839 (145h55m43.95379696s) [upload=151794]: Next segment err: metaclient: Too Many Requests Aug 14 19:21:49.522736748 (145h55m43.953816879s) [upload=151794]: Done uploading segments... Aug 14 19:21:49.522755343 (145h55m43.953835474s) [upload=151794]: Upload finished. err: metaclient: Too Many Requests Duration: 6.006011918s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..X......................X..................................] duration: 2.243324878s FAIL (2025-08-14 19:31:22 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 14 19:07:41.786508305 (145h41m36.217588436s) [upload=151546]: Starting upload Aug 14 19:07:41.786586363 (145h41m36.217666494s) [upload=151546]: Done starting upload Aug 14 19:07:41.786650096 (145h41m36.217730237s) [upload=151546]: Uploading segments... Aug 14 19:07:41.786691344 (145h41m36.217771475s) [upload=151546]: Got next segment. Inline: true Aug 14 19:07:41.786695231 (145h41m36.217775353s) [upload=151546]: Waiting for error group managing segments... Aug 14 19:07:41.786736050 (145h41m36.217816181s) [upload=151546]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 19:07:41.786740278 (145h41m36.217820409s) [upload=151546]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 19:07:41.786742793 (145h41m36.217822924s) [upload=151546]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 19:07:42.077859232 (145h41m36.508939363s) [upload=151546]: Done uploading segments... Aug 14 19:07:42.077877176 (145h41m36.508957307s) [upload=151546]: Upload finished. err: <nil> Duration:* 2.243344095s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.X.......................................X....X.............] duration: 5.889168001s FAIL (2025-08-14 19:31:21 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 19:21:49.307741637 (145h55m43.738821768s) [upload=151794]: Starting upload Aug 14 19:21:49.307822251 (145h55m43.738902382s) [upload=151794]: Done starting upload Aug 14 19:21:49.307927863 (145h55m43.739007994s) [upload=151794]: Uploading segments... Aug 14 19:21:49.308065827 (145h55m43.739145958s) [upload=151794]: Got next segment. Inline: false Aug 14 19:21:49.308095183 (145h55m43.739175304s) [upload=151794]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 19:21:49.308099662 (145h55m43.739179793s) [upload=151794]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 19:21:49.522716839 (145h55m43.95379696s) [upload=151794]: Next segment err: metaclient: Too Many Requests Aug 14 19:21:49.522736748 (145h55m43.953816879s) [upload=151794]: Done uploading segments... Aug 14 19:21:49.522755343 (145h55m43.953835474s) [upload=151794]: Upload finished. err: metaclient: Too Many Requests Duration: 5.889192027s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [...X...........] duration: 616.538964ms remote: "tcp:13.233.175.166:443" response headers: Date=Thu, 14 Aug 2025 19:23:35 GMT Content-Type=text/html Content-Length=164 X-Cluster-Name=ap-south-1-prod-hosting-red target: https://www.storj.io/dcs-satellites FAIL (2025-08-14 19:31:10 UTC) orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n" Duration: 616.555045ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...X......................X.................................] duration: 1.979788298s FAIL (2025-08-14 19:31:02 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 14 19:07:41.786508305 (145h41m36.217588436s) [upload=151546]: Starting upload Aug 14 19:07:41.786586363 (145h41m36.217666494s) [upload=151546]: Done starting upload Aug 14 19:07:41.786650096 (145h41m36.217730237s) [upload=151546]: Uploading segments... Aug 14 19:07:41.786691344 (145h41m36.217771475s) [upload=151546]: Got next segment. Inline: true Aug 14 19:07:41.786695231 (145h41m36.217775353s) [upload=151546]: Waiting for error group managing segments... Aug 14 19:07:41.786736050 (145h41m36.217816181s) [upload=151546]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 19:07:41.786740278 (145h41m36.217820409s) [upload=151546]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 19:07:41.786742793 (145h41m36.217822924s) [upload=151546]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 19:07:42.077859232 (145h41m36.508939363s) [upload=151546]: Done uploading segments... Aug 14 19:07:42.077877176 (145h41m36.508957307s) [upload=151546]: Upload finished. err: <nil> Duration:* 1.979812446s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..X.......................................X....X............] duration: 5.827788252s FAIL (2025-08-14 19:30:56 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 19:21:49.307741637 (145h55m43.738821768s) [upload=151794]: Starting upload Aug 14 19:21:49.307822251 (145h55m43.738902382s) [upload=151794]: Done starting upload Aug 14 19:21:49.307927863 (145h55m43.739007994s) [upload=151794]: Uploading segments... Aug 14 19:21:49.308065827 (145h55m43.739145958s) [upload=151794]: Got next segment. Inline: false Aug 14 19:21:49.308095183 (145h55m43.739175304s) [upload=151794]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 19:21:49.308099662 (145h55m43.739179793s) [upload=151794]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 19:21:49.522716839 (145h55m43.95379696s) [upload=151794]: Next segment err: metaclient: Too Many Requests Aug 14 19:21:49.522736748 (145h55m43.953816879s) [upload=151794]: Done uploading segments... Aug 14 19:21:49.522755343 (145h55m43.953835474s) [upload=151794]: Upload finished. err: metaclient: Too Many Requests Duration: 5.827814893s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [....X..........] duration: 609.987376ms remote: "tcp:13.233.175.166:443" response headers: Date=Thu, 14 Aug 2025 19:23:35 GMT Content-Type=text/html Content-Length=164 X-Cluster-Name=ap-south-1-prod-hosting-red target: https://www.storj.io/dcs-satellites FAIL (2025-08-14 19:30:52 UTC) orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n" Duration: 610.012455ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...X.......................................X....X...........] duration: 5.891357948s FAIL (2025-08-14 19:30:39 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 19:21:49.307741637 (145h55m43.738821768s) [upload=151794]: Starting upload Aug 14 19:21:49.307822251 (145h55m43.738902382s) [upload=151794]: Done starting upload Aug 14 19:21:49.307927863 (145h55m43.739007994s) [upload=151794]: Uploading segments... Aug 14 19:21:49.308065827 (145h55m43.739145958s) [upload=151794]: Got next segment. Inline: false Aug 14 19:21:49.308095183 (145h55m43.739175304s) [upload=151794]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 19:21:49.308099662 (145h55m43.739179793s) [upload=151794]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 19:21:49.522716839 (145h55m43.95379696s) [upload=151794]: Next segment err: metaclient: Too Many Requests Aug 14 19:21:49.522736748 (145h55m43.953816879s) [upload=151794]: Done uploading segments... Aug 14 19:21:49.522755343 (145h55m43.953835474s) [upload=151794]: Upload finished. err: metaclient: Too Many Requests Duration: 5.891400891s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [....X......................X................................] duration: 2.204502047s FAIL (2025-08-14 19:30:21 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 14 19:07:41.786508305 (145h41m36.217588436s) [upload=151546]: Starting upload Aug 14 19:07:41.786586363 (145h41m36.217666494s) [upload=151546]: Done starting upload Aug 14 19:07:41.786650096 (145h41m36.217730237s) [upload=151546]: Uploading segments... Aug 14 19:07:41.786691344 (145h41m36.217771475s) [upload=151546]: Got next segment. Inline: true Aug 14 19:07:41.786695231 (145h41m36.217775353s) [upload=151546]: Waiting for error group managing segments... Aug 14 19:07:41.786736050 (145h41m36.217816181s) [upload=151546]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 19:07:41.786740278 (145h41m36.217820409s) [upload=151546]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 19:07:41.786742793 (145h41m36.217822924s) [upload=151546]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 19:07:42.077859232 (145h41m36.508939363s) [upload=151546]: Done uploading segments... Aug 14 19:07:42.077877176 (145h41m36.508957307s) [upload=151546]: Upload finished. err: <nil> Duration:* 2.20452943s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [....X.......................................X....X..........] duration: 5.777028226s FAIL (2025-08-14 19:29:59 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 19:21:49.307741637 (145h55m43.738821768s) [upload=151794]: Starting upload Aug 14 19:21:49.307822251 (145h55m43.738902382s) [upload=151794]: Done starting upload Aug 14 19:21:49.307927863 (145h55m43.739007994s) [upload=151794]: Uploading segments... Aug 14 19:21:49.308065827 (145h55m43.739145958s) [upload=151794]: Got next segment. Inline: false Aug 14 19:21:49.308095183 (145h55m43.739175304s) [upload=151794]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 19:21:49.308099662 (145h55m43.739179793s) [upload=151794]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 19:21:49.522716839 (145h55m43.95379696s) [upload=151794]: Next segment err: metaclient: Too Many Requests Aug 14 19:21:49.522736748 (145h55m43.953816879s) [upload=151794]: Done uploading segments... Aug 14 19:21:49.522755343 (145h55m43.953835474s) [upload=151794]: Upload finished. err: metaclient: Too Many Requests Duration: 5.777052834s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.....X......................X...............................] duration: 1.969424469s FAIL (2025-08-14 19:29:39 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 14 19:07:41.786508305 (145h41m36.217588436s) [upload=151546]: Starting upload Aug 14 19:07:41.786586363 (145h41m36.217666494s) [upload=151546]: Done starting upload Aug 14 19:07:41.786650096 (145h41m36.217730237s) [upload=151546]: Uploading segments... Aug 14 19:07:41.786691344 (145h41m36.217771475s) [upload=151546]: Got next segment. Inline: true Aug 14 19:07:41.786695231 (145h41m36.217775353s) [upload=151546]: Waiting for error group managing segments... Aug 14 19:07:41.786736050 (145h41m36.217816181s) [upload=151546]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 19:07:41.786740278 (145h41m36.217820409s) [upload=151546]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 19:07:41.786742793 (145h41m36.217822924s) [upload=151546]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 19:07:42.077859232 (145h41m36.508939363s) [upload=151546]: Done uploading segments... Aug 14 19:07:42.077877176 (145h41m36.508957307s) [upload=151546]: Upload finished. err: <nil> Duration:* 1.969455067s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [.....X.........] duration: 837.650297ms remote: "tcp:13.233.175.166:443" response headers: Date=Thu, 14 Aug 2025 19:23:35 GMT Content-Type=text/html Content-Length=164 X-Cluster-Name=ap-south-1-prod-hosting-red target: https://www.storj.io/dcs-satellites FAIL (2025-08-14 19:29:39 UTC) orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n" Duration: 837.672188ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.....X.......................................X....X.........] duration: 5.944496264s FAIL (2025-08-14 19:29:07 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 19:21:49.307741637 (145h55m43.738821768s) [upload=151794]: Starting upload Aug 14 19:21:49.307822251 (145h55m43.738902382s) [upload=151794]: Done starting upload Aug 14 19:21:49.307927863 (145h55m43.739007994s) [upload=151794]: Uploading segments... Aug 14 19:21:49.308065827 (145h55m43.739145958s) [upload=151794]: Got next segment. Inline: false Aug 14 19:21:49.308095183 (145h55m43.739175304s) [upload=151794]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 19:21:49.308099662 (145h55m43.739179793s) [upload=151794]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 19:21:49.522716839 (145h55m43.95379696s) [upload=151794]: Next segment err: metaclient: Too Many Requests Aug 14 19:21:49.522736748 (145h55m43.953816879s) [upload=151794]: Done uploading segments... Aug 14 19:21:49.522755343 (145h55m43.953835474s) [upload=151794]: Upload finished. err: metaclient: Too Many Requests Duration: 5.944521663s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [......X......................X..............................] duration: 2.292819783s FAIL (2025-08-14 19:29:06 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 14 19:07:41.786508305 (145h41m36.217588436s) [upload=151546]: Starting upload Aug 14 19:07:41.786586363 (145h41m36.217666494s) [upload=151546]: Done starting upload Aug 14 19:07:41.786650096 (145h41m36.217730237s) [upload=151546]: Uploading segments... Aug 14 19:07:41.786691344 (145h41m36.217771475s) [upload=151546]: Got next segment. Inline: true Aug 14 19:07:41.786695231 (145h41m36.217775353s) [upload=151546]: Waiting for error group managing segments... Aug 14 19:07:41.786736050 (145h41m36.217816181s) [upload=151546]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 19:07:41.786740278 (145h41m36.217820409s) [upload=151546]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 19:07:41.786742793 (145h41m36.217822924s) [upload=151546]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 19:07:42.077859232 (145h41m36.508939363s) [upload=151546]: Done uploading segments... Aug 14 19:07:42.077877176 (145h41m36.508957307s) [upload=151546]: Upload finished. err: <nil> Duration:* 2.292844489s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [......X........] duration: 1.360088968s remote: "tcp:13.233.175.166:443" response headers: Date=Thu, 14 Aug 2025 19:23:35 GMT Content-Type=text/html Content-Length=164 X-Cluster-Name=ap-south-1-prod-hosting-red target: https://www.storj.io/dcs-satellites FAIL (2025-08-14 19:28:49 UTC) orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n" Duration: 1.360111771s core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [......X.......................................X....X........] duration: 20.630888128s FAIL (2025-08-14 19:28:46 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 19:21:49.307741637 (145h55m43.738821768s) [upload=151794]: Starting upload Aug 14 19:21:49.307822251 (145h55m43.738902382s) [upload=151794]: Done starting upload Aug 14 19:21:49.307927863 (145h55m43.739007994s) [upload=151794]: Uploading segments... Aug 14 19:21:49.308065827 (145h55m43.739145958s) [upload=151794]: Got next segment. Inline: false Aug 14 19:21:49.308095183 (145h55m43.739175304s) [upload=151794]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 19:21:49.308099662 (145h55m43.739179793s) [upload=151794]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 19:21:49.522716839 (145h55m43.95379696s) [upload=151794]: Next segment err: metaclient: Too Many Requests Aug 14 19:21:49.522736748 (145h55m43.953816879s) [upload=151794]: Done uploading segments... Aug 14 19:21:49.522755343 (145h55m43.953835474s) [upload=151794]: Upload finished. err: metaclient: Too Many Requests Duration: 20.63091507s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.......X......................X.............................] duration: 12.188528858s FAIL (2025-08-14 19:28:39 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 14 19:07:41.786508305 (145h41m36.217588436s) [upload=151546]: Starting upload Aug 14 19:07:41.786586363 (145h41m36.217666494s) [upload=151546]: Done starting upload Aug 14 19:07:41.786650096 (145h41m36.217730237s) [upload=151546]: Uploading segments... Aug 14 19:07:41.786691344 (145h41m36.217771475s) [upload=151546]: Got next segment. Inline: true Aug 14 19:07:41.786695231 (145h41m36.217775353s) [upload=151546]: Waiting for error group managing segments... Aug 14 19:07:41.786736050 (145h41m36.217816181s) [upload=151546]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 19:07:41.786740278 (145h41m36.217820409s) [upload=151546]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 19:07:41.786742793 (145h41m36.217822924s) [upload=151546]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 19:07:42.077859232 (145h41m36.508939363s) [upload=151546]: Done uploading segments... Aug 14 19:07:42.077877176 (145h41m36.508957307s) [upload=151546]: Upload finished. err: <nil> Duration:* 12.188552141s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.......X.......................................X....X.......] duration: 5.807835168s FAIL (2025-08-14 19:27:54 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 19:21:49.307741637 (145h55m43.738821768s) [upload=151794]: Starting upload Aug 14 19:21:49.307822251 (145h55m43.738902382s) [upload=151794]: Done starting upload Aug 14 19:21:49.307927863 (145h55m43.739007994s) [upload=151794]: Uploading segments... Aug 14 19:21:49.308065827 (145h55m43.739145958s) [upload=151794]: Got next segment. Inline: false Aug 14 19:21:49.308095183 (145h55m43.739175304s) [upload=151794]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 19:21:49.308099662 (145h55m43.739179793s) [upload=151794]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 19:21:49.522716839 (145h55m43.95379696s) [upload=151794]: Next segment err: metaclient: Too Many Requests Aug 14 19:21:49.522736748 (145h55m43.953816879s) [upload=151794]: Done uploading segments... Aug 14 19:21:49.522755343 (145h55m43.953835474s) [upload=151794]: Upload finished. err: metaclient: Too Many Requests Duration: 5.807852581s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [.......X.......] duration: 629.53965ms remote: "tcp:13.233.175.166:443" response headers: Date=Thu, 14 Aug 2025 19:23:35 GMT Content-Type=text/html Content-Length=164 X-Cluster-Name=ap-south-1-prod-hosting-red target: https://www.storj.io/dcs-satellites FAIL (2025-08-14 19:27:44 UTC) orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n" Duration: 629.56607ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [........X......................X............................] duration: 1.986437031s FAIL (2025-08-14 19:27:41 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 14 19:07:41.786508305 (145h41m36.217588436s) [upload=151546]: Starting upload Aug 14 19:07:41.786586363 (145h41m36.217666494s) [upload=151546]: Done starting upload Aug 14 19:07:41.786650096 (145h41m36.217730237s) [upload=151546]: Uploading segments... Aug 14 19:07:41.786691344 (145h41m36.217771475s) [upload=151546]: Got next segment. Inline: true Aug 14 19:07:41.786695231 (145h41m36.217775353s) [upload=151546]: Waiting for error group managing segments... Aug 14 19:07:41.786736050 (145h41m36.217816181s) [upload=151546]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 19:07:41.786740278 (145h41m36.217820409s) [upload=151546]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 19:07:41.786742793 (145h41m36.217822924s) [upload=151546]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 19:07:42.077859232 (145h41m36.508939363s) [upload=151546]: Done uploading segments... Aug 14 19:07:42.077877176 (145h41m36.508957307s) [upload=151546]: Upload finished. err: <nil> Duration:* 1.98646296s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.........X......................X...........................] duration: 1.919396896s FAIL (2025-08-14 19:27:19 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 14 19:07:41.786508305 (145h41m36.217588436s) [upload=151546]: Starting upload Aug 14 19:07:41.786586363 (145h41m36.217666494s) [upload=151546]: Done starting upload Aug 14 19:07:41.786650096 (145h41m36.217730237s) [upload=151546]: Uploading segments... Aug 14 19:07:41.786691344 (145h41m36.217771475s) [upload=151546]: Got next segment. Inline: true Aug 14 19:07:41.786695231 (145h41m36.217775353s) [upload=151546]: Waiting for error group managing segments... Aug 14 19:07:41.786736050 (145h41m36.217816181s) [upload=151546]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 19:07:41.786740278 (145h41m36.217820409s) [upload=151546]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 19:07:41.786742793 (145h41m36.217822924s) [upload=151546]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 19:07:42.077859232 (145h41m36.508939363s) [upload=151546]: Done uploading segments... Aug 14 19:07:42.077877176 (145h41m36.508957307s) [upload=151546]: Upload finished. err: <nil> Duration:* 1.919422957s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [........X.......................................X....X......] duration: 5.919176948s FAIL (2025-08-14 19:27:13 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 19:21:49.307741637 (145h55m43.738821768s) [upload=151794]: Starting upload Aug 14 19:21:49.307822251 (145h55m43.738902382s) [upload=151794]: Done starting upload Aug 14 19:21:49.307927863 (145h55m43.739007994s) [upload=151794]: Uploading segments... Aug 14 19:21:49.308065827 (145h55m43.739145958s) [upload=151794]: Got next segment. Inline: false Aug 14 19:21:49.308095183 (145h55m43.739175304s) [upload=151794]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 19:21:49.308099662 (145h55m43.739179793s) [upload=151794]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 19:21:49.522716839 (145h55m43.95379696s) [upload=151794]: Next segment err: metaclient: Too Many Requests Aug 14 19:21:49.522736748 (145h55m43.953816879s) [upload=151794]: Done uploading segments... Aug 14 19:21:49.522755343 (145h55m43.953835474s) [upload=151794]: Upload finished. err: metaclient: Too Many Requests Duration: 5.919203017s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [........X......] duration: 621.855977ms remote: "tcp:13.233.175.166:443" response headers: Date=Thu, 14 Aug 2025 19:23:35 GMT Content-Type=text/html Content-Length=164 X-Cluster-Name=ap-south-1-prod-hosting-red target: https://www.storj.io/dcs-satellites FAIL (2025-08-14 19:26:58 UTC) orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n" Duration: 621.880704ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [.........X.....] duration: 611.380244ms remote: "tcp:13.233.175.166:443" response headers: Date=Thu, 14 Aug 2025 19:23:35 GMT Content-Type=text/html Content-Length=164 X-Cluster-Name=ap-south-1-prod-hosting-red target: https://www.storj.io/dcs-satellites FAIL (2025-08-14 19:26:31 UTC) orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n" Duration: 611.428205ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.........X.......................................X....X.....] duration: 5.593630133s FAIL (2025-08-14 19:26:24 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 19:21:49.307741637 (145h55m43.738821768s) [upload=151794]: Starting upload Aug 14 19:21:49.307822251 (145h55m43.738902382s) [upload=151794]: Done starting upload Aug 14 19:21:49.307927863 (145h55m43.739007994s) [upload=151794]: Uploading segments... Aug 14 19:21:49.308065827 (145h55m43.739145958s) [upload=151794]: Got next segment. Inline: false Aug 14 19:21:49.308095183 (145h55m43.739175304s) [upload=151794]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 19:21:49.308099662 (145h55m43.739179793s) [upload=151794]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 19:21:49.522716839 (145h55m43.95379696s) [upload=151794]: Next segment err: metaclient: Too Many Requests Aug 14 19:21:49.522736748 (145h55m43.953816879s) [upload=151794]: Done uploading segments... Aug 14 19:21:49.522755343 (145h55m43.953835474s) [upload=151794]: Upload finished. err: metaclient: Too Many Requests Duration: 5.593656384s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..........X......................X..........................] duration: 1.836773785s FAIL (2025-08-14 19:26:13 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 14 19:07:41.786508305 (145h41m36.217588436s) [upload=151546]: Starting upload Aug 14 19:07:41.786586363 (145h41m36.217666494s) [upload=151546]: Done starting upload Aug 14 19:07:41.786650096 (145h41m36.217730237s) [upload=151546]: Uploading segments... Aug 14 19:07:41.786691344 (145h41m36.217771475s) [upload=151546]: Got next segment. Inline: true Aug 14 19:07:41.786695231 (145h41m36.217775353s) [upload=151546]: Waiting for error group managing segments... Aug 14 19:07:41.786736050 (145h41m36.217816181s) [upload=151546]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 19:07:41.786740278 (145h41m36.217820409s) [upload=151546]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 19:07:41.786742793 (145h41m36.217822924s) [upload=151546]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 19:07:42.077859232 (145h41m36.508939363s) [upload=151546]: Done uploading segments... Aug 14 19:07:42.077877176 (145h41m36.508957307s) [upload=151546]: Upload finished. err: <nil> Duration:* 1.836793411s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [..........X....] duration: 845.635244ms remote: "tcp:13.233.175.166:443" response headers: Date=Thu, 14 Aug 2025 19:23:35 GMT Content-Type=text/html Content-Length=164 X-Cluster-Name=ap-south-1-prod-hosting-red target: https://www.storj.io/dcs-satellites FAIL (2025-08-14 19:26:03 UTC) orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n" Duration: 845.691471ms core website

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)