Orbiter History

Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure

Orbiter Check History

Showing 50 of 482596 reports (Page 5795 of 9652)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 43 out of 60 is failed (threshold=3) [X.......X.X.XXX.XX..XX.X.XX..X.XXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 30.002805043s FAIL (2025-09-09 15:44:45 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 15:44:16.698475235 (74h15m52.738048355s) [upload=65343]: Starting upload Sep 9 15:44:16.698565327 (74h15m52.738138457s) [upload=65343]: Done starting upload Sep 9 15:44:16.698630913 (74h15m52.738204033s) [upload=65343]: Uploading segments... Sep 9 15:44:16.698845754 (74h15m52.738418874s) [upload=65343]: Got next segment. Inline: false Sep 9 15:44:16.698874730 (74h15m52.73844785s) [upload=65343]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 15:44:16.698880070 (74h15m52.73845319s) [upload=65343]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 15:44:17.249401604 (74h15m53.288974724s) [seg_pos={0 0}, upload=65343]: Begin upload segment... Sep 9 15:44:17.249457211 (74h15m53.289030341s) [seg_pos={0 0}, upload=65343]: Done begin upload segment. Sep 9 15:44:17.249484182 (74h15m53.289057302s) [noise=true , address=77.90.31.13:4626 , piece_id=QZQ3MCSL7KYI5J3MNK23WL2EHAG7JZN6ERJFYZMZ4MBEXL7SO7AQ, seg_pos={0 0}, upload=65343]: Uploading piece... Sep 9 15:44:17.249535119 (74h15m53.289108239s) [noise=true , address=45.91.116.8:4048 , piece_id=SDAPL6V4BS3US44M2ZL2D7CPVK3HGFS6G6KO4CPK7IAVWQ7FZX7Q, seg_pos={0 0}, upload=65343]: Uploading piece... Sep 9 15:44:17.249945074 (74h15m53.289518194s) [noise=true , address=77.90.31.16:4734 , piece_id=BI3LLL37IDPMFSHUYQJBZRAJZHWCLEIAJXC7LPXAFC66K5EBVXEQ, seg_pos={0 0}, upload=65343]: Uploading piece... Sep 9 15:44:17.250057069 (74h15m53.289630189s) [noise=true , address=45.91.116.5:4299 , piece_id=E53XMXZ7Z4PYUDBJTIXP73PSQO6PK2TPHQYO2WSBJ3XDYWEWJEFQ, seg_pos={0 0}, upload=65343]: Uploading piece... Sep 9 15:44:17.250271899 (74h15m53.289845029s) [noise=true , address=45.91.116.14:4189 , piece_id=IDFRJD4QTU3KNHSDFW432ZFAX2LKILDRSIHSNHNTYZNG7PUODNRQ, seg_pos={0 0}, upload=65343]: Uploading piece... Sep 9 15:44:17.250374265 (74h15m53.289947385s) [noise=true , address=145.79.227.19:4078 , piece_id=O3FF5FOJS77JXDLE7BWBL7PPE2CALSQP6A2LEZVXKU5GLWDOPVUQ, seg_pos={0 0}, upload=65343]: Uploading piece... Sep 9 15:44:17.250665483 (74h15m53.290238613s) [noise=true , address=45.91.116.4:4938 , piece_id=623BOK2GFBXPNUMAHAPILFW2FA2ND4FY5KGEE5EIWBNM3FFVRKAA, seg_pos={0 0}, upload=65343]: Uploading piece... Sep 9 15:44:17.250697844 (74h15m53.290270964s) [noise=true , address=45.91.116.11:4119 , piece_id=3G7EKLEXWUD5GFDNF23OYMNYTEHGWUK3574PDSZII5DSBVQQHMIQ, seg_pos={0 0}, upload=65343]: Uploading piece... Sep 9 15:44:17.251012848 (74h15m53.290585968s) [noise=true , address=145.79.227.19:4079 , piece_id=SOCWECLJIDYBX5A7NKIKCJ67ZHJP7CI2ESE6WZSKH2MOAYSUTGRA, seg_pos={0 0}, upload=65343]: Uploading piece... Sep 9 15:44:17.251026984 (74h15m53.290600104s) [noise=true , address=45.91.116.12:4227 , piece_id=E6FUCJCCHQZSF2SI4QECBPPZA5JYIUXFIMSNL5TMCYCDY54272LQ, seg_pos={0 0}, upload=65343]: Uploading piece... Sep 9 15:44:17.251367065 (74h15m53.290940185s) [noise=true , address=45.91.116.14:4191 , piece_id=IHCL4RVR72G34KNQOO7QXFBEKKA2GZ56KIV6VPFWRBJKMGYXYS5A, seg_pos={0 0}, upload=65343]: Uploading piece... Sep 9 15:44:17.251718467 (74h15m53.291291597s) [noise=true , address=77.90.31.17:4771 , piece_id=BDFSREGZBYGH5CQ533QPGOYF44IHYNELUMB2D5BXVFBOPBE7UKMA, seg_pos={0 0}, upload=65343]: Uploading piece... Sep 9 15:44:17.252083777 (74h15m53.291656897s) [noise=true , address=145.79.227.16:4911 , piece_id=XXT7IQ5DX7U7OPUXT437JCKO7MZPJQ7PRLAVU3Q7H4EA5CIHPNFQ, seg_pos={0 0}, upload=65343]: Uploading piece... Sep 9 15:44:17.252443605 (74h15m53.292016735s) [noise=true , address=45.91.116.6:4973 , piece_id=KIDSCLLB5L4M6RVSHPKH34PONH3IWAFFLKE67FUPTMKUMEVVM6DQ, seg_pos={0 0}, upload=65343]: Uploading piece... Sep 9 15:44:17.252789417 (74h15m53.292362547s) [noise=true , address=45.91.116.8:4045 , piece_id=G4P72FYI6QQALHO6KJWACYOOON6YDZ3BJ6ZS2P5BAKAMBZTPX3IQ, seg_pos={0 0}, upload=65343]: Uploading piece... Sep 9 15:44:17.253203980 (74h15m53.29277711s) [noise=true , address=77.90.31.18:4807 , piece_id=3QFK3I6M7SD65QGVTHZHUUBRGZAWDISDPOQUN2O63RZEOTXKNE3A, seg_pos={0 0}, upload=65343]: Uploading piece... Sep 9 15:44:19.009097926 (74h15m55.048671046s) [upload=65343]: Next returned nil segment Sep 9 15:44:19.009114367 (74h15m55.048687487s) [upload=65343]: Waiting for error group managing segments... Sep 9 15:44:19.438618333 (74h15m55.478191453s) [noise=true , address=45.91.116.6:4973 , piece_id=KIDSCLLB5L4M6RVSHPKH34PONH3IWAFFLKE67FUPTMKUMEVVM6DQ, seg_pos={0 0}, upload=65343]: Done uploading piece. err: <nil> Sep 9 15:44:19.452959556 (74h15m55.492532676s) [noise=true , address=45.91.116.11:4119 , piece_id=3G7EKLEXWUD5GFDNF23OYMNYTEHGWUK3574PDSZII5DSBVQQHMIQ, seg_pos={0 0}, upload=65343]: Done uploading piece. err: <nil> Sep 9 15:44:19.478647653 (74h15m55.518220773s) [noise=true , address=45.91.116.14:4191 , piece_id=IHCL4RVR72G34KNQOO7QXFBEKKA2GZ56KIV6VPFWRBJKMGYXYS5A, seg_pos={0 0}, upload=65343]: Done uploading piece. err: <nil> Sep 9 15:44:19.509293576 (74h15m55.548866696s) [noise=true , address=45.91.116.4:4938 , piece_id=623BOK2GFBXPNUMAHAPILFW2FA2ND4FY5KGEE5EIWBNM3FFVRKAA, seg_pos={0 0}, upload=65343]: Done uploading piece. err: <nil> Sep 9 15:44:19.524180915 (74h15m55.563754035s) [noise=true , address=45.91.116.12:4227 , piece_id=E6FUCJCCHQZSF2SI4QECBPPZA5JYIUXFIMSNL5TMCYCDY54272LQ, seg_pos={0 0}, upload=65343]: Done uploading piece. err: <nil> Sep 9 15:44:19.540261467 (74h15m55.579834587s) [noise=true , address=45.91.116.8:4045 , piece_id=G4P72FYI6QQALHO6KJWACYOOON6YDZ3BJ6ZS2P5BAKAMBZTPX3IQ, seg_pos={0 0}, upload=65343]: Done uploading piece. err: <nil> Sep 9 15:44:19.590589354 (74h15m55.630162474s) [noise=true , address=145.79.227.19:4078 , piece_id=O3FF5FOJS77JXDLE7BWBL7PPE2CALSQP6A2LEZVXKU5GLWDOPVUQ, seg_pos={0 0}, upload=65343]: Done uploading piece. err: <nil> Sep 9 15:44:19.610227493 (74h15m55.649800613s) [noise=true , address=77.90.31.18:4807 , piece_id=3QFK3I6M7SD65QGVTHZHUUBRGZAWDISDPOQUN2O63RZEOTXKNE3A, seg_pos={0 0}, upload=65343]: Done uploading piece. err: <nil> Sep 9 15:44:19.628580443 (74h15m55.668153563s) [noise=true , address=77.90.31.17:4771 , piece_id=BDFSREGZBYGH5CQ533QPGOYF44IHYNELUMB2D5BXVFBOPBE7UKMA, seg_pos={0 0}, upload=65343]: Done uploading piece. err: <nil> Sep 9 15:44:19.636405056 (74h15m55.675978176s) [noise=true , address=45.91.116.8:4048 , piece_id=SDAPL6V4BS3US44M2ZL2D7CPVK3HGFS6G6KO4CPK7IAVWQ7FZX7Q, seg_pos={0 0}, upload=65343]: Done uploading piece. err: <nil> Sep 9 15:44:19.672994193 (74h15m55.712567313s) [noise=true , address=77.90.31.13:4626 , piece_id=QZQ3MCSL7KYI5J3MNK23WL2EHAG7JZN6ERJFYZMZ4MBEXL7SO7AQ, seg_pos={0 0}, upload=65343]: Done uploading piece. err: <nil> Sep 9 15:44:19.739997881 (74h15m55.779570991s) [noise=true , address=77.90.31.16:4734 , piece_id=BI3LLL37IDPMFSHUYQJBZRAJZHWCLEIAJXC7LPXAFC66K5EBVXEQ, seg_pos={0 0}, upload=65343]: Done uploading piece. err: <nil> Sep 9 15:44:19.853589569 (74h15m55.893162689s) [noise=true , address=45.91.116.14:4189 , piece_id=IDFRJD4QTU3KNHSDFW432ZFAX2LKILDRSIHSNHNTYZNG7PUODNRQ, seg_pos={0 0}, upload=65343]: Done uploading piece. err: <nil> Sep 9 15:44:19.853642110 (74h15m55.89321523s) [seg_pos={0 0}, upload=65343]: Segment reached optimal threshold of 13 pieces. Sep 9 15:44:19.853743363 (74h15m55.893316473s) [noise=true , address=45.91.116.5:4299 , piece_id=E53XMXZ7Z4PYUDBJTIXP73PSQO6PK2TPHQYO2WSBJ3XDYWEWJEFQ, seg_pos={0 0}, upload=65343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF Sep 9 15:44:19.853832033 (74h15m55.893405153s) [noise=true , address=145.79.227.16:4911 , piece_id=XXT7IQ5DX7U7OPUXT437JCKO7MZPJQ7PRLAVU3Q7H4EA5CIHPNFQ, seg_pos={0 0}, upload=65343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu): protocol: expected piece hash; context canceled; EOF Sep 9 15:44:19.853867080 (74h15m55.8934402s) [noise=true , address=145.79.227.19:4079 , piece_id=SOCWECLJIDYBX5A7NKIKCJ67ZHJP7CI2ESE6WZSKH2MOAYSUTGRA, seg_pos={0 0}, upload=65343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF Sep 9 15:44:19.853908258 (74h15m55.893481378s) [seg_pos={0 0}, upload=65343]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 15:44:19.853987891 (74h15m55.893561011s) [upload=65343]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 15:44:19.853992420 (74h15m55.89356554s) [upload=65343]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 15:44:20.187584619 (74h15m56.22715773s) [upload=65343]: Done uploading segments... Sep 9 15:44:20.187605068 (74h15m56.227178178s) [upload=65343]: Upload finished. err: <nil> Duration: 30.002829882s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 2.568152657s FAIL (2025-09-09 15:44:25 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.568175239s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 8 out of 60 is failed (threshold=3) [.......XX...X.X.......X.X....X...................X..........] duration: 7.588173972s FAIL (2025-09-09 15:44:14 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.588196826s edge gateway us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 1.885305436s target: https://us1.storj.io/login FAIL (2025-09-09 15:44:04 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused Duration: 1.885333019s core satellite us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 2.582231679s FAIL (2025-09-09 15:43:50 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.582256346s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 8 out of 60 is failed (threshold=3) [........XX...X.X.......X.X....X...................X.........] duration: 7.927079414s FAIL (2025-09-09 15:43:34 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.927096216s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 43 out of 60 is failed (threshold=3) [XX.......X.X.XXX.XX..XX.X.XX..X.XXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 30.003042416s FAIL (2025-09-09 15:43:33 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 15:43:04.167835404 (74h14m40.207408524s) [upload=65327]: Starting upload Sep 9 15:43:04.167890169 (74h14m40.207463289s) [upload=65327]: Done starting upload Sep 9 15:43:04.167996492 (74h14m40.207569612s) [upload=65327]: Uploading segments... Sep 9 15:43:04.168070704 (74h14m40.207643824s) [upload=65327]: Got next segment. Inline: false Sep 9 15:43:04.168104830 (74h14m40.20767795s) [upload=65327]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 15:43:04.168109779 (74h14m40.207682899s) [upload=65327]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 15:43:04.420232900 (74h14m40.45980602s) [seg_pos={0 0}, upload=65327]: Begin upload segment... Sep 9 15:43:04.420279618 (74h14m40.459852738s) [seg_pos={0 0}, upload=65327]: Done begin upload segment. Sep 9 15:43:04.420301671 (74h14m40.459874791s) [noise=true , address=45.91.116.4:4937 , piece_id=5VE5KABF62FV3YXF6AB57IA25VMUC7OUGZRYA5DIDNETMVUX35KQ, seg_pos={0 0}, upload=65327]: Uploading piece... Sep 9 15:43:04.420306199 (74h14m40.459879319s) [noise=true , address=45.91.116.9:4262 , piece_id=M45XJNY6CX3F34FEKD4U6H44MGPYO24TTPA7MHY5MOWFJBICMWPA, seg_pos={0 0}, upload=65327]: Uploading piece... Sep 9 15:43:04.420677991 (74h14m40.460251111s) [noise=true , address=77.90.31.10:4519 , piece_id=3WWKYSGP7HXPHKGS5XVC2JP7V7I6Z66Q2ZMWKJDSBJ7HU5I7P3LA, seg_pos={0 0}, upload=65327]: Uploading piece... Sep 9 15:43:04.420939742 (74h14m40.460512862s) [noise=true , address=45.91.116.4:4938 , piece_id=KCN33V36JJ7ILD44TK2EKRXPDHEBTZ4YJJBEHAXYBEGF45HE3GIA, seg_pos={0 0}, upload=65327]: Uploading piece... Sep 9 15:43:04.421205590 (74h14m40.46077871s) [noise=true , address=45.91.116.7:4010 , piece_id=QOFT54GGS7HTGPCU4HQWHNJAKVNHTDTYIRPBO4TAWVHDBUDSQUEQ, seg_pos={0 0}, upload=65327]: Uploading piece... Sep 9 15:43:04.421328767 (74h14m40.460901887s) [noise=true , address=77.90.31.18:4807 , piece_id=XEH5PJB4R3OQQR33YKOWUCPVYBLOOBXWTVT5THNKDK6U7SNRX5VQ, seg_pos={0 0}, upload=65327]: Uploading piece... Sep 9 15:43:04.421478733 (74h14m40.461051933s) [noise=true , address=45.91.116.11:4118 , piece_id=USMUS74QA4Q7PWHOI76653KBCJROEFD54H64HWBQBVZ6HQK5AUOQ, seg_pos={0 0}, upload=65327]: Uploading piece... Sep 9 15:43:04.421748279 (74h14m40.461321399s) [noise=true , address=45.91.116.12:4225 , piece_id=EU5YYKHWMVL3NPRXKXMJRWUQJTV5GWOF3RRJXYSHS2OWXUQJICAQ, seg_pos={0 0}, upload=65327]: Uploading piece... Sep 9 15:43:04.421911040 (74h14m40.46148416s) [noise=true , address=45.91.116.8:4045 , piece_id=WC76G6NN7JCDF2AJR2IJZEWJEYDXQZ2IFR2FIJEVIJPEBWSBGEFQ, seg_pos={0 0}, upload=65327]: Uploading piece... Sep 9 15:43:04.422204843 (74h14m40.461777963s) [noise=true , address=77.90.31.13:4626 , piece_id=SMNVJ6V3V5M4Q55HVYL4ADJDFP3C24XM5SH2HOKH7NQVPA6D5TEQ, seg_pos={0 0}, upload=65327]: Uploading piece... Sep 9 15:43:04.422443891 (74h14m40.462017011s) [noise=true , address=77.90.31.19:4842 , piece_id=SVV7CE5B7T3DFG5X5V7PZZAFVKJYREE3J7XEZ4IQ7EDP33TTZDYQ, seg_pos={0 0}, upload=65327]: Uploading piece... Sep 9 15:43:04.422676505 (74h14m40.462249625s) [noise=true , address=77.90.31.17:4770 , piece_id=EQMSRH4GHVRVEAWYX2WUJZ74HIM44DUMZEUMHIQWRLX2PT5BA6FQ, seg_pos={0 0}, upload=65327]: Uploading piece... Sep 9 15:43:04.422767580 (74h14m40.46234071s) [noise=true , address=45.91.116.10:4083 , piece_id=W4M3FFM3QX4UYYYQNS6APUEEQGWKGM6OK4U2HBDBN2LVBHKOANUQ, seg_pos={0 0}, upload=65327]: Uploading piece... Sep 9 15:43:04.423013330 (74h14m40.46258645s) [noise=true , address=45.91.116.14:4191 , piece_id=WQ2ULDYQAORYM2TSTTMRQRYCDN3VQYS7575CPKZZGFRWXMC36KPQ, seg_pos={0 0}, upload=65327]: Uploading piece... Sep 9 15:43:04.423324996 (74h14m40.462898116s) [noise=true , address=77.90.31.21:4878 , piece_id=ZIQTQVECAY4XWDZV5G5UZQNCMPVIQLYXYSVCOVA2DZLTHNUZNX5A, seg_pos={0 0}, upload=65327]: Uploading piece... Sep 9 15:43:04.423600333 (74h14m40.463173453s) [noise=true , address=145.79.227.6:4258 , piece_id=JGV4BZQFMJM6D52ISFZZ7AP5MZRZTNOSFRUVOOVBQLJXTO6M5T4A, seg_pos={0 0}, upload=65327]: Uploading piece... Sep 9 15:43:06.331709375 (74h14m42.371282495s) [upload=65327]: Next returned nil segment Sep 9 15:43:06.331749802 (74h14m42.371322922s) [upload=65327]: Waiting for error group managing segments... Sep 9 15:43:06.639281873 (74h14m42.678854993s) [noise=true , address=45.91.116.10:4083 , piece_id=W4M3FFM3QX4UYYYQNS6APUEEQGWKGM6OK4U2HBDBN2LVBHKOANUQ, seg_pos={0 0}, upload=65327]: Done uploading piece. err: <nil> Sep 9 15:43:06.639301952 (74h14m42.678875062s) [noise=true , address=77.90.31.10:4519 , piece_id=3WWKYSGP7HXPHKGS5XVC2JP7V7I6Z66Q2ZMWKJDSBJ7HU5I7P3LA, seg_pos={0 0}, upload=65327]: Done uploading piece. err: <nil> Sep 9 15:43:06.639703620 (74h14m42.67927674s) [noise=true , address=45.91.116.8:4045 , piece_id=WC76G6NN7JCDF2AJR2IJZEWJEYDXQZ2IFR2FIJEVIJPEBWSBGEFQ, seg_pos={0 0}, upload=65327]: Done uploading piece. err: <nil> Sep 9 15:43:06.642069657 (74h14m42.681642778s) [noise=true , address=45.91.116.12:4225 , piece_id=EU5YYKHWMVL3NPRXKXMJRWUQJTV5GWOF3RRJXYSHS2OWXUQJICAQ, seg_pos={0 0}, upload=65327]: Done uploading piece. err: <nil> Sep 9 15:43:06.649382231 (74h14m42.688955351s) [noise=true , address=77.90.31.17:4770 , piece_id=EQMSRH4GHVRVEAWYX2WUJZ74HIM44DUMZEUMHIQWRLX2PT5BA6FQ, seg_pos={0 0}, upload=65327]: Done uploading piece. err: <nil> Sep 9 15:43:06.664499179 (74h14m42.704072299s) [noise=true , address=77.90.31.18:4807 , piece_id=XEH5PJB4R3OQQR33YKOWUCPVYBLOOBXWTVT5THNKDK6U7SNRX5VQ, seg_pos={0 0}, upload=65327]: Done uploading piece. err: <nil> Sep 9 15:43:06.677132464 (74h14m42.716705584s) [noise=true , address=77.90.31.19:4842 , piece_id=SVV7CE5B7T3DFG5X5V7PZZAFVKJYREE3J7XEZ4IQ7EDP33TTZDYQ, seg_pos={0 0}, upload=65327]: Done uploading piece. err: <nil> Sep 9 15:43:06.711481133 (74h14m42.751054253s) [noise=true , address=45.91.116.14:4191 , piece_id=WQ2ULDYQAORYM2TSTTMRQRYCDN3VQYS7575CPKZZGFRWXMC36KPQ, seg_pos={0 0}, upload=65327]: Done uploading piece. err: <nil> Sep 9 15:43:06.722358087 (74h14m42.761931207s) [noise=true , address=45.91.116.11:4118 , piece_id=USMUS74QA4Q7PWHOI76653KBCJROEFD54H64HWBQBVZ6HQK5AUOQ, seg_pos={0 0}, upload=65327]: Done uploading piece. err: <nil> Sep 9 15:43:06.760202536 (74h14m42.799775656s) [noise=true , address=45.91.116.4:4938 , piece_id=KCN33V36JJ7ILD44TK2EKRXPDHEBTZ4YJJBEHAXYBEGF45HE3GIA, seg_pos={0 0}, upload=65327]: Done uploading piece. err: <nil> Sep 9 15:43:06.775105423 (74h14m42.814678543s) [noise=true , address=45.91.116.4:4937 , piece_id=5VE5KABF62FV3YXF6AB57IA25VMUC7OUGZRYA5DIDNETMVUX35KQ, seg_pos={0 0}, upload=65327]: Done uploading piece. err: <nil> Sep 9 15:43:06.967418603 (74h14m43.006991723s) [noise=true , address=145.79.227.6:4258 , piece_id=JGV4BZQFMJM6D52ISFZZ7AP5MZRZTNOSFRUVOOVBQLJXTO6M5T4A, seg_pos={0 0}, upload=65327]: Done uploading piece. err: <nil> Sep 9 15:43:06.970866702 (74h14m43.010439822s) [noise=true , address=77.90.31.21:4878 , piece_id=ZIQTQVECAY4XWDZV5G5UZQNCMPVIQLYXYSVCOVA2DZLTHNUZNX5A, seg_pos={0 0}, upload=65327]: Done uploading piece. err: <nil> Sep 9 15:43:06.970895206 (74h14m43.010468326s) [seg_pos={0 0}, upload=65327]: Segment reached optimal threshold of 13 pieces. Sep 9 15:43:06.971016308 (74h14m43.010589428s) [noise=true , address=45.91.116.7:4010 , piece_id=QOFT54GGS7HTGPCU4HQWHNJAKVNHTDTYIRPBO4TAWVHDBUDSQUEQ, seg_pos={0 0}, upload=65327]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w): protocol: expected piece hash; context canceled; EOF Sep 9 15:43:06.971144313 (74h14m43.010717433s) [noise=true , address=77.90.31.13:4626 , piece_id=SMNVJ6V3V5M4Q55HVYL4ADJDFP3C24XM5SH2HOKH7NQVPA6D5TEQ, seg_pos={0 0}, upload=65327]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu): protocol: expected piece hash; context canceled; EOF Sep 9 15:43:06.971238873 (74h14m43.01084623s) [noise=true , address=45.91.116.9:4262 , piece_id=M45XJNY6CX3F34FEKD4U6H44MGPYO24TTPA7MHY5MOWFJBICMWPA, seg_pos={0 0}, upload=65327]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto): protocol: read tcp 188.166.225.170:58444->45.91.116.9:4262: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 9 15:43:06.971297977 (74h14m43.010871097s) [seg_pos={0 0}, upload=65327]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 15:43:06.971367019 (74h14m43.010940139s) [upload=65327]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 15:43:06.971370896 (74h14m43.010944016s) [upload=65327]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 15:43:07.337642180 (74h14m43.3772153s) [upload=65327]: Done uploading segments... Sep 9 15:43:07.337661678 (74h14m43.377234798s) [upload=65327]: Upload finished. err: <nil> Duration: 30.003068384s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 2.562647671s FAIL (2025-09-09 15:43:14 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.562666327s edge gateway us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 731.176075ms target: https://us1.storj.io/login FAIL (2025-09-09 15:42:52 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused Duration: 731.200951ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 43 out of 60 is failed (threshold=3) [XXX.......X.X.XXX.XX..XX.X.XX..X.XXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 30.00297663s FAIL (2025-09-09 15:42:39 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 15:42:10.291738849 (74h13m46.331311979s) [upload=65314]: Starting upload Sep 9 15:42:10.291795287 (74h13m46.331368407s) [upload=65314]: Done starting upload Sep 9 15:42:10.291833170 (74h13m46.33140631s) [upload=65314]: Uploading segments... Sep 9 15:42:10.292588745 (74h13m46.332161865s) [upload=65314]: Got next segment. Inline: false Sep 9 15:42:10.292628261 (74h13m46.332201381s) [upload=65314]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 15:42:10.292633130 (74h13m46.33220625s) [upload=65314]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 15:42:11.331118529 (74h13m47.370691649s) [seg_pos={0 0}, upload=65314]: Begin upload segment... Sep 9 15:42:11.331166530 (74h13m47.370739651s) [seg_pos={0 0}, upload=65314]: Done begin upload segment. Sep 9 15:42:11.331204614 (74h13m47.370777734s) [noise=true , address=145.79.227.18:4005 , piece_id=C36BISL45ALU2CKIU4GGN2FUOWI4IN7Z3U5AMJTWRWFDW5CBXZXQ, seg_pos={0 0}, upload=65314]: Uploading piece... Sep 9 15:42:11.331322229 (74h13m47.370895359s) [noise=true , address=77.90.31.10:4519 , piece_id=TSB6INSNRGN7WKCL55LIDIB3IG3YCZ5EW3IXAHICKCI77ZHJ7QBA, seg_pos={0 0}, upload=65314]: Uploading piece... Sep 9 15:42:11.331730480 (74h13m47.3713036s) [noise=true , address=77.90.31.13:4628 , piece_id=ZVFJV5QMGNB4YYV2QLTIU4FNWQW5BMEGS64JSTIHMLHSWWKCCFRA, seg_pos={0 0}, upload=65314]: Uploading piece... Sep 9 15:42:11.331942857 (74h13m47.371515977s) [noise=true , address=77.90.31.16:4735 , piece_id=JGZXCX3S5BGGM7QB5LLY6FMMA5FNKPZGU5MTQV26BLEJ26B3XAKQ, seg_pos={0 0}, upload=65314]: Uploading piece... Sep 9 15:42:11.332246718 (74h13m47.371819838s) [noise=true , address=145.79.227.13:4803 , piece_id=H4H3FMIIJZIKRS6BUDABZMG5WZXFSBSQGB3T7J4F2LG72DUSDQFQ, seg_pos={0 0}, upload=65314]: Uploading piece... Sep 9 15:42:11.332306131 (74h13m47.371879251s) [noise=true , address=77.90.31.14:4661 , piece_id=LW4XARD7DV2OLYB27LUAXYZFF7XL5BOIR4Z5YAVD3VG2B2OB54KQ, seg_pos={0 0}, upload=65314]: Uploading piece... Sep 9 15:42:11.332566210 (74h13m47.37213933s) [noise=true , address=45.91.116.6:4973 , piece_id=E45ZWCIPT6MW3VUFPQWE22IOHBMAGX7ZFLFHP7VF43OD5KC2G3KQ, seg_pos={0 0}, upload=65314]: Uploading piece... Sep 9 15:42:11.332688142 (74h13m47.372261262s) [noise=true , address=145.79.227.5:4221 , piece_id=O3YIFIZHCXXQBYJTNIGJMM3YXOTENTCX6XYB3GRQWBXG4IATEJUQ, seg_pos={0 0}, upload=65314]: Uploading piece... Sep 9 15:42:11.332835665 (74h13m47.372408785s) [noise=true , address=77.90.31.17:4772 , piece_id=GB6XEPAWZYYVIWLWPGGH4G74HNTAZ3KAQT7SK57FWDIK5Z5ANG6A, seg_pos={0 0}, upload=65314]: Uploading piece... Sep 9 15:42:11.333145698 (74h13m47.372718848s) [noise=true , address=45.91.116.11:4119 , piece_id=YQLANDXBKCYHTEKJE3FMBRIYSQ5XX6L5TVY3ARUYM26JCOOHXACA, seg_pos={0 0}, upload=65314]: Uploading piece... Sep 9 15:42:11.333461393 (74h13m47.373034513s) [noise=true , address=77.90.31.12:4590 , piece_id=WN2NASKBPP4Z3YCBTDDIH3SA5C43FLAT3FZYQAG3TFM2JVFOUONA, seg_pos={0 0}, upload=65314]: Uploading piece... Sep 9 15:42:11.333733013 (74h13m47.373306133s) [noise=true , address=45.91.116.7:4010 , piece_id=JC3XOUFJ3JS2G5IOX4E5WH57MRFYESGCZ5K2OZKX33K5Q3TGZTCA, seg_pos={0 0}, upload=65314]: Uploading piece... Sep 9 15:42:11.334038377 (74h13m47.373611497s) [noise=true , address=45.91.116.8:4047 , piece_id=ETJZV35Y7VABY3O6GIQLKXNLYG5BDPPZM5MW7GXH5JAQ24XXRNQQ, seg_pos={0 0}, upload=65314]: Uploading piece... Sep 9 15:42:11.334292623 (74h13m47.373865743s) [noise=true , address=77.90.31.21:4878 , piece_id=KPSG3XBIROWHX5UXMVNCJGF635GEINHT2G3GRLED2KOGFDZUTZKA, seg_pos={0 0}, upload=65314]: Uploading piece... Sep 9 15:42:11.334558772 (74h13m47.374131893s) [noise=true , address=45.91.116.5:4299 , piece_id=ATK2SJE3U6ABDOJXKZX4HZKEYOYVDIE57V25ZN3DHJEOEU7FNSOQ, seg_pos={0 0}, upload=65314]: Uploading piece... Sep 9 15:42:11.334922478 (74h13m47.374495608s) [noise=true , address=45.91.116.6:4975 , piece_id=HTF2M53XCE6XDMTJSNOWZSYENIS4VDK2SAZD7RIBFXIEQEQFVE5Q, seg_pos={0 0}, upload=65314]: Uploading piece... Sep 9 15:42:13.231415413 (74h13m49.270988543s) [upload=65314]: Next returned nil segment Sep 9 15:42:13.231436594 (74h13m49.271009714s) [upload=65314]: Waiting for error group managing segments... Sep 9 15:42:13.546065526 (74h13m49.585638646s) [noise=true , address=45.91.116.6:4975 , piece_id=HTF2M53XCE6XDMTJSNOWZSYENIS4VDK2SAZD7RIBFXIEQEQFVE5Q, seg_pos={0 0}, upload=65314]: Done uploading piece. err: <nil> Sep 9 15:42:13.555455474 (74h13m49.595028594s) [noise=true , address=77.90.31.21:4878 , piece_id=KPSG3XBIROWHX5UXMVNCJGF635GEINHT2G3GRLED2KOGFDZUTZKA, seg_pos={0 0}, upload=65314]: Done uploading piece. err: <nil> Sep 9 15:42:13.573659118 (74h13m49.613232238s) [noise=true , address=45.91.116.6:4973 , piece_id=E45ZWCIPT6MW3VUFPQWE22IOHBMAGX7ZFLFHP7VF43OD5KC2G3KQ, seg_pos={0 0}, upload=65314]: Done uploading piece. err: <nil> Sep 9 15:42:13.576719374 (74h13m49.616292494s) [noise=true , address=45.91.116.7:4010 , piece_id=JC3XOUFJ3JS2G5IOX4E5WH57MRFYESGCZ5K2OZKX33K5Q3TGZTCA, seg_pos={0 0}, upload=65314]: Done uploading piece. err: <nil> Sep 9 15:42:13.587310682 (74h13m49.626883802s) [noise=true , address=77.90.31.10:4519 , piece_id=TSB6INSNRGN7WKCL55LIDIB3IG3YCZ5EW3IXAHICKCI77ZHJ7QBA, seg_pos={0 0}, upload=65314]: Done uploading piece. err: <nil> Sep 9 15:42:13.600573571 (74h13m49.640146691s) [noise=true , address=77.90.31.12:4590 , piece_id=WN2NASKBPP4Z3YCBTDDIH3SA5C43FLAT3FZYQAG3TFM2JVFOUONA, seg_pos={0 0}, upload=65314]: Done uploading piece. err: <nil> Sep 9 15:42:13.631107621 (74h13m49.670680741s) [noise=true , address=77.90.31.14:4661 , piece_id=LW4XARD7DV2OLYB27LUAXYZFF7XL5BOIR4Z5YAVD3VG2B2OB54KQ, seg_pos={0 0}, upload=65314]: Done uploading piece. err: <nil> Sep 9 15:42:13.661935483 (74h13m49.701508603s) [noise=true , address=77.90.31.17:4772 , piece_id=GB6XEPAWZYYVIWLWPGGH4G74HNTAZ3KAQT7SK57FWDIK5Z5ANG6A, seg_pos={0 0}, upload=65314]: Done uploading piece. err: <nil> Sep 9 15:42:13.705837984 (74h13m49.745411104s) [noise=true , address=77.90.31.16:4735 , piece_id=JGZXCX3S5BGGM7QB5LLY6FMMA5FNKPZGU5MTQV26BLEJ26B3XAKQ, seg_pos={0 0}, upload=65314]: Done uploading piece. err: <nil> Sep 9 15:42:13.906552049 (74h13m49.946125169s) [noise=true , address=145.79.227.18:4005 , piece_id=C36BISL45ALU2CKIU4GGN2FUOWI4IN7Z3U5AMJTWRWFDW5CBXZXQ, seg_pos={0 0}, upload=65314]: Done uploading piece. err: <nil> Sep 9 15:42:13.914758955 (74h13m49.954332075s) [noise=true , address=45.91.116.11:4119 , piece_id=YQLANDXBKCYHTEKJE3FMBRIYSQ5XX6L5TVY3ARUYM26JCOOHXACA, seg_pos={0 0}, upload=65314]: Done uploading piece. err: <nil> Sep 9 15:42:14.063649059 (74h13m50.103222179s) [noise=true , address=45.91.116.8:4047 , piece_id=ETJZV35Y7VABY3O6GIQLKXNLYG5BDPPZM5MW7GXH5JAQ24XXRNQQ, seg_pos={0 0}, upload=65314]: Done uploading piece. err: <nil> Sep 9 15:42:14.126527292 (74h13m50.166100412s) [noise=true , address=145.79.227.13:4803 , piece_id=H4H3FMIIJZIKRS6BUDABZMG5WZXFSBSQGB3T7J4F2LG72DUSDQFQ, seg_pos={0 0}, upload=65314]: Done uploading piece. err: <nil> Sep 9 15:42:14.126556267 (74h13m50.166129408s) [seg_pos={0 0}, upload=65314]: Segment reached optimal threshold of 13 pieces. Sep 9 15:42:14.126733556 (74h13m50.166306676s) [noise=true , address=45.91.116.5:4299 , piece_id=ATK2SJE3U6ABDOJXKZX4HZKEYOYVDIE57V25ZN3DHJEOEU7FNSOQ, seg_pos={0 0}, upload=65314]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF Sep 9 15:42:14.126826244 (74h13m50.166399364s) [noise=true , address=77.90.31.13:4628 , piece_id=ZVFJV5QMGNB4YYV2QLTIU4FNWQW5BMEGS64JSTIHMLHSWWKCCFRA, seg_pos={0 0}, upload=65314]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF Sep 9 15:42:14.126858195 (74h13m50.166431315s) [noise=true , address=145.79.227.5:4221 , piece_id=O3YIFIZHCXXQBYJTNIGJMM3YXOTENTCX6XYB3GRQWBXG4IATEJUQ, seg_pos={0 0}, upload=65314]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: expected piece hash; context canceled; EOF Sep 9 15:42:14.126881660 (74h13m50.16645479s) [seg_pos={0 0}, upload=65314]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 15:42:14.126965090 (74h13m50.16653821s) [upload=65314]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 15:42:14.126969959 (74h13m50.166543079s) [upload=65314]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 15:42:14.473681074 (74h13m50.513254204s) [upload=65314]: Done uploading segments... Sep 9 15:42:14.473702755 (74h13m50.513275875s) [upload=65314]: Upload finished. err: <nil> Duration: 30.003002489s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 8 out of 60 is failed (threshold=3) [.........XX...X.X.......X.X....X...................X........] duration: 7.081800333s FAIL (2025-09-09 15:42:39 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.081828856s edge gateway us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 1.013699578s target: https://us1.storj.io/login FAIL (2025-09-09 15:42:28 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused Duration: 1.013728181s core satellite us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 2.465329817s FAIL (2025-09-09 15:42:15 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.465349526s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 8 out of 60 is failed (threshold=3) [..........XX...X.X.......X.X....X...................X.......] duration: 7.122812201s FAIL (2025-09-09 15:42:14 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.122834643s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 43 out of 60 is failed (threshold=3) [XXXX.......X.X.XXX.XX..XX.X.XX..X.XXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 30.002775302s FAIL (2025-09-09 15:42:03 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 15:41:33.791133599 (74h13m9.830706719s) [upload=65305]: Starting upload Sep 9 15:41:33.791194695 (74h13m9.830767825s) [upload=65305]: Done starting upload Sep 9 15:41:33.791304656 (74h13m9.830877786s) [upload=65305]: Uploading segments... Sep 9 15:41:33.791424896 (74h13m9.830998016s) [upload=65305]: Got next segment. Inline: false Sep 9 15:41:33.791467778 (74h13m9.831040938s) [upload=65305]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 15:41:33.791478178 (74h13m9.831051328s) [upload=65305]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 15:41:34.068461000 (74h13m10.10803412s) [seg_pos={0 0}, upload=65305]: Begin upload segment... Sep 9 15:41:34.068516536 (74h13m10.108089656s) [seg_pos={0 0}, upload=65305]: Done begin upload segment. Sep 9 15:41:34.068540171 (74h13m10.108113292s) [noise=true , address=145.79.227.3:4151 , piece_id=DXITSKFOMZWU5MPWAF7A4INZULJ5QCUK4JGL4PKVOZ4N7COOJ4SA, seg_pos={0 0}, upload=65305]: Uploading piece... Sep 9 15:41:34.068591640 (74h13m10.10816476s) [noise=true , address=45.91.116.5:4298 , piece_id=N5JIRKRJ3WXQD3ZYGJPLRURN5JYLYUP6VMB5WS7GDEO55AHUFNFQ, seg_pos={0 0}, upload=65305]: Uploading piece... Sep 9 15:41:34.068979652 (74h13m10.108552772s) [noise=true , address=77.90.31.18:4805 , piece_id=B2XS5AHVC77KBOQ2QBTOTOXSMXTP23ODRGK6VLAAK5JJKM5DDIAA, seg_pos={0 0}, upload=65305]: Uploading piece... Sep 9 15:41:34.069253827 (74h13m10.108826947s) [noise=true , address=77.90.31.21:4879 , piece_id=6ZOXZJVEDQ4ZJQBW34ZA7IJIKRC7JHGSULO544VHW5WNPQOOJBNQ, seg_pos={0 0}, upload=65305]: Uploading piece... Sep 9 15:41:34.069304674 (74h13m10.108877794s) [noise=true , address=45.91.116.14:4190 , piece_id=3PTJW53Y3QONXR26N2SBPZJS6CUWLFT3HGU5JUFXWXPQWBITJL2A, seg_pos={0 0}, upload=65305]: Uploading piece... Sep 9 15:41:34.069508605 (74h13m10.109081725s) [noise=true , address=77.90.31.16:4735 , piece_id=HQZSSOPZ3DA3E47HT6EILRWXIRA5RJKND64APNG6YMYPV7SPRCFA, seg_pos={0 0}, upload=65305]: Uploading piece... Sep 9 15:41:34.069675424 (74h13m10.109248544s) [noise=true , address=45.91.116.8:4047 , piece_id=UGT3QVU24ZULXLXAGPP3ZOBFZPZ5TM5ZR3QS75SHCRBSWNC3VWFA, seg_pos={0 0}, upload=65305]: Uploading piece... Sep 9 15:41:34.069757772 (74h13m10.109330892s) [noise=true , address=45.91.116.12:4225 , piece_id=U6LCM5PM3LCCQQZMHP7EBAC5UTYUM34IGYYAZS3UZJTKTD34BVQQ, seg_pos={0 0}, upload=65305]: Uploading piece... Sep 9 15:41:34.070160743 (74h13m10.109733863s) [noise=true , address=77.90.31.15:4697 , piece_id=WF3E72NYFJGH3S5EADLBKAF57V4O7AEBCF57ULKDPXQ6EZL6NMVA, seg_pos={0 0}, upload=65305]: Uploading piece... Sep 9 15:41:34.070166103 (74h13m10.109739223s) [noise=true , address=77.90.31.17:4771 , piece_id=R3RY47Z7CY55E25ZWRFPYQKODDDF27TCQIRODSG2NCRP7E47NMQA, seg_pos={0 0}, upload=65305]: Uploading piece... Sep 9 15:41:34.070405141 (74h13m10.109978261s) [noise=true , address=45.91.116.11:4119 , piece_id=GDEROR6YL2ZOV3SRLLHSVYORV3WQ4QJZMFQ22OIVPD27HYCPVTEA, seg_pos={0 0}, upload=65305]: Uploading piece... Sep 9 15:41:34.070556740 (74h13m10.11012986s) [noise=true , address=77.90.31.10:4520 , piece_id=K4MOBIE3Q2U7TJE42O4EFIC5WSE2EGKHQML6ED7BTXZVXLSFIF7A, seg_pos={0 0}, upload=65305]: Uploading piece... Sep 9 15:41:34.070724141 (74h13m10.110297261s) [noise=true , address=77.90.31.12:4589 , piece_id=UBYMPTYTZLW45ZQ7IFADKNFUG4DLWIFOHJLHT44OU6AASJAWSHPA, seg_pos={0 0}, upload=65305]: Uploading piece... Sep 9 15:41:34.071063821 (74h13m10.110636941s) [noise=true , address=45.91.116.9:4263 , piece_id=2WHWTHP2PRNOGMMHRQRKBJBX7JLJUVK74FYPCVSGTKXLPZW47SUQ, seg_pos={0 0}, upload=65305]: Uploading piece... Sep 9 15:41:34.071581903 (74h13m10.111155023s) [noise=true , address=45.91.116.5:4299 , piece_id=MNX26LVZ3FUWJYULRSHY6HXR4CPK33V27R2ZTROVCPH5TWORVQ6Q, seg_pos={0 0}, upload=65305]: Uploading piece... Sep 9 15:41:34.072008558 (74h13m10.111581678s) [noise=true , address=45.91.116.12:4227 , piece_id=HY3OECTA4ZCYU4UOLVZ3OULDOVMK37NUGYZJWFZM5QLP7UIPNMRA, seg_pos={0 0}, upload=65305]: Uploading piece... Sep 9 15:41:35.923145970 (74h13m11.96271909s) [upload=65305]: Next returned nil segment Sep 9 15:41:35.923163544 (74h13m11.962736664s) [upload=65305]: Waiting for error group managing segments... Sep 9 15:41:36.234122832 (74h13m12.273695952s) [noise=true , address=77.90.31.10:4520 , piece_id=K4MOBIE3Q2U7TJE42O4EFIC5WSE2EGKHQML6ED7BTXZVXLSFIF7A, seg_pos={0 0}, upload=65305]: Done uploading piece. err: <nil> Sep 9 15:41:36.288549041 (74h13m12.328122161s) [noise=true , address=45.91.116.9:4263 , piece_id=2WHWTHP2PRNOGMMHRQRKBJBX7JLJUVK74FYPCVSGTKXLPZW47SUQ, seg_pos={0 0}, upload=65305]: Done uploading piece. err: <nil> Sep 9 15:41:36.290101793 (74h13m12.329674923s) [noise=true , address=77.90.31.16:4735 , piece_id=HQZSSOPZ3DA3E47HT6EILRWXIRA5RJKND64APNG6YMYPV7SPRCFA, seg_pos={0 0}, upload=65305]: Done uploading piece. err: <nil> Sep 9 15:41:36.317160932 (74h13m12.356734062s) [noise=true , address=77.90.31.17:4771 , piece_id=R3RY47Z7CY55E25ZWRFPYQKODDDF27TCQIRODSG2NCRP7E47NMQA, seg_pos={0 0}, upload=65305]: Done uploading piece. err: <nil> Sep 9 15:41:36.317782682 (74h13m12.357355802s) [noise=true , address=45.91.116.8:4047 , piece_id=UGT3QVU24ZULXLXAGPP3ZOBFZPZ5TM5ZR3QS75SHCRBSWNC3VWFA, seg_pos={0 0}, upload=65305]: Done uploading piece. err: <nil> Sep 9 15:41:36.320273869 (74h13m12.359846989s) [noise=true , address=45.91.116.5:4298 , piece_id=N5JIRKRJ3WXQD3ZYGJPLRURN5JYLYUP6VMB5WS7GDEO55AHUFNFQ, seg_pos={0 0}, upload=65305]: Done uploading piece. err: <nil> Sep 9 15:41:36.332450901 (74h13m12.372024021s) [noise=true , address=45.91.116.5:4299 , piece_id=MNX26LVZ3FUWJYULRSHY6HXR4CPK33V27R2ZTROVCPH5TWORVQ6Q, seg_pos={0 0}, upload=65305]: Done uploading piece. err: <nil> Sep 9 15:41:36.349389794 (74h13m12.388962914s) [noise=true , address=77.90.31.12:4589 , piece_id=UBYMPTYTZLW45ZQ7IFADKNFUG4DLWIFOHJLHT44OU6AASJAWSHPA, seg_pos={0 0}, upload=65305]: Done uploading piece. err: <nil> Sep 9 15:41:36.352925170 (74h13m12.39249832s) [noise=true , address=45.91.116.14:4190 , piece_id=3PTJW53Y3QONXR26N2SBPZJS6CUWLFT3HGU5JUFXWXPQWBITJL2A, seg_pos={0 0}, upload=65305]: Done uploading piece. err: <nil> Sep 9 15:41:36.390790309 (74h13m12.430363429s) [noise=true , address=45.91.116.12:4225 , piece_id=U6LCM5PM3LCCQQZMHP7EBAC5UTYUM34IGYYAZS3UZJTKTD34BVQQ, seg_pos={0 0}, upload=65305]: Done uploading piece. err: <nil> Sep 9 15:41:36.404384813 (74h13m12.443957933s) [noise=true , address=77.90.31.21:4879 , piece_id=6ZOXZJVEDQ4ZJQBW34ZA7IJIKRC7JHGSULO544VHW5WNPQOOJBNQ, seg_pos={0 0}, upload=65305]: Done uploading piece. err: <nil> Sep 9 15:41:36.407186946 (74h13m12.446760066s) [noise=true , address=77.90.31.18:4805 , piece_id=B2XS5AHVC77KBOQ2QBTOTOXSMXTP23ODRGK6VLAAK5JJKM5DDIAA, seg_pos={0 0}, upload=65305]: Done uploading piece. err: <nil> Sep 9 15:41:36.442568763 (74h13m12.482141883s) [noise=true , address=45.91.116.11:4119 , piece_id=GDEROR6YL2ZOV3SRLLHSVYORV3WQ4QJZMFQ22OIVPD27HYCPVTEA, seg_pos={0 0}, upload=65305]: Done uploading piece. err: <nil> Sep 9 15:41:36.442646331 (74h13m12.482219451s) [seg_pos={0 0}, upload=65305]: Segment reached optimal threshold of 13 pieces. Sep 9 15:41:36.442769657 (74h13m12.482342777s) [noise=true , address=45.91.116.12:4227 , piece_id=HY3OECTA4ZCYU4UOLVZ3OULDOVMK37NUGYZJWFZM5QLP7UIPNMRA, seg_pos={0 0}, upload=65305]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ETZh5HbRYk386nSYJSd4DvQ2XbMw5XBnyyPMfsxwHJaSHaQEH): protocol: expected piece hash; context canceled; EOF Sep 9 15:41:36.442806959 (74h13m12.482380079s) [noise=true , address=145.79.227.3:4151 , piece_id=DXITSKFOMZWU5MPWAF7A4INZULJ5QCUK4JGL4PKVOZ4N7COOJ4SA, seg_pos={0 0}, upload=65305]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB): protocol: expected piece hash; context canceled; EOF Sep 9 15:41:36.442813882 (74h13m12.482387002s) [noise=true , address=77.90.31.15:4697 , piece_id=WF3E72NYFJGH3S5EADLBKAF57V4O7AEBCF57ULKDPXQ6EZL6NMVA, seg_pos={0 0}, upload=65305]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5): protocol: expected piece hash; context canceled; EOF Sep 9 15:41:36.442828811 (74h13m12.482401931s) [seg_pos={0 0}, upload=65305]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 15:41:36.442895258 (74h13m12.482468378s) [upload=65305]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 15:41:36.442899656 (74h13m12.482472776s) [upload=65305]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 15:41:36.844581712 (74h13m12.884154832s) [upload=65305]: Done uploading segments... Sep 9 15:41:36.844600549 (74h13m12.884173669s) [upload=65305]: Upload finished. err: <nil> Duration: 30.002804078s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 2.202741553s FAIL (2025-09-09 15:41:48 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.202757686s edge gateway us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 743.210711ms target: https://us1.storj.io/login FAIL (2025-09-09 15:41:44 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused Duration: 743.240217ms core satellite us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 8 out of 60 is failed (threshold=3) [...........XX...X.X.......X.X....X...................X......] duration: 12.736199458s FAIL (2025-09-09 15:41:11 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 12.736222571s edge gateway us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 690.604755ms target: https://us1.storj.io/login FAIL (2025-09-09 15:41:06 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused Duration: 690.649442ms core satellite us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 2.894342432s FAIL (2025-09-09 15:41:00 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.894364434s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 42 out of 60 is failed (threshold=3) [.XXXX.......X.X.XXX.XX..XX.X.XX..X.XXXXXXXXXXXXXXXXXXXXXXXXX] duration: 30.002600428s FAIL (2025-09-09 15:40:59 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 15:40:29.710244084 (74h12m5.749817204s) [upload=65293]: Starting upload Sep 9 15:40:29.710302386 (74h12m5.749875506s) [upload=65293]: Done starting upload Sep 9 15:40:29.710406806 (74h12m5.749979926s) [upload=65293]: Uploading segments... Sep 9 15:40:29.710478513 (74h12m5.750051633s) [upload=65293]: Got next segment. Inline: false Sep 9 15:40:29.710510625 (74h12m5.750083755s) [upload=65293]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 15:40:29.710515053 (74h12m5.750088173s) [upload=65293]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 15:40:29.951381573 (74h12m5.990954733s) [seg_pos={0 0}, upload=65293]: Begin upload segment... Sep 9 15:40:29.951446967 (74h12m5.991020107s) [seg_pos={0 0}, upload=65293]: Done begin upload segment. Sep 9 15:40:29.951507704 (74h12m5.991080824s) [noise=true , address=145.79.227.4:4187 , piece_id=EWS55VLO3XQMMFIF77XZY2O6IN3K2LDWUIMGHKKOKTV7SRG5ZAJQ, seg_pos={0 0}, upload=65293]: Uploading piece... Sep 9 15:40:29.951527852 (74h12m5.991100972s) [noise=true , address=77.90.31.13:4628 , piece_id=QXAEEJMKMAEIEW6FDT64WZBKI6FECEU3GZRYNLVYYJV6ZIDPI53A, seg_pos={0 0}, upload=65293]: Uploading piece... Sep 9 15:40:29.951968605 (74h12m5.991541726s) [noise=true , address=77.90.31.14:4663 , piece_id=GMAEFBQGWLUCPLCEFHCNBT6EBGTQLNWSTYHPZ4ZG5BKCKNVQHZOQ, seg_pos={0 0}, upload=65293]: Uploading piece... Sep 9 15:40:29.952043649 (74h12m5.991616769s) [noise=true , address=45.91.116.13:4155 , piece_id=QMQTVTAPRSLGI3BC6VKAFJYXDRGSWY5JOE7WPSXON75ECQAB6UNQ, seg_pos={0 0}, upload=65293]: Uploading piece... Sep 9 15:40:29.952244134 (74h12m5.991817244s) [noise=true , address=45.91.116.6:4974 , piece_id=CEAZCTZHLGFC3IYVT7KXFH3HA32TR46ZLV4CKAGBYSMEXQ6B32QA, seg_pos={0 0}, upload=65293]: Uploading piece... Sep 9 15:40:29.952439006 (74h12m5.992012126s) [noise=true , address=45.91.116.9:4263 , piece_id=KZOTRJNJLIC4R452K65OQ52AULXS4PSM6FPJZBJ66BQDF5SOLYRQ, seg_pos={0 0}, upload=65293]: Uploading piece... Sep 9 15:40:29.952502187 (74h12m5.992075307s) [noise=true , address=145.79.227.16:4909 , piece_id=SYF4EQZNRPZQ2KXQRRGCDNITPKKDANMHCIFJCWNJOO4SSNFBO6GQ, seg_pos={0 0}, upload=65293]: Uploading piece... Sep 9 15:40:29.952732558 (74h12m5.992305678s) [noise=true , address=77.90.31.10:4520 , piece_id=DIASHYPINQZJPMP5LYDH36KYG24YDVETFEUFKDAWHA6I4K6XJ4CA, seg_pos={0 0}, upload=65293]: Uploading piece... Sep 9 15:40:29.952785148 (74h12m5.992358268s) [noise=true , address=45.91.116.10:4081 , piece_id=HDQBK2GIV4CO6JM3ZGMKLBY3RBJ2VDQOIEW5TN6OAZNPTPNU6OCQ, seg_pos={0 0}, upload=65293]: Uploading piece... Sep 9 15:40:29.952951738 (74h12m5.992524858s) [noise=true , address=77.90.31.21:4879 , piece_id=GEXC3456ZILDO37CI2KBN27KZVUVKBIGKOYLEKJIOVKXBMKQ4UWQ, seg_pos={0 0}, upload=65293]: Uploading piece... Sep 9 15:40:29.953169004 (74h12m5.992742124s) [noise=true , address=45.91.116.11:4117 , piece_id=AUFV7MS4PQJAO4EXV75C5H36AXAHJBQ3TAGD354M5YEY236IHKOA, seg_pos={0 0}, upload=65293]: Uploading piece... Sep 9 15:40:29.953182399 (74h12m5.992755519s) [noise=true , address=145.79.227.7:4293 , piece_id=D7JEAHL7RZF6TU62DHMKNWKD7AK5KPL723QAPUAD3C4MMX4WLJCA, seg_pos={0 0}, upload=65293]: Uploading piece... Sep 9 15:40:29.953438508 (74h12m5.993011628s) [noise=true , address=45.91.116.4:4939 , piece_id=CKFP22JR3RIZPLG2ZYAGX2Y6TMUWXTONTN6Q65LPJB5BVWZAQOJQ, seg_pos={0 0}, upload=65293]: Uploading piece... Sep 9 15:40:29.953591331 (74h12m5.993164451s) [noise=true , address=145.79.227.11:4729 , piece_id=O5FMUGHO6AQHX7A4NJQGV2FIHHUJHQG4ODLORNIJ3PUE2WFKEDPA, seg_pos={0 0}, upload=65293]: Uploading piece... Sep 9 15:40:29.953936733 (74h12m5.993509853s) [noise=true , address=145.79.227.3:4150 , piece_id=ZMX7X4XPWV3E5FZ5EL3KS5KF2BPBNVOK2BXXLZN722AUQX5BVJ5A, seg_pos={0 0}, upload=65293]: Uploading piece... Sep 9 15:40:29.954338671 (74h12m5.993911791s) [noise=true , address=145.79.227.14:4840 , piece_id=52MOOFNX3WWPYPGY4RE46CH3VTJR77JSYADOWWD654KOHZQ3SFIQ, seg_pos={0 0}, upload=65293]: Uploading piece... Sep 9 15:40:31.877254629 (74h12m7.916827749s) [upload=65293]: Next returned nil segment Sep 9 15:40:31.877274988 (74h12m7.916848118s) [upload=65293]: Waiting for error group managing segments... Sep 9 15:40:32.187878096 (74h12m8.227451216s) [noise=true , address=77.90.31.14:4663 , piece_id=GMAEFBQGWLUCPLCEFHCNBT6EBGTQLNWSTYHPZ4ZG5BKCKNVQHZOQ, seg_pos={0 0}, upload=65293]: Done uploading piece. err: <nil> Sep 9 15:40:32.191903479 (74h12m8.231476599s) [noise=true , address=45.91.116.10:4081 , piece_id=HDQBK2GIV4CO6JM3ZGMKLBY3RBJ2VDQOIEW5TN6OAZNPTPNU6OCQ, seg_pos={0 0}, upload=65293]: Done uploading piece. err: <nil> Sep 9 15:40:32.258136272 (74h12m8.297709392s) [noise=true , address=45.91.116.13:4155 , piece_id=QMQTVTAPRSLGI3BC6VKAFJYXDRGSWY5JOE7WPSXON75ECQAB6UNQ, seg_pos={0 0}, upload=65293]: Done uploading piece. err: <nil> Sep 9 15:40:32.264244250 (74h12m8.30381738s) [noise=true , address=45.91.116.11:4117 , piece_id=AUFV7MS4PQJAO4EXV75C5H36AXAHJBQ3TAGD354M5YEY236IHKOA, seg_pos={0 0}, upload=65293]: Done uploading piece. err: <nil> Sep 9 15:40:32.279634400 (74h12m8.31920752s) [noise=true , address=77.90.31.13:4628 , piece_id=QXAEEJMKMAEIEW6FDT64WZBKI6FECEU3GZRYNLVYYJV6ZIDPI53A, seg_pos={0 0}, upload=65293]: Done uploading piece. err: <nil> Sep 9 15:40:32.282835807 (74h12m8.322408927s) [noise=true , address=45.91.116.6:4974 , piece_id=CEAZCTZHLGFC3IYVT7KXFH3HA32TR46ZLV4CKAGBYSMEXQ6B32QA, seg_pos={0 0}, upload=65293]: Done uploading piece. err: <nil> Sep 9 15:40:32.322742731 (74h12m8.362315851s) [noise=true , address=77.90.31.10:4520 , piece_id=DIASHYPINQZJPMP5LYDH36KYG24YDVETFEUFKDAWHA6I4K6XJ4CA, seg_pos={0 0}, upload=65293]: Done uploading piece. err: <nil> Sep 9 15:40:32.324263953 (74h12m8.363837073s) [noise=true , address=45.91.116.4:4939 , piece_id=CKFP22JR3RIZPLG2ZYAGX2Y6TMUWXTONTN6Q65LPJB5BVWZAQOJQ, seg_pos={0 0}, upload=65293]: Done uploading piece. err: <nil> Sep 9 15:40:32.336232816 (74h12m8.375805936s) [noise=true , address=45.91.116.9:4263 , piece_id=KZOTRJNJLIC4R452K65OQ52AULXS4PSM6FPJZBJ66BQDF5SOLYRQ, seg_pos={0 0}, upload=65293]: Done uploading piece. err: <nil> Sep 9 15:40:32.362538234 (74h12m8.402111354s) [noise=true , address=145.79.227.14:4840 , piece_id=52MOOFNX3WWPYPGY4RE46CH3VTJR77JSYADOWWD654KOHZQ3SFIQ, seg_pos={0 0}, upload=65293]: Done uploading piece. err: <nil> Sep 9 15:40:32.506776547 (74h12m8.546349667s) [noise=true , address=77.90.31.21:4879 , piece_id=GEXC3456ZILDO37CI2KBN27KZVUVKBIGKOYLEKJIOVKXBMKQ4UWQ, seg_pos={0 0}, upload=65293]: Done uploading piece. err: <nil> Sep 9 15:40:32.617222786 (74h12m8.656795906s) [noise=true , address=145.79.227.11:4729 , piece_id=O5FMUGHO6AQHX7A4NJQGV2FIHHUJHQG4ODLORNIJ3PUE2WFKEDPA, seg_pos={0 0}, upload=65293]: Done uploading piece. err: <nil> Sep 9 15:40:32.716179299 (74h12m8.755752419s) [noise=true , address=145.79.227.3:4150 , piece_id=ZMX7X4XPWV3E5FZ5EL3KS5KF2BPBNVOK2BXXLZN722AUQX5BVJ5A, seg_pos={0 0}, upload=65293]: Done uploading piece. err: <nil> Sep 9 15:40:32.716205579 (74h12m8.755778699s) [seg_pos={0 0}, upload=65293]: Segment reached optimal threshold of 13 pieces. Sep 9 15:40:32.716322093 (74h12m8.755895213s) [noise=true , address=145.79.227.4:4187 , piece_id=EWS55VLO3XQMMFIF77XZY2O6IN3K2LDWUIMGHKKOKTV7SRG5ZAJQ, seg_pos={0 0}, upload=65293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x): protocol: expected piece hash; context canceled; EOF Sep 9 15:40:32.716384171 (74h12m8.755957281s) [noise=true , address=145.79.227.7:4293 , piece_id=D7JEAHL7RZF6TU62DHMKNWKD7AK5KPL723QAPUAD3C4MMX4WLJCA, seg_pos={0 0}, upload=65293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE): protocol: expected piece hash; context canceled; EOF Sep 9 15:40:32.716441891 (74h12m8.756015011s) [noise=true , address=145.79.227.16:4909 , piece_id=SYF4EQZNRPZQ2KXQRRGCDNITPKKDANMHCIFJCWNJOO4SSNFBO6GQ, seg_pos={0 0}, upload=65293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: write tcp 188.166.225.170:51926->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:51926->145.79.227.16:4909: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51926->145.79.227.16:4909: use of closed network connection Sep 9 15:40:32.716460578 (74h12m8.756033698s) [seg_pos={0 0}, upload=65293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 15:40:32.716524650 (74h12m8.75609777s) [upload=65293]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 15:40:32.716528818 (74h12m8.756101938s) [upload=65293]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 15:40:33.023303800 (74h12m9.06287695s) [upload=65293]: Done uploading segments... Sep 9 15:40:33.023345730 (74h12m9.06291885s) [upload=65293]: Upload finished. err: <nil> Duration: 30.002613642s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 2.54102637s FAIL (2025-09-09 15:40:31 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.541103015s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 41 out of 60 is failed (threshold=3) [..XXXX.......X.X.XXX.XX..XX.X.XX..X.XXXXXXXXXXXXXXXXXXXXXXXX] duration: 30.001404708s FAIL (2025-09-09 15:40:28 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 15:39:59.490396426 (74h11m35.529969546s) [upload=65282]: Starting upload Sep 9 15:39:59.490472050 (74h11m35.53004518s) [upload=65282]: Done starting upload Sep 9 15:39:59.490541874 (74h11m35.530114994s) [upload=65282]: Uploading segments... Sep 9 15:39:59.490681982 (74h11m35.530255102s) [upload=65282]: Got next segment. Inline: false Sep 9 15:39:59.490714835 (74h11m35.530287955s) [upload=65282]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 15:39:59.490719093 (74h11m35.530292213s) [upload=65282]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 15:39:59.748151495 (74h11m35.787724615s) [seg_pos={0 0}, upload=65282]: Begin upload segment... Sep 9 15:39:59.748199867 (74h11m35.787772987s) [seg_pos={0 0}, upload=65282]: Done begin upload segment. Sep 9 15:39:59.748226257 (74h11m35.787799367s) [noise=true , address=45.91.116.12:4225 , piece_id=N646QFFHZEIFILTAZEPPTJPGBJCPC5I65VYNHA777R5T322DNKNQ, seg_pos={0 0}, upload=65282]: Uploading piece... Sep 9 15:39:59.748281032 (74h11m35.787854152s) [noise=true , address=45.91.116.13:4154 , piece_id=5VXNKFEEI43EQNAIPZLDNLHJBSLW5VVWXOTI45RCWJTQTED64JCQ, seg_pos={0 0}, upload=65282]: Uploading piece... Sep 9 15:39:59.748606595 (74h11m35.788179715s) [noise=true , address=45.91.116.4:4938 , piece_id=CEFNAE5UBJJ3EHC3TOUKMPWKQN4PVSTOFOYR4TMI2QVPCUGZ27PA, seg_pos={0 0}, upload=65282]: Uploading piece... Sep 9 15:39:59.748696147 (74h11m35.788269267s) [noise=true , address=77.90.31.10:4517 , piece_id=FYF4NR7PTXZW7BSYXKUWCQL6CIOHLEXEHHVRH2CSJ6VCUJTZ2TEA, seg_pos={0 0}, upload=65282]: Uploading piece... Sep 9 15:39:59.748880910 (74h11m35.78845403s) [noise=true , address=77.90.31.18:4806 , piece_id=UQ4Y4BZZP6EAWUYPGUEF632BP4ZCAY4EE44EJMGASTASAAN4RJ2Q, seg_pos={0 0}, upload=65282]: Uploading piece... Sep 9 15:39:59.748975702 (74h11m35.788548822s) [noise=true , address=77.90.31.17:4770 , piece_id=Q5M5ZIJN5BHYEZYTLNB3QOLI6EZYOFR3UYOLGOKNPSTGYTJQQYKA, seg_pos={0 0}, upload=65282]: Uploading piece... Sep 9 15:39:59.749150526 (74h11m35.788723646s) [noise=true , address=45.91.116.9:4262 , piece_id=S4P4YDXGECGMLK7URYIQXFZFALPBYLKFPKFKDVG2SLKK2BWJITDQ, seg_pos={0 0}, upload=65282]: Uploading piece... Sep 9 15:39:59.749325742 (74h11m35.788898862s) [noise=true , address=45.91.116.14:4191 , piece_id=4Y3NEBFVAJDK6JWVXPNHK6ZUB7OBKYE5YNHYOXNBDYGUHTGOHRSA, seg_pos={0 0}, upload=65282]: Uploading piece... Sep 9 15:39:59.749484396 (74h11m35.789057516s) [noise=true , address=77.90.31.13:4627 , piece_id=BO6T56BTKW4F6XTENEFYJZMDYO3MSDZTU3JJPG4CR2XGLQY27JMA, seg_pos={0 0}, upload=65282]: Uploading piece... Sep 9 15:39:59.749603964 (74h11m35.789177084s) [noise=true , address=45.91.116.8:4048 , piece_id=BQVSIZR2WN5JERLM6ZZPF2KBLKSNQ4IYMB2QYVMFU7F6UG4T3KQQ, seg_pos={0 0}, upload=65282]: Uploading piece... Sep 9 15:39:59.749727320 (74h11m35.789300441s) [noise=true , address=45.91.116.11:4117 , piece_id=37VU4VVATPAKMRAKEDV2QS3ACBSP7Z3GHPWKBTKI7MLHPOTBIM6A, seg_pos={0 0}, upload=65282]: Uploading piece... Sep 9 15:39:59.749873159 (74h11m35.789446269s) [noise=true , address=77.90.31.15:4699 , piece_id=BLPVNJBR5RADY5V5F2VPKGW4P43EPBB5GO3AMFDPKWMNS7PT2SFA, seg_pos={0 0}, upload=65282]: Uploading piece... Sep 9 15:39:59.750051640 (74h11m35.78962476s) [noise=true , address=45.91.116.5:4299 , piece_id=FRZ3YSBSXTI4GQD4CLFVDRH33W5TLJ3CACZUTU4EZWWWWI6LWPTA, seg_pos={0 0}, upload=65282]: Uploading piece... Sep 9 15:39:59.750116034 (74h11m35.789689154s) [noise=true , address=77.90.31.19:4843 , piece_id=DTVHJMQ6TRY3B2T3XOHTAKFCOGG7H27GT66DM4DJ6LQCBZAJKHHA, seg_pos={0 0}, upload=65282]: Uploading piece... Sep 9 15:39:59.750297481 (74h11m35.789870601s) [noise=true , address=145.79.227.19:4077 , piece_id=LC65CQZS4S5P3GNKT3XTDTWS6CSSX2PUJIOAIPZ665OP2ZVMSQRA, seg_pos={0 0}, upload=65282]: Uploading piece... Sep 9 15:39:59.750380229 (74h11m35.789953339s) [noise=true , address=145.79.227.13:4801 , piece_id=COTHT7SS7J74HXNLEHHXKQTBWANA27G5B5UG342KS3WABM27LN4A, seg_pos={0 0}, upload=65282]: Uploading piece... Sep 9 15:40:01.634923808 (74h11m37.674496938s) [upload=65282]: Next returned nil segment Sep 9 15:40:01.634945148 (74h11m37.674518268s) [upload=65282]: Waiting for error group managing segments... Sep 9 15:40:01.936355255 (74h11m37.975928395s) [noise=true , address=45.91.116.8:4048 , piece_id=BQVSIZR2WN5JERLM6ZZPF2KBLKSNQ4IYMB2QYVMFU7F6UG4T3KQQ, seg_pos={0 0}, upload=65282]: Done uploading piece. err: <nil> Sep 9 15:40:01.944397865 (74h11m37.983970995s) [noise=true , address=77.90.31.13:4627 , piece_id=BO6T56BTKW4F6XTENEFYJZMDYO3MSDZTU3JJPG4CR2XGLQY27JMA, seg_pos={0 0}, upload=65282]: Done uploading piece. err: <nil> Sep 9 15:40:01.982806213 (74h11m38.022379343s) [noise=true , address=45.91.116.11:4117 , piece_id=37VU4VVATPAKMRAKEDV2QS3ACBSP7Z3GHPWKBTKI7MLHPOTBIM6A, seg_pos={0 0}, upload=65282]: Done uploading piece. err: <nil> Sep 9 15:40:02.012741037 (74h11m38.052314167s) [noise=true , address=45.91.116.5:4299 , piece_id=FRZ3YSBSXTI4GQD4CLFVDRH33W5TLJ3CACZUTU4EZWWWWI6LWPTA, seg_pos={0 0}, upload=65282]: Done uploading piece. err: <nil> Sep 9 15:40:02.016773153 (74h11m38.056346283s) [noise=true , address=77.90.31.19:4843 , piece_id=DTVHJMQ6TRY3B2T3XOHTAKFCOGG7H27GT66DM4DJ6LQCBZAJKHHA, seg_pos={0 0}, upload=65282]: Done uploading piece. err: <nil> Sep 9 15:40:02.023104127 (74h11m38.062677257s) [noise=true , address=45.91.116.9:4262 , piece_id=S4P4YDXGECGMLK7URYIQXFZFALPBYLKFPKFKDVG2SLKK2BWJITDQ, seg_pos={0 0}, upload=65282]: Done uploading piece. err: <nil> Sep 9 15:40:02.041176611 (74h11m38.080749741s) [noise=true , address=77.90.31.10:4517 , piece_id=FYF4NR7PTXZW7BSYXKUWCQL6CIOHLEXEHHVRH2CSJ6VCUJTZ2TEA, seg_pos={0 0}, upload=65282]: Done uploading piece. err: <nil> Sep 9 15:40:02.052970610 (74h11m38.09254373s) [noise=true , address=45.91.116.13:4154 , piece_id=5VXNKFEEI43EQNAIPZLDNLHJBSLW5VVWXOTI45RCWJTQTED64JCQ, seg_pos={0 0}, upload=65282]: Done uploading piece. err: <nil> Sep 9 15:40:02.060574531 (74h11m38.100147671s) [noise=true , address=77.90.31.17:4770 , piece_id=Q5M5ZIJN5BHYEZYTLNB3QOLI6EZYOFR3UYOLGOKNPSTGYTJQQYKA, seg_pos={0 0}, upload=65282]: Done uploading piece. err: <nil> Sep 9 15:40:02.073005408 (74h11m38.112578538s) [noise=true , address=77.90.31.15:4699 , piece_id=BLPVNJBR5RADY5V5F2VPKGW4P43EPBB5GO3AMFDPKWMNS7PT2SFA, seg_pos={0 0}, upload=65282]: Done uploading piece. err: <nil> Sep 9 15:40:02.105304816 (74h11m38.144877946s) [noise=true , address=45.91.116.4:4938 , piece_id=CEFNAE5UBJJ3EHC3TOUKMPWKQN4PVSTOFOYR4TMI2QVPCUGZ27PA, seg_pos={0 0}, upload=65282]: Done uploading piece. err: <nil> Sep 9 15:40:02.105655297 (74h11m38.145228417s) [noise=true , address=145.79.227.13:4801 , piece_id=COTHT7SS7J74HXNLEHHXKQTBWANA27G5B5UG342KS3WABM27LN4A, seg_pos={0 0}, upload=65282]: Done uploading piece. err: <nil> Sep 9 15:40:02.309779617 (74h11m38.349352747s) [noise=true , address=45.91.116.12:4225 , piece_id=N646QFFHZEIFILTAZEPPTJPGBJCPC5I65VYNHA777R5T322DNKNQ, seg_pos={0 0}, upload=65282]: Done uploading piece. err: <nil> Sep 9 15:40:02.309875872 (74h11m38.349448992s) [seg_pos={0 0}, upload=65282]: Segment reached optimal threshold of 13 pieces. Sep 9 15:40:02.310211875 (74h11m38.349785005s) [noise=true , address=77.90.31.18:4806 , piece_id=UQ4Y4BZZP6EAWUYPGUEF632BP4ZCAY4EE44EJMGASTASAAN4RJ2Q, seg_pos={0 0}, upload=65282]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF Sep 9 15:40:02.310300524 (74h11m38.349873654s) [noise=true , address=145.79.227.19:4077 , piece_id=LC65CQZS4S5P3GNKT3XTDTWS6CSSX2PUJIOAIPZ665OP2ZVMSQRA, seg_pos={0 0}, upload=65282]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Sep 9 15:40:02.310332626 (74h11m38.349905756s) [noise=true , address=45.91.116.14:4191 , piece_id=4Y3NEBFVAJDK6JWVXPNHK6ZUB7OBKYE5YNHYOXNBDYGUHTGOHRSA, seg_pos={0 0}, upload=65282]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq): protocol: write tcp 188.166.225.170:40104->45.91.116.14:4191: use of closed network connection; write tcp 188.166.225.170:40104->45.91.116.14:4191: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40104->45.91.116.14:4191: use of closed network connection Sep 9 15:40:02.310357874 (74h11m38.349931004s) [seg_pos={0 0}, upload=65282]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 15:40:02.310446905 (74h11m38.350020025s) [upload=65282]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 15:40:02.310452465 (74h11m38.350025595s) [upload=65282]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 15:40:02.758062881 (74h11m38.797636011s) [upload=65282]: Done uploading segments... Sep 9 15:40:02.758089773 (74h11m38.797662903s) [upload=65282]: Upload finished. err: <nil> Duration: 30.001423344s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 8 out of 60 is failed (threshold=3) [............XX...X.X.......X.X....X...................X.....] duration: 7.330920259s FAIL (2025-09-09 15:40:24 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.33095766s edge gateway us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 682.732782ms target: https://us1.storj.io/login FAIL (2025-09-09 15:40:05 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused Duration: 682.756908ms core satellite us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 2.683531845s FAIL (2025-09-09 15:39:58 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.683563104s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 40 out of 60 is failed (threshold=3) [...XXXX.......X.X.XXX.XX..XX.X.XX..X.XXXXXXXXXXXXXXXXXXXXXXX] duration: 30.002812056s FAIL (2025-09-09 15:39:34 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 15:39:04.718955874 (74h10m40.758529004s) [upload=65271]: Starting upload Sep 9 15:39:04.719026760 (74h10m40.75859988s) [upload=65271]: Done starting upload Sep 9 15:39:04.719135107 (74h10m40.758708227s) [upload=65271]: Uploading segments... Sep 9 15:39:04.719284964 (74h10m40.758858084s) [upload=65271]: Got next segment. Inline: false Sep 9 15:39:04.719323638 (74h10m40.758896758s) [upload=65271]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 15:39:04.719328959 (74h10m40.758902079s) [upload=65271]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 15:39:04.968852164 (74h10m41.008425304s) [seg_pos={0 0}, upload=65271]: Begin upload segment... Sep 9 15:39:04.968904805 (74h10m41.008477935s) [seg_pos={0 0}, upload=65271]: Done begin upload segment. Sep 9 15:39:04.969074501 (74h10m41.008647631s) [noise=true , address=45.91.116.11:4117 , piece_id=PHJLHJFIZ3NN6ZEB4SMAL3IZTPQYGAD22YWEBBPQAHHRYFMIVPWQ, seg_pos={0 0}, upload=65271]: Uploading piece... Sep 9 15:39:04.970192520 (74h10m41.00976564s) [noise=true , address=77.90.31.10:4520 , piece_id=JIXMYLL76CE6BBHRR3CSIP6ZLUPS57PVD6UTMDRITOIHGODLMRMQ, seg_pos={0 0}, upload=65271]: Uploading piece... Sep 9 15:39:04.970707135 (74h10m41.010280265s) [noise=true , address=45.91.116.4:4938 , piece_id=ZLXCKVDAMVVHQRO7BQGVO36ILTVYMKYRIM2LIHQGTPTOF3PH2RUQ, seg_pos={0 0}, upload=65271]: Uploading piece... Sep 9 15:39:04.971251365 (74h10m41.010824486s) [noise=true , address=45.91.116.6:4974 , piece_id=ENFULBU4WHINDEANOYKVHNR3XMHVPNS4YQBUANCKL3VSEU32SWFA, seg_pos={0 0}, upload=65271]: Uploading piece... Sep 9 15:39:04.972426375 (74h10m41.011999495s) [noise=true , address=145.79.227.13:4802 , piece_id=FHMTVWY537KQTXKUCNKJHXBR2CPBNVPIC7F5MJ4WTK5EZI2RWHDQ, seg_pos={0 0}, upload=65271]: Uploading piece... Sep 9 15:39:04.972766505 (74h10m41.012339625s) [noise=true , address=45.91.116.10:4081 , piece_id=556WTBPJSXZLMM3LLFWA6FFGAMKVA4O643V77QYTHIOMQDAMW3MQ, seg_pos={0 0}, upload=65271]: Uploading piece... Sep 9 15:39:04.973222568 (74h10m41.012795688s) [noise=true , address=145.79.227.16:4910 , piece_id=IUEORBHKSYSAU5EVLOWKNXFVPSNITHJOZFBL3FCWFHEVKSVJTPIA, seg_pos={0 0}, upload=65271]: Uploading piece... Sep 9 15:39:04.973545446 (74h10m41.013118576s) [noise=true , address=145.79.227.7:4294 , piece_id=JTGCIGYJGIYCEATOZUVHS2DJMMQZJCA3GUTWQCUH2IAIN6NN4UEA, seg_pos={0 0}, upload=65271]: Uploading piece... Sep 9 15:39:04.974530060 (74h10m41.01410319s) [noise=true , address=45.91.116.14:4189 , piece_id=IVSUFEBVET2GMDT7V5YG2VIN3ZJ4JDAAO3YKSVR5ENAPVWMKIWKQ, seg_pos={0 0}, upload=65271]: Uploading piece... Sep 9 15:39:04.974940145 (74h10m41.014513275s) [noise=true , address=77.90.31.18:4806 , piece_id=E3373H655HD66B2SMOQLS6ODSAKBWXJADHGVOQCEYBY2BZSXYGUA, seg_pos={0 0}, upload=65271]: Uploading piece... Sep 9 15:39:04.975299232 (74h10m41.014872352s) [noise=true , address=77.90.31.19:4842 , piece_id=MQY7JTRFYPMGKKH3NKZITAJS5TYWZXWRHERMYPPLJXLVBKOQKZDQ, seg_pos={0 0}, upload=65271]: Uploading piece... Sep 9 15:39:04.975741578 (74h10m41.015314698s) [noise=true , address=145.79.227.15:4875 , piece_id=ANSVE7YOTIADKT2WHA7B7SZ3OE2QHYOV5LJTSOT2KPR42XU2YUWA, seg_pos={0 0}, upload=65271]: Uploading piece... Sep 9 15:39:04.976090987 (74h10m41.015664107s) [noise=true , address=77.90.31.10:4517 , piece_id=3P4GNLOFRNEYECE3MNDWMZPBE4FH7OKRR6APK3KDZUY5JRRYVU5A, seg_pos={0 0}, upload=65271]: Uploading piece... Sep 9 15:39:04.976417572 (74h10m41.015990692s) [noise=true , address=45.91.116.7:4009 , piece_id=3Q62POIWI64POBDW6PH6ATO74OXZYPUHH566NWQ36VPNNGTT3COA, seg_pos={0 0}, upload=65271]: Uploading piece... Sep 9 15:39:04.976760929 (74h10m41.016334059s) [noise=true , address=77.90.31.14:4663 , piece_id=2QHZTK3YWJMCOS5Y6RSRPHIAGNWSR7SKU5U5LBAYBAJ426VM2N3A, seg_pos={0 0}, upload=65271]: Uploading piece... Sep 9 15:39:04.978172630 (74h10m41.01774576s) [noise=true , address=45.91.116.12:4227 , piece_id=NQCZBST3CXQENSOCCOF6JADPRJYUDIFVVQIH3SUGCRTFN4FQZVRA, seg_pos={0 0}, upload=65271]: Uploading piece... Sep 9 15:39:06.874049074 (74h10m42.913622194s) [upload=65271]: Next returned nil segment Sep 9 15:39:06.874064795 (74h10m42.913637915s) [upload=65271]: Waiting for error group managing segments... Sep 9 15:39:07.192071791 (74h10m43.231644921s) [noise=true , address=77.90.31.14:4663 , piece_id=2QHZTK3YWJMCOS5Y6RSRPHIAGNWSR7SKU5U5LBAYBAJ426VM2N3A, seg_pos={0 0}, upload=65271]: Done uploading piece. err: <nil> Sep 9 15:39:07.248708690 (74h10m43.28828181s) [noise=true , address=45.91.116.10:4081 , piece_id=556WTBPJSXZLMM3LLFWA6FFGAMKVA4O643V77QYTHIOMQDAMW3MQ, seg_pos={0 0}, upload=65271]: Done uploading piece. err: <nil> Sep 9 15:39:07.272251802 (74h10m43.311824922s) [noise=true , address=45.91.116.4:4938 , piece_id=ZLXCKVDAMVVHQRO7BQGVO36ILTVYMKYRIM2LIHQGTPTOF3PH2RUQ, seg_pos={0 0}, upload=65271]: Done uploading piece. err: <nil> Sep 9 15:39:07.303136644 (74h10m43.342709764s) [noise=true , address=77.90.31.10:4520 , piece_id=JIXMYLL76CE6BBHRR3CSIP6ZLUPS57PVD6UTMDRITOIHGODLMRMQ, seg_pos={0 0}, upload=65271]: Done uploading piece. err: <nil> Sep 9 15:39:07.346323926 (74h10m43.385897046s) [noise=true , address=77.90.31.18:4806 , piece_id=E3373H655HD66B2SMOQLS6ODSAKBWXJADHGVOQCEYBY2BZSXYGUA, seg_pos={0 0}, upload=65271]: Done uploading piece. err: <nil> Sep 9 15:39:07.365426771 (74h10m43.404999891s) [noise=true , address=77.90.31.10:4517 , piece_id=3P4GNLOFRNEYECE3MNDWMZPBE4FH7OKRR6APK3KDZUY5JRRYVU5A, seg_pos={0 0}, upload=65271]: Done uploading piece. err: <nil> Sep 9 15:39:07.374809916 (74h10m43.414383037s) [noise=true , address=45.91.116.11:4117 , piece_id=PHJLHJFIZ3NN6ZEB4SMAL3IZTPQYGAD22YWEBBPQAHHRYFMIVPWQ, seg_pos={0 0}, upload=65271]: Done uploading piece. err: <nil> Sep 9 15:39:07.410377488 (74h10m43.449950608s) [noise=true , address=77.90.31.19:4842 , piece_id=MQY7JTRFYPMGKKH3NKZITAJS5TYWZXWRHERMYPPLJXLVBKOQKZDQ, seg_pos={0 0}, upload=65271]: Done uploading piece. err: <nil> Sep 9 15:39:07.514807816 (74h10m43.554380946s) [noise=true , address=45.91.116.6:4974 , piece_id=ENFULBU4WHINDEANOYKVHNR3XMHVPNS4YQBUANCKL3VSEU32SWFA, seg_pos={0 0}, upload=65271]: Done uploading piece. err: <nil> Sep 9 15:39:07.521217692 (74h10m43.560790812s) [noise=true , address=145.79.227.7:4294 , piece_id=JTGCIGYJGIYCEATOZUVHS2DJMMQZJCA3GUTWQCUH2IAIN6NN4UEA, seg_pos={0 0}, upload=65271]: Done uploading piece. err: <nil> Sep 9 15:39:07.564936292 (74h10m43.604509412s) [noise=true , address=145.79.227.16:4910 , piece_id=IUEORBHKSYSAU5EVLOWKNXFVPSNITHJOZFBL3FCWFHEVKSVJTPIA, seg_pos={0 0}, upload=65271]: Done uploading piece. err: <nil> Sep 9 15:39:07.645638332 (74h10m43.685211452s) [noise=true , address=145.79.227.15:4875 , piece_id=ANSVE7YOTIADKT2WHA7B7SZ3OE2QHYOV5LJTSOT2KPR42XU2YUWA, seg_pos={0 0}, upload=65271]: Done uploading piece. err: <nil> Sep 9 15:39:07.794259532 (74h10m43.833832652s) [noise=true , address=145.79.227.13:4802 , piece_id=FHMTVWY537KQTXKUCNKJHXBR2CPBNVPIC7F5MJ4WTK5EZI2RWHDQ, seg_pos={0 0}, upload=65271]: Done uploading piece. err: <nil> Sep 9 15:39:07.794286544 (74h10m43.833859664s) [seg_pos={0 0}, upload=65271]: Segment reached optimal threshold of 13 pieces. Sep 9 15:39:07.794435971 (74h10m43.834009091s) [noise=true , address=45.91.116.7:4009 , piece_id=3Q62POIWI64POBDW6PH6ATO74OXZYPUHH566NWQ36VPNNGTT3COA, seg_pos={0 0}, upload=65271]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF Sep 9 15:39:07.794514219 (74h10m43.834087339s) [noise=true , address=45.91.116.12:4227 , piece_id=NQCZBST3CXQENSOCCOF6JADPRJYUDIFVVQIH3SUGCRTFN4FQZVRA, seg_pos={0 0}, upload=65271]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ETZh5HbRYk386nSYJSd4DvQ2XbMw5XBnyyPMfsxwHJaSHaQEH): protocol: expected piece hash; context canceled; EOF Sep 9 15:39:07.794600856 (74h10m43.834173976s) [noise=true , address=45.91.116.14:4189 , piece_id=IVSUFEBVET2GMDT7V5YG2VIN3ZJ4JDAAO3YKSVR5ENAPVWMKIWKQ, seg_pos={0 0}, upload=65271]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N): protocol: write tcp 188.166.225.170:38126->45.91.116.14:4189: use of closed network connection; write tcp 188.166.225.170:38126->45.91.116.14:4189: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38126->45.91.116.14:4189: use of closed network connection Sep 9 15:39:07.794623248 (74h10m43.834196368s) [seg_pos={0 0}, upload=65271]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 15:39:07.794715736 (74h10m43.834288856s) [upload=65271]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 15:39:07.794720505 (74h10m43.834293635s) [upload=65271]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 15:39:08.105935333 (74h10m44.145508443s) [upload=65271]: Done uploading segments... Sep 9 15:39:08.105953138 (74h10m44.145526258s) [upload=65271]: Upload finished. err: <nil> Duration: 30.002839557s core uplink us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 683.392215ms target: https://us1.storj.io/login FAIL (2025-09-09 15:39:21 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused Duration: 683.419627ms core satellite us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 8 out of 60 is failed (threshold=3) [.............XX...X.X.......X.X....X...................X....] duration: 6.865362279s FAIL (2025-09-09 15:39:16 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.865383029s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 2.427304352s FAIL (2025-09-09 15:39:10 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.427321164s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 39 out of 60 is failed (threshold=3) [....XXXX.......X.X.XXX.XX..XX.X.XX..X.XXXXXXXXXXXXXXXXXXXXXX] duration: 30.003192358s FAIL (2025-09-09 15:39:01 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 15:38:32.193478401 (74h10m8.233051521s) [upload=65264]: Starting upload Sep 9 15:38:32.193548725 (74h10m8.233121845s) [upload=65264]: Done starting upload Sep 9 15:38:32.193643647 (74h10m8.233216767s) [upload=65264]: Uploading segments... Sep 9 15:38:32.193724752 (74h10m8.233297872s) [upload=65264]: Got next segment. Inline: false Sep 9 15:38:32.193752355 (74h10m8.233325465s) [upload=65264]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 15:38:32.193756393 (74h10m8.233329513s) [upload=65264]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 15:38:32.738495991 (74h10m8.778069111s) [seg_pos={0 0}, upload=65264]: Begin upload segment... Sep 9 15:38:32.738542020 (74h10m8.77811514s) [seg_pos={0 0}, upload=65264]: Done begin upload segment. Sep 9 15:38:32.738564693 (74h10m8.778137803s) [noise=true , address=145.79.227.2:4114 , piece_id=7MCYWYTWPPFI6CAPJCIVKUCZ2N6ZL7GQKUR6E3TUIWLDY6YWJZZQ, seg_pos={0 0}, upload=65264]: Uploading piece... Sep 9 15:38:32.738671227 (74h10m8.778244347s) [noise=true , address=45.91.116.5:4298 , piece_id=6237EKSFZXVPWBBUKTAFXE7JAIF3IQI35XVPIXZ25KM7RSNMYDHQ, seg_pos={0 0}, upload=65264]: Uploading piece... Sep 9 15:38:32.738950141 (74h10m8.778523261s) [noise=true , address=77.90.31.15:4699 , piece_id=DZIN5OFGDAREIHGX5NAPGMSQZENPK2OFM7CWURZHHNUKQHVPEEKQ, seg_pos={0 0}, upload=65264]: Uploading piece... Sep 9 15:38:32.739140294 (74h10m8.778713414s) [noise=true , address=77.90.31.15:4698 , piece_id=ZKQT36TDYAKC3DE4QQCZXFJSLQQENP5ZCWH7L2HLKOEK2IM3Q6HA, seg_pos={0 0}, upload=65264]: Uploading piece... Sep 9 15:38:32.739280202 (74h10m8.778853322s) [noise=true , address=77.90.31.12:4590 , piece_id=SSJU4IVTZTEU35IMY22DS7RFRB2JHSKETTPA5ZTXFXNXSFBN4IIQ, seg_pos={0 0}, upload=65264]: Uploading piece... Sep 9 15:38:32.739554216 (74h10m8.779127336s) [noise=true , address=45.91.116.8:4045 , piece_id=VBEWFE6IVHUE3EYBXBWX4JJZHKVYOLKBOBMKIU4J3JFN6Q6A32FA, seg_pos={0 0}, upload=65264]: Uploading piece... Sep 9 15:38:32.739619772 (74h10m8.779192892s) [noise=true , address=45.91.116.4:4938 , piece_id=LZCTYU56WJO3DUERHSQLVHFPG3LVG2G6WYGZLB6UDJOHRF52AVPQ, seg_pos={0 0}, upload=65264]: Uploading piece... Sep 9 15:38:32.739836627 (74h10m8.779409747s) [noise=true , address=145.79.227.5:4223 , piece_id=KZI75AOWOM3YACQ3VRT33M5CPC5XVQY6DQ374TNFXK5MFHCST2HA, seg_pos={0 0}, upload=65264]: Uploading piece... Sep 9 15:38:32.740145238 (74h10m8.779718358s) [noise=true , address=77.90.31.14:4662 , piece_id=FSGFXIVSRR5WIBV5FAISXAZMGJVBGSJ5EPB3OI6EKXMOZA4TKZPQ, seg_pos={0 0}, upload=65264]: Uploading piece... Sep 9 15:38:32.740152181 (74h10m8.779725301s) [noise=true , address=145.79.227.18:4006 , piece_id=TLGRGMP23KIHRGDBUP3UU7EBH3UU6M4JUPEC3IWMSINVO4KIBCOA, seg_pos={0 0}, upload=65264]: Uploading piece... Sep 9 15:38:32.740378825 (74h10m8.779951945s) [noise=true , address=145.79.227.16:4912 , piece_id=JQIXTSBH2NQ2RKMEID5AF4U26PEK7QFQHSBB5GW53L2KISW6XSAA, seg_pos={0 0}, upload=65264]: Uploading piece... Sep 9 15:38:32.740438419 (74h10m8.780011539s) [noise=true , address=45.91.116.12:4225 , piece_id=HR7DDR37XF4H2AYGASIUHRCQARJYD3C4FVDW6LDJZRVY7ST7LWAA, seg_pos={0 0}, upload=65264]: Uploading piece... Sep 9 15:38:32.740619886 (74h10m8.780193006s) [noise=true , address=77.90.31.19:4843 , piece_id=GFOIDZMFILDSKKPBIJWS4TRWDGURQB2ZP7ZC2TXJYBJLXUFVMETQ, seg_pos={0 0}, upload=65264]: Uploading piece... Sep 9 15:38:32.740800371 (74h10m8.780373491s) [noise=true , address=45.91.116.14:4190 , piece_id=UP24DJUCPXOXUHTK5ZOSXXXABBGBK6YW7XBCH3ACOPBHFTLL5ARA, seg_pos={0 0}, upload=65264]: Uploading piece... Sep 9 15:38:32.740861468 (74h10m8.780434578s) [noise=true , address=77.90.31.10:4517 , piece_id=T5Z36YTUIVML4LMVFS3GBDPOY3D5CCV5LTU477V7QAY2ZUEE5ZJA, seg_pos={0 0}, upload=65264]: Uploading piece... Sep 9 15:38:32.741069306 (74h10m8.780642426s) [noise=true , address=45.91.116.10:4083 , piece_id=TKTS266BO5OADOGOCJOJYN3MW4UVAULWGOURE7CWWBO4CSOKFHCQ, seg_pos={0 0}, upload=65264]: Uploading piece... Sep 9 15:38:34.566056367 (74h10m10.605629487s) [upload=65264]: Next returned nil segment Sep 9 15:38:34.566083790 (74h10m10.6056569s) [upload=65264]: Waiting for error group managing segments... Sep 9 15:38:34.980311644 (74h10m11.019884774s) [noise=true , address=77.90.31.19:4843 , piece_id=GFOIDZMFILDSKKPBIJWS4TRWDGURQB2ZP7ZC2TXJYBJLXUFVMETQ, seg_pos={0 0}, upload=65264]: Done uploading piece. err: <nil> Sep 9 15:38:34.988630483 (74h10m11.028203603s) [noise=true , address=145.79.227.18:4006 , piece_id=TLGRGMP23KIHRGDBUP3UU7EBH3UU6M4JUPEC3IWMSINVO4KIBCOA, seg_pos={0 0}, upload=65264]: Done uploading piece. err: <nil> Sep 9 15:38:34.998239310 (74h10m11.03781243s) [noise=true , address=45.91.116.8:4045 , piece_id=VBEWFE6IVHUE3EYBXBWX4JJZHKVYOLKBOBMKIU4J3JFN6Q6A32FA, seg_pos={0 0}, upload=65264]: Done uploading piece. err: <nil> Sep 9 15:38:35.009622854 (74h10m11.049195974s) [noise=true , address=45.91.116.5:4298 , piece_id=6237EKSFZXVPWBBUKTAFXE7JAIF3IQI35XVPIXZ25KM7RSNMYDHQ, seg_pos={0 0}, upload=65264]: Done uploading piece. err: <nil> Sep 9 15:38:35.016469656 (74h10m11.056042776s) [noise=true , address=77.90.31.10:4517 , piece_id=T5Z36YTUIVML4LMVFS3GBDPOY3D5CCV5LTU477V7QAY2ZUEE5ZJA, seg_pos={0 0}, upload=65264]: Done uploading piece. err: <nil> Sep 9 15:38:35.058545161 (74h10m11.098118281s) [noise=true , address=77.90.31.15:4698 , piece_id=ZKQT36TDYAKC3DE4QQCZXFJSLQQENP5ZCWH7L2HLKOEK2IM3Q6HA, seg_pos={0 0}, upload=65264]: Done uploading piece. err: <nil> Sep 9 15:38:35.067640416 (74h10m11.107213546s) [noise=true , address=145.79.227.2:4114 , piece_id=7MCYWYTWPPFI6CAPJCIVKUCZ2N6ZL7GQKUR6E3TUIWLDY6YWJZZQ, seg_pos={0 0}, upload=65264]: Done uploading piece. err: <nil> Sep 9 15:38:35.087720140 (74h10m11.12729328s) [noise=true , address=45.91.116.4:4938 , piece_id=LZCTYU56WJO3DUERHSQLVHFPG3LVG2G6WYGZLB6UDJOHRF52AVPQ, seg_pos={0 0}, upload=65264]: Done uploading piece. err: <nil> Sep 9 15:38:35.135832167 (74h10m11.175405287s) [noise=true , address=77.90.31.15:4699 , piece_id=DZIN5OFGDAREIHGX5NAPGMSQZENPK2OFM7CWURZHHNUKQHVPEEKQ, seg_pos={0 0}, upload=65264]: Done uploading piece. err: <nil> Sep 9 15:38:35.212575702 (74h10m11.252148823s) [noise=true , address=145.79.227.5:4223 , piece_id=KZI75AOWOM3YACQ3VRT33M5CPC5XVQY6DQ374TNFXK5MFHCST2HA, seg_pos={0 0}, upload=65264]: Done uploading piece. err: <nil> Sep 9 15:38:35.249460795 (74h10m11.289033915s) [noise=true , address=77.90.31.12:4590 , piece_id=SSJU4IVTZTEU35IMY22DS7RFRB2JHSKETTPA5ZTXFXNXSFBN4IIQ, seg_pos={0 0}, upload=65264]: Done uploading piece. err: <nil> Sep 9 15:38:35.388860108 (74h10m11.428433308s) [noise=true , address=145.79.227.16:4912 , piece_id=JQIXTSBH2NQ2RKMEID5AF4U26PEK7QFQHSBB5GW53L2KISW6XSAA, seg_pos={0 0}, upload=65264]: Done uploading piece. err: <nil> Sep 9 15:38:35.421425335 (74h10m11.460998455s) [noise=true , address=77.90.31.14:4662 , piece_id=FSGFXIVSRR5WIBV5FAISXAZMGJVBGSJ5EPB3OI6EKXMOZA4TKZPQ, seg_pos={0 0}, upload=65264]: Done uploading piece. err: <nil> Sep 9 15:38:35.421451054 (74h10m11.461024174s) [seg_pos={0 0}, upload=65264]: Segment reached optimal threshold of 13 pieces. Sep 9 15:38:35.421615599 (74h10m11.461188719s) [noise=true , address=45.91.116.14:4190 , piece_id=UP24DJUCPXOXUHTK5ZOSXXXABBGBK6YW7XBCH3ACOPBHFTLL5ARA, seg_pos={0 0}, upload=65264]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Sep 9 15:38:35.421627572 (74h10m11.461200692s) [noise=true , address=45.91.116.10:4083 , piece_id=TKTS266BO5OADOGOCJOJYN3MW4UVAULWGOURE7CWWBO4CSOKFHCQ, seg_pos={0 0}, upload=65264]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Sep 9 15:38:35.421689911 (74h10m11.461263031s) [noise=true , address=45.91.116.12:4225 , piece_id=HR7DDR37XF4H2AYGASIUHRCQARJYD3C4FVDW6LDJZRVY7ST7LWAA, seg_pos={0 0}, upload=65264]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy): protocol: write tcp 188.166.225.170:41498->45.91.116.12:4225: use of closed network connection; write tcp 188.166.225.170:41498->45.91.116.12:4225: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41498->45.91.116.12:4225: use of closed network connection Sep 9 15:38:35.421712735 (74h10m11.461285855s) [seg_pos={0 0}, upload=65264]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 15:38:35.421783330 (74h10m11.46135645s) [upload=65264]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 15:38:35.421787818 (74h10m11.461360938s) [upload=65264]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 15:38:35.751837249 (74h10m11.791410389s) [upload=65264]: Done uploading segments... Sep 9 15:38:35.751857347 (74h10m11.791430477s) [upload=65264]: Upload finished. err: <nil> Duration: 30.003223188s core uplink us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 685.985447ms target: https://us1.storj.io/login FAIL (2025-09-09 15:38:36 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused Duration: 686.01338ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 38 out of 60 is failed (threshold=3) [.....XXXX.......X.X.XXX.XX..XX.X.XX..X.XXXXXXXXXXXXXXXXXXXXX] duration: 30.002585573s FAIL (2025-09-09 15:38:22 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 15:37:52.902817454 (74h9m28.942390574s) [upload=65257]: Starting upload Sep 9 15:37:52.902865967 (74h9m28.942439087s) [upload=65257]: Done starting upload Sep 9 15:37:52.903042475 (74h9m28.942615595s) [upload=65257]: Uploading segments... Sep 9 15:37:52.903094715 (74h9m28.942667835s) [upload=65257]: Got next segment. Inline: false Sep 9 15:37:52.903120364 (74h9m28.942693484s) [upload=65257]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 15:37:52.903124341 (74h9m28.942697461s) [upload=65257]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 15:37:53.147467726 (74h9m29.187040846s) [seg_pos={0 0}, upload=65257]: Begin upload segment... Sep 9 15:37:53.147508193 (74h9m29.187081313s) [seg_pos={0 0}, upload=65257]: Done begin upload segment. Sep 9 15:37:53.147530085 (74h9m29.187103195s) [noise=true , address=45.91.116.4:4937 , piece_id=DJIFKOLC5FMWM3L6P3ILAXIBSUKMWWK7ECPJMTWSD52WJFR33DFQ, seg_pos={0 0}, upload=65257]: Uploading piece... Sep 9 15:37:53.147600160 (74h9m29.18717332s) [noise=true , address=77.90.31.12:4589 , piece_id=HBIE5HDW25CGL4AQ5MJWR7624YP2Z5BOLRXCAQZSMPX2SHS227KQ, seg_pos={0 0}, upload=65257]: Uploading piece... Sep 9 15:37:53.148053296 (74h9m29.187626476s) [noise=true , address=77.90.31.10:4519 , piece_id=HQHKWDCTXLQ3U3YD726K3HXB7J4TSTD4RJEL3GYJ5FYYGTND3PBQ, seg_pos={0 0}, upload=65257]: Uploading piece... Sep 9 15:37:53.148172825 (74h9m29.187745945s) [noise=true , address=77.90.31.16:4733 , piece_id=HBHGPIZLYZWC7SQR54OFRPSZ4BT7J7ABD5OXQOL6R6PYVMIA5GHA, seg_pos={0 0}, upload=65257]: Uploading piece... Sep 9 15:37:53.148784405 (74h9m29.188357535s) [noise=true , address=45.91.116.9:4263 , piece_id=JYLEGN4Y52NZW6YMRJPPKUUENTZXCDOVF24PFRIPA2IN45LYH35A, seg_pos={0 0}, upload=65257]: Uploading piece... Sep 9 15:37:53.148950303 (74h9m29.188523473s) [noise=true , address=45.91.116.6:4973 , piece_id=NCLY22RM4CUAFWXGWITQUYVFRFSNCYM5RLHW6Z4L7H5GXAZY5IXA, seg_pos={0 0}, upload=65257]: Uploading piece... Sep 9 15:37:53.149113856 (74h9m29.188686976s) [noise=true , address=45.91.116.12:4225 , piece_id=LQVF5KEY2KOOYTQ7VDRWRGUE2XAZPZKGKEVHHOKLCDV2MVXPAUGA, seg_pos={0 0}, upload=65257]: Uploading piece... Sep 9 15:37:53.149221411 (74h9m29.188794532s) [noise=true , address=45.91.116.14:4191 , piece_id=HV3SDFWTZKBYT66ITJN4QHHONZINRDXMRIPUV7BKBOXQYIQQA7UA, seg_pos={0 0}, upload=65257]: Uploading piece... Sep 9 15:37:53.149396808 (74h9m29.188969928s) [noise=true , address=45.91.116.7:4009 , piece_id=5PBRPV4BK7632T2NJ43T2JNXMOWVPXPRNWDKLGP4O57SP6VEHR6Q, seg_pos={0 0}, upload=65257]: Uploading piece... Sep 9 15:37:53.149617079 (74h9m29.189190199s) [noise=true , address=45.91.116.13:4154 , piece_id=KR23L3ZFCIID4Y5WQ6GOVPFJEYOAY3A3N7IJWWQRGZVPMB4JTR5Q, seg_pos={0 0}, upload=65257]: Uploading piece... Sep 9 15:37:53.149676382 (74h9m29.189249502s) [noise=true , address=45.91.116.8:4047 , piece_id=2QDIW2VYD6WWKCCL6PTS3PUWMWCE7QJXQ72THRKNN4ZCZZU4NRWQ, seg_pos={0 0}, upload=65257]: Uploading piece... Sep 9 15:37:53.149979362 (74h9m29.189552482s) [noise=true , address=77.90.31.15:4697 , piece_id=EPAYVVYERMWLW6CLZUST72AUEAX6UQW35TBNI7EO24LQK6FF5LUQ, seg_pos={0 0}, upload=65257]: Uploading piece... Sep 9 15:37:53.150698478 (74h9m29.190271598s) [noise=true , address=45.91.116.12:4227 , piece_id=VJV5PRQQXFZEDHUMSSCRWGWJXE6OENBEMNEI7BPZBLWBIW7QFW4Q, seg_pos={0 0}, upload=65257]: Uploading piece... Sep 9 15:37:53.151169390 (74h9m29.19074251s) [noise=true , address=77.90.31.13:4627 , piece_id=DFXQOFHAWNU32XSRQSOSBUGXD4HVHYS3S2YKYCOPCZMTYZYPRZ5A, seg_pos={0 0}, upload=65257]: Uploading piece... Sep 9 15:37:53.151426812 (74h9m29.190999932s) [noise=true , address=77.90.31.18:4805 , piece_id=A7F63YDUVOWYHEUDBQIT56I5KH353SF54PJUV6MTR6VAFEI2EFAQ, seg_pos={0 0}, upload=65257]: Uploading piece... Sep 9 15:37:53.151648286 (74h9m29.191221406s) [noise=true , address=77.90.31.21:4877 , piece_id=ITBPXENEYYYR5FKOC752OPVEULDSFD23SP44XLS7XTHJX2LG7XIQ, seg_pos={0 0}, upload=65257]: Uploading piece... Sep 9 15:37:55.044900218 (74h9m31.084473338s) [upload=65257]: Next returned nil segment Sep 9 15:37:55.044917761 (74h9m31.084490881s) [upload=65257]: Waiting for error group managing segments... Sep 9 15:37:55.353951025 (74h9m31.393524145s) [noise=true , address=45.91.116.12:4227 , piece_id=VJV5PRQQXFZEDHUMSSCRWGWJXE6OENBEMNEI7BPZBLWBIW7QFW4Q, seg_pos={0 0}, upload=65257]: Done uploading piece. err: <nil> Sep 9 15:37:55.354034405 (74h9m31.393607525s) [noise=true , address=77.90.31.18:4805 , piece_id=A7F63YDUVOWYHEUDBQIT56I5KH353SF54PJUV6MTR6VAFEI2EFAQ, seg_pos={0 0}, upload=65257]: Done uploading piece. err: <nil> Sep 9 15:37:55.385417630 (74h9m31.42499076s) [noise=true , address=77.90.31.13:4627 , piece_id=DFXQOFHAWNU32XSRQSOSBUGXD4HVHYS3S2YKYCOPCZMTYZYPRZ5A, seg_pos={0 0}, upload=65257]: Done uploading piece. err: <nil> Sep 9 15:37:55.393283452 (74h9m31.432856572s) [noise=true , address=45.91.116.8:4047 , piece_id=2QDIW2VYD6WWKCCL6PTS3PUWMWCE7QJXQ72THRKNN4ZCZZU4NRWQ, seg_pos={0 0}, upload=65257]: Done uploading piece. err: <nil> Sep 9 15:37:55.398565610 (74h9m31.43813873s) [noise=true , address=45.91.116.4:4937 , piece_id=DJIFKOLC5FMWM3L6P3ILAXIBSUKMWWK7ECPJMTWSD52WJFR33DFQ, seg_pos={0 0}, upload=65257]: Done uploading piece. err: <nil> Sep 9 15:37:55.424407661 (74h9m31.463980781s) [noise=true , address=45.91.116.6:4973 , piece_id=NCLY22RM4CUAFWXGWITQUYVFRFSNCYM5RLHW6Z4L7H5GXAZY5IXA, seg_pos={0 0}, upload=65257]: Done uploading piece. err: <nil> Sep 9 15:37:55.446233496 (74h9m31.485806626s) [noise=true , address=45.91.116.9:4263 , piece_id=JYLEGN4Y52NZW6YMRJPPKUUENTZXCDOVF24PFRIPA2IN45LYH35A, seg_pos={0 0}, upload=65257]: Done uploading piece. err: <nil> Sep 9 15:37:55.460111112 (74h9m31.499684233s) [noise=true , address=77.90.31.15:4697 , piece_id=EPAYVVYERMWLW6CLZUST72AUEAX6UQW35TBNI7EO24LQK6FF5LUQ, seg_pos={0 0}, upload=65257]: Done uploading piece. err: <nil> Sep 9 15:37:55.461271043 (74h9m31.500844173s) [noise=true , address=77.90.31.10:4519 , piece_id=HQHKWDCTXLQ3U3YD726K3HXB7J4TSTD4RJEL3GYJ5FYYGTND3PBQ, seg_pos={0 0}, upload=65257]: Done uploading piece. err: <nil> Sep 9 15:37:55.492271905 (74h9m31.531845025s) [noise=true , address=45.91.116.13:4154 , piece_id=KR23L3ZFCIID4Y5WQ6GOVPFJEYOAY3A3N7IJWWQRGZVPMB4JTR5Q, seg_pos={0 0}, upload=65257]: Done uploading piece. err: <nil> Sep 9 15:37:55.493061246 (74h9m31.532634366s) [noise=true , address=77.90.31.21:4877 , piece_id=ITBPXENEYYYR5FKOC752OPVEULDSFD23SP44XLS7XTHJX2LG7XIQ, seg_pos={0 0}, upload=65257]: Done uploading piece. err: <nil> Sep 9 15:37:55.498508910 (74h9m31.538082031s) [noise=true , address=45.91.116.7:4009 , piece_id=5PBRPV4BK7632T2NJ43T2JNXMOWVPXPRNWDKLGP4O57SP6VEHR6Q, seg_pos={0 0}, upload=65257]: Done uploading piece. err: <nil> Sep 9 15:37:55.503770058 (74h9m31.543343178s) [noise=true , address=45.91.116.12:4225 , piece_id=LQVF5KEY2KOOYTQ7VDRWRGUE2XAZPZKGKEVHHOKLCDV2MVXPAUGA, seg_pos={0 0}, upload=65257]: Done uploading piece. err: <nil> Sep 9 15:37:55.503792421 (74h9m31.543365541s) [seg_pos={0 0}, upload=65257]: Segment reached optimal threshold of 13 pieces. Sep 9 15:37:55.504005268 (74h9m31.543578388s) [noise=true , address=45.91.116.14:4191 , piece_id=HV3SDFWTZKBYT66ITJN4QHHONZINRDXMRIPUV7BKBOXQYIQQA7UA, seg_pos={0 0}, upload=65257]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq): protocol: write tcp 188.166.225.170:40392->45.91.116.14:4191: use of closed network connection; write tcp 188.166.225.170:40392->45.91.116.14:4191: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40392->45.91.116.14:4191: use of closed network connection Sep 9 15:37:55.504047669 (74h9m31.543620789s) [noise=true , address=77.90.31.16:4733 , piece_id=HBHGPIZLYZWC7SQR54OFRPSZ4BT7J7ABD5OXQOL6R6PYVMIA5GHA, seg_pos={0 0}, upload=65257]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: write tcp 188.166.225.170:56430->77.90.31.16:4733: use of closed network connection; write tcp 188.166.225.170:56430->77.90.31.16:4733: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56430->77.90.31.16:4733: use of closed network connection Sep 9 15:37:55.504084269 (74h9m31.543657389s) [noise=true , address=77.90.31.12:4589 , piece_id=HBIE5HDW25CGL4AQ5MJWR7624YP2Z5BOLRXCAQZSMPX2SHS227KQ, seg_pos={0 0}, upload=65257]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv): protocol: expected piece hash; context canceled; EOF Sep 9 15:37:55.504132181 (74h9m31.543705301s) [seg_pos={0 0}, upload=65257]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 15:37:55.504215060 (74h9m31.54378818s) [upload=65257]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 15:37:55.504221702 (74h9m31.543794832s) [upload=65257]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 15:37:55.807393020 (74h9m31.84696614s) [upload=65257]: Done uploading segments... Sep 9 15:37:55.807412466 (74h9m31.846985596s) [upload=65257]: Upload finished. err: <nil> Duration: 30.002600031s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 8 out of 60 is failed (threshold=3) [..............XX...X.X.......X.X....X...................X...] duration: 6.703671402s FAIL (2025-09-09 15:38:11 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.703689838s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 2.905822779s FAIL (2025-09-09 15:38:07 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.905845022s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 38 out of 60 is failed (threshold=3) [X.....XXXX.......X.X.XXX.XX..XX.X.XX..X.XXXXXXXXXXXXXXXXXXXX] duration: 30.003486568s FAIL (2025-09-09 15:37:51 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 15:37:22.636596360 (74h8m58.67616948s) [upload=65249]: Starting upload Sep 9 15:37:22.636656004 (74h8m58.676229124s) [upload=65249]: Done starting upload Sep 9 15:37:22.636757228 (74h8m58.676330348s) [upload=65249]: Uploading segments... Sep 9 15:37:22.636934197 (74h8m58.676507317s) [upload=65249]: Got next segment. Inline: false Sep 9 15:37:22.636968632 (74h8m58.676541742s) [upload=65249]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 15:37:22.636973381 (74h8m58.676546501s) [upload=65249]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 15:37:22.909751247 (74h8m58.949324368s) [seg_pos={0 0}, upload=65249]: Begin upload segment... Sep 9 15:37:22.909791995 (74h8m58.949365115s) [seg_pos={0 0}, upload=65249]: Done begin upload segment. Sep 9 15:37:22.909924699 (74h8m58.949497819s) [noise=true , address=77.90.31.21:4878 , piece_id=VNRBIMPK3BHST4AP5NTHPJO6H5RNF4FO33RUICBTBQQVWC4ZZRFQ, seg_pos={0 0}, upload=65249]: Uploading piece... Sep 9 15:37:22.909945068 (74h8m58.949518188s) [noise=true , address=77.90.31.17:4771 , piece_id=RML34DVTYEMMXMTEJDOC5J2AOPNO2YRTGN7AABJTST3BKXADPL3Q, seg_pos={0 0}, upload=65249]: Uploading piece... Sep 9 15:37:22.910332950 (74h8m58.94990607s) [noise=true , address=45.91.116.6:4975 , piece_id=G7EEHL3TGT67FRH4XATYORSNZEHXUTSEBTM7A4JST7KGF4DS44WA, seg_pos={0 0}, upload=65249]: Uploading piece... Sep 9 15:37:22.910401813 (74h8m58.949974923s) [noise=true , address=77.90.31.16:4733 , piece_id=3PTDSYR3MLEOYY6B3QSCOACAZX2YYVUHAGS7JQULRDCVSD3WRK3A, seg_pos={0 0}, upload=65249]: Uploading piece... Sep 9 15:37:22.910777250 (74h8m58.95035037s) [noise=true , address=145.79.227.11:4730 , piece_id=YZT6B6MEUWGPUICGRDF34NXD76IISRYZKCSBAWPS2LAGKUFL6MOQ, seg_pos={0 0}, upload=65249]: Uploading piece... Sep 9 15:37:22.911279652 (74h8m58.950852772s) [noise=true , address=77.90.31.19:4842 , piece_id=WJH5OMRR65EM7IBSZB6VLQX4QWSJPIRXDIFKS3DHYBPT2RM26J7Q, seg_pos={0 0}, upload=65249]: Uploading piece... Sep 9 15:37:22.911447533 (74h8m58.951020643s) [noise=true , address=45.91.116.5:4298 , piece_id=2EYVXWNXKJ7BT6XS6I22CA6OQMUPVUB254JSHDT5CUJXOX7MC2QQ, seg_pos={0 0}, upload=65249]: Uploading piece... Sep 9 15:37:22.911561852 (74h8m58.951134962s) [noise=true , address=45.91.116.9:4262 , piece_id=G5BMA4XEEKFNBSCDLCTADFKCEFSLANGKAQHGLZSNTVXS7XQ547WQ, seg_pos={0 0}, upload=65249]: Uploading piece... Sep 9 15:37:22.912077248 (74h8m58.951650368s) [noise=true , address=45.91.116.13:4155 , piece_id=E7FE24OEUOZFNXOL7HS4UYIPUVS6CRGAWIPS5AM3PE4DQLP2H7NA, seg_pos={0 0}, upload=65249]: Uploading piece... Sep 9 15:37:22.912690191 (74h8m58.952263311s) [noise=true , address=145.79.227.16:4910 , piece_id=STF7HYESX4Q5SMKORRMDAO3XR3TGUK5XMCNBKGWEMFVP5XZFCHBQ, seg_pos={0 0}, upload=65249]: Uploading piece... Sep 9 15:37:22.913024802 (74h8m58.952597922s) [noise=true , address=45.91.116.8:4048 , piece_id=TBIABCPORCISDFSMQ3Y7G37DZ54AIKCC3SXUDDJ7J7A2GXQ5Y2QA, seg_pos={0 0}, upload=65249]: Uploading piece... Sep 9 15:37:22.913077082 (74h8m58.952650202s) [noise=true , address=145.79.227.6:4259 , piece_id=B4LW4SHUJIQ7Y3HFI2NMEFUGAFUEJKUGFQU7OVPFWPUZLLDUWAFQ, seg_pos={0 0}, upload=65249]: Uploading piece... Sep 9 15:37:22.913370533 (74h8m58.952943653s) [noise=true , address=45.91.116.4:4940 , piece_id=SXOCQDIZKSWN2VVNDSWXMTLHXCZXDXVUMA46AZKGRTU5IPIVTLCQ, seg_pos={0 0}, upload=65249]: Uploading piece... Sep 9 15:37:22.913612706 (74h8m58.953185826s) [noise=true , address=45.91.116.10:4083 , piece_id=XJHROTKGVR2XVQSZN5BGANSYBNJTVFV7DU3XMFOHAITLZXL477BA, seg_pos={0 0}, upload=65249]: Uploading piece... Sep 9 15:37:22.913868126 (74h8m58.953441236s) [noise=true , address=45.91.116.12:4225 , piece_id=2LZ6UOMYRIVA6NAY33NZZ7VUIQVFHJGVVKK2TP646XXZR7ME4HHQ, seg_pos={0 0}, upload=65249]: Uploading piece... Sep 9 15:37:22.914254214 (74h8m58.953827334s) [noise=true , address=45.91.116.11:4117 , piece_id=DITSFBWVDUFOGIYZTNS5OC7XHU44RXCU7F7FIWFFDPTQTK4BCHJQ, seg_pos={0 0}, upload=65249]: Uploading piece... Sep 9 15:37:24.774761578 (74h9m0.814334708s) [upload=65249]: Next returned nil segment Sep 9 15:37:24.774782528 (74h9m0.814355648s) [upload=65249]: Waiting for error group managing segments... Sep 9 15:37:25.130894381 (74h9m1.170467501s) [noise=true , address=45.91.116.5:4298 , piece_id=2EYVXWNXKJ7BT6XS6I22CA6OQMUPVUB254JSHDT5CUJXOX7MC2QQ, seg_pos={0 0}, upload=65249]: Done uploading piece. err: <nil> Sep 9 15:37:25.148415870 (74h9m1.18798899s) [noise=true , address=45.91.116.4:4940 , piece_id=SXOCQDIZKSWN2VVNDSWXMTLHXCZXDXVUMA46AZKGRTU5IPIVTLCQ, seg_pos={0 0}, upload=65249]: Done uploading piece. err: <nil> Sep 9 15:37:25.158739967 (74h9m1.198313087s) [noise=true , address=45.91.116.11:4117 , piece_id=DITSFBWVDUFOGIYZTNS5OC7XHU44RXCU7F7FIWFFDPTQTK4BCHJQ, seg_pos={0 0}, upload=65249]: Done uploading piece. err: <nil> Sep 9 15:37:25.171767636 (74h9m1.211340746s) [noise=true , address=145.79.227.16:4910 , piece_id=STF7HYESX4Q5SMKORRMDAO3XR3TGUK5XMCNBKGWEMFVP5XZFCHBQ, seg_pos={0 0}, upload=65249]: Done uploading piece. err: <nil> Sep 9 15:37:25.183781726 (74h9m1.223354846s) [noise=true , address=145.79.227.6:4259 , piece_id=B4LW4SHUJIQ7Y3HFI2NMEFUGAFUEJKUGFQU7OVPFWPUZLLDUWAFQ, seg_pos={0 0}, upload=65249]: Done uploading piece. err: <nil> Sep 9 15:37:25.195887512 (74h9m1.235460632s) [noise=true , address=145.79.227.11:4730 , piece_id=YZT6B6MEUWGPUICGRDF34NXD76IISRYZKCSBAWPS2LAGKUFL6MOQ, seg_pos={0 0}, upload=65249]: Done uploading piece. err: <nil> Sep 9 15:37:25.199715276 (74h9m1.239288396s) [noise=true , address=45.91.116.13:4155 , piece_id=E7FE24OEUOZFNXOL7HS4UYIPUVS6CRGAWIPS5AM3PE4DQLP2H7NA, seg_pos={0 0}, upload=65249]: Done uploading piece. err: <nil> Sep 9 15:37:25.235650341 (74h9m1.275223461s) [noise=true , address=45.91.116.9:4262 , piece_id=G5BMA4XEEKFNBSCDLCTADFKCEFSLANGKAQHGLZSNTVXS7XQ547WQ, seg_pos={0 0}, upload=65249]: Done uploading piece. err: <nil> Sep 9 15:37:25.243963479 (74h9m1.283536589s) [noise=true , address=45.91.116.12:4225 , piece_id=2LZ6UOMYRIVA6NAY33NZZ7VUIQVFHJGVVKK2TP646XXZR7ME4HHQ, seg_pos={0 0}, upload=65249]: Done uploading piece. err: <nil> Sep 9 15:37:25.311317638 (74h9m1.350890758s) [noise=true , address=77.90.31.21:4878 , piece_id=VNRBIMPK3BHST4AP5NTHPJO6H5RNF4FO33RUICBTBQQVWC4ZZRFQ, seg_pos={0 0}, upload=65249]: Done uploading piece. err: <nil> Sep 9 15:37:25.327645793 (74h9m1.367218923s) [noise=true , address=45.91.116.8:4048 , piece_id=TBIABCPORCISDFSMQ3Y7G37DZ54AIKCC3SXUDDJ7J7A2GXQ5Y2QA, seg_pos={0 0}, upload=65249]: Done uploading piece. err: <nil> Sep 9 15:37:25.338612028 (74h9m1.378185138s) [noise=true , address=77.90.31.19:4842 , piece_id=WJH5OMRR65EM7IBSZB6VLQX4QWSJPIRXDIFKS3DHYBPT2RM26J7Q, seg_pos={0 0}, upload=65249]: Done uploading piece. err: <nil> Sep 9 15:37:25.514615367 (74h9m1.554188487s) [noise=true , address=45.91.116.10:4083 , piece_id=XJHROTKGVR2XVQSZN5BGANSYBNJTVFV7DU3XMFOHAITLZXL477BA, seg_pos={0 0}, upload=65249]: Done uploading piece. err: <nil> Sep 9 15:37:25.514644012 (74h9m1.554217132s) [seg_pos={0 0}, upload=65249]: Segment reached optimal threshold of 13 pieces. Sep 9 15:37:25.514834136 (74h9m1.554407256s) [noise=true , address=77.90.31.17:4771 , piece_id=RML34DVTYEMMXMTEJDOC5J2AOPNO2YRTGN7AABJTST3BKXADPL3Q, seg_pos={0 0}, upload=65249]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2): protocol: expected piece hash; context canceled; EOF Sep 9 15:37:25.514914059 (74h9m1.554487179s) [noise=true , address=77.90.31.16:4733 , piece_id=3PTDSYR3MLEOYY6B3QSCOACAZX2YYVUHAGS7JQULRDCVSD3WRK3A, seg_pos={0 0}, upload=65249]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: write tcp 188.166.225.170:54116->77.90.31.16:4733: use of closed network connection; write tcp 188.166.225.170:54116->77.90.31.16:4733: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54116->77.90.31.16:4733: use of closed network connection Sep 9 15:37:25.514953233 (74h9m1.554526353s) [noise=true , address=45.91.116.6:4975 , piece_id=G7EEHL3TGT67FRH4XATYORSNZEHXUTSEBTM7A4JST7KGF4DS44WA, seg_pos={0 0}, upload=65249]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: write tcp 188.166.225.170:56310->45.91.116.6:4975: use of closed network connection; write tcp 188.166.225.170:56310->45.91.116.6:4975: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56310->45.91.116.6:4975: use of closed network connection Sep 9 15:37:25.515001285 (74h9m1.554574405s) [seg_pos={0 0}, upload=65249]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 15:37:25.515083803 (74h9m1.554656923s) [upload=65249]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 15:37:25.515088342 (74h9m1.554661462s) [upload=65249]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 15:37:25.837698398 (74h9m1.877271518s) [upload=65249]: Done uploading segments... Sep 9 15:37:25.837715971 (74h9m1.877289091s) [upload=65249]: Upload finished. err: <nil> Duration: 30.003519311s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 8 out of 60 is failed (threshold=3) [...............XX...X.X.......X.X....X...................X..] duration: 24.809572927s FAIL (2025-09-09 15:37:43 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 24.809594087s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 2.620727484s FAIL (2025-09-09 15:37:38 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.620750228s edge gateway us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 693.49189ms target: https://us1.storj.io/login FAIL (2025-09-09 15:37:28 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused Duration: 693.515586ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 38 out of 60 is failed (threshold=3) [XX.....XXXX.......X.X.XXX.XX..XX.X.XX..X.XXXXXXXXXXXXXXXXXXX] duration: 30.002591145s FAIL (2025-09-09 15:37:11 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 15:36:41.948310926 (74h8m17.987884046s) [upload=65240]: Starting upload Sep 9 15:36:41.948373746 (74h8m17.987946866s) [upload=65240]: Done starting upload Sep 9 15:36:41.948518453 (74h8m17.988091573s) [upload=65240]: Uploading segments... Sep 9 15:36:41.948610559 (74h8m17.988183679s) [upload=65240]: Got next segment. Inline: false Sep 9 15:36:41.948653341 (74h8m17.988226462s) [upload=65240]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 15:36:41.948657640 (74h8m17.98823076s) [upload=65240]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 15:36:42.206251799 (74h8m18.245824919s) [seg_pos={0 0}, upload=65240]: Begin upload segment... Sep 9 15:36:42.206296385 (74h8m18.245869505s) [seg_pos={0 0}, upload=65240]: Done begin upload segment. Sep 9 15:36:42.206323637 (74h8m18.245896757s) [noise=true , address=77.90.31.14:4663 , piece_id=6H6PT2H3NO4OV4XNQAR7JTCAGFMRJ77UGHO5VLOZDY66CEMQWJBQ, seg_pos={0 0}, upload=65240]: Uploading piece... Sep 9 15:36:42.206330720 (74h8m18.24590384s) [noise=true , address=45.91.116.8:4045 , piece_id=OHRP5VYOWJDHGMTMMEVWCK25ASVT52JL7DSSFFSTH3UJEWFK7QFA, seg_pos={0 0}, upload=65240]: Uploading piece... Sep 9 15:36:42.206748230 (74h8m18.24632135s) [noise=true , address=45.91.116.10:4081 , piece_id=DE3GWU7R3XKEDU43MPDMEHEMIEHX2XLDG2BBGTSTRA7JV4NHKFFA, seg_pos={0 0}, upload=65240]: Uploading piece... Sep 9 15:36:42.206895571 (74h8m18.246468701s) [noise=true , address=45.91.116.6:4975 , piece_id=3HLR7OB3KZRAGHUYOIC7S76JJLLKYNRCBON3LTTFIHR7NWLGA63Q, seg_pos={0 0}, upload=65240]: Uploading piece... Sep 9 15:36:42.206995052 (74h8m18.246568172s) [noise=true , address=45.91.116.7:4009 , piece_id=ZGMIN6S66PCTST5IODNAIBT3UGKF2XN5RKY2VGUZ4PNPIZQ5HS5Q, seg_pos={0 0}, upload=65240]: Uploading piece... Sep 9 15:36:42.207348538 (74h8m18.246921659s) [noise=true , address=45.91.116.5:4299 , piece_id=EX4RRJZNANVXFHRVSNIR57TTBIMJGPXXYGQPBLCIRTSI53UN4GZQ, seg_pos={0 0}, upload=65240]: Uploading piece... Sep 9 15:36:42.207501861 (74h8m18.247074981s) [noise=true , address=45.91.116.10:4082 , piece_id=GIH6OZUP66G3DPXR2RXBL5YLH6YEPJPLBLJDL5FMBXLNSEHH2SQQ, seg_pos={0 0}, upload=65240]: Uploading piece... Sep 9 15:36:42.207717223 (74h8m18.247290343s) [noise=true , address=77.90.31.13:4627 , piece_id=AUBWJDAHDCBFKH53XO5H2ZP75653RLKAUH7FGBYKI7IJ3EW2XMRQ, seg_pos={0 0}, upload=65240]: Uploading piece... Sep 9 15:36:42.207911856 (74h8m18.247484976s) [noise=true , address=77.90.31.21:4878 , piece_id=PCIV5MNJCFVWPY6LBIDKQTNMGT24VGYQOKWATWKXGXA4ZEFJOZVA, seg_pos={0 0}, upload=65240]: Uploading piece... Sep 9 15:36:42.208088324 (74h8m18.247661444s) [noise=true , address=145.79.227.6:4257 , piece_id=MJNLPH2SZUDWY754MTOQAQ7JCOGOMG63W44BWMFGBDCF3FLL3P4Q, seg_pos={0 0}, upload=65240]: Uploading piece... Sep 9 15:36:42.208277216 (74h8m18.247850336s) [noise=true , address=45.91.116.5:4297 , piece_id=M42AZLSSSXD6DJJFMARMIXF4O5POOAB4NT7HFTE3RT6EFVWKHBJA, seg_pos={0 0}, upload=65240]: Uploading piece... Sep 9 15:36:42.208431119 (74h8m18.248004239s) [noise=true , address=45.91.116.14:4190 , piece_id=BP6JJNRGTCQIYUFXHX4WOJJK3Z3RRMGJAM4URTY4UYHPUZIXVVKQ, seg_pos={0 0}, upload=65240]: Uploading piece... Sep 9 15:36:42.208625953 (74h8m18.248199083s) [noise=true , address=45.91.116.10:4083 , piece_id=GRUAIUT2ODNJ6D4FKCXD2OMM6O5CRGDQSNGJ4QZPCOJJ2YEZ2Q7A, seg_pos={0 0}, upload=65240]: Uploading piece... Sep 9 15:36:42.208988987 (74h8m18.248562118s) [noise=true , address=45.91.116.8:4048 , piece_id=WIVPAYULYPDJO5AQ63NAZTO5HH5WSUJLRJMUOVSBV2GJAGCWYQTA, seg_pos={0 0}, upload=65240]: Uploading piece... Sep 9 15:36:42.209323838 (74h8m18.248896958s) [noise=true , address=45.91.116.14:4189 , piece_id=SMHOGN5KYJSR5CHRNUX6222DA7JTLOV4WOVJNX77DIMHJUK2ZO7Q, seg_pos={0 0}, upload=65240]: Uploading piece... Sep 9 15:36:42.209618462 (74h8m18.249191582s) [noise=true , address=45.91.116.11:4118 , piece_id=UEZ7VPFRUQTFW5CFPBIKP5UQ5YJJ5VOCU3SXOOGR2G5MBVYNJFPA, seg_pos={0 0}, upload=65240]: Uploading piece... Sep 9 15:36:44.113610036 (74h8m20.153183146s) [upload=65240]: Next returned nil segment Sep 9 15:36:44.113627709 (74h8m20.15320083s) [upload=65240]: Waiting for error group managing segments... Sep 9 15:36:44.422149635 (74h8m20.461722745s) [noise=true , address=45.91.116.10:4083 , piece_id=GRUAIUT2ODNJ6D4FKCXD2OMM6O5CRGDQSNGJ4QZPCOJJ2YEZ2Q7A, seg_pos={0 0}, upload=65240]: Done uploading piece. err: <nil> Sep 9 15:36:44.436237333 (74h8m20.475810453s) [noise=true , address=77.90.31.21:4878 , piece_id=PCIV5MNJCFVWPY6LBIDKQTNMGT24VGYQOKWATWKXGXA4ZEFJOZVA, seg_pos={0 0}, upload=65240]: Done uploading piece. err: <nil> Sep 9 15:36:44.449312333 (74h8m20.488885453s) [noise=true , address=45.91.116.11:4118 , piece_id=UEZ7VPFRUQTFW5CFPBIKP5UQ5YJJ5VOCU3SXOOGR2G5MBVYNJFPA, seg_pos={0 0}, upload=65240]: Done uploading piece. err: <nil> Sep 9 15:36:44.455675219 (74h8m20.495248339s) [noise=true , address=77.90.31.13:4627 , piece_id=AUBWJDAHDCBFKH53XO5H2ZP75653RLKAUH7FGBYKI7IJ3EW2XMRQ, seg_pos={0 0}, upload=65240]: Done uploading piece. err: <nil> Sep 9 15:36:44.463213375 (74h8m20.502786505s) [noise=true , address=45.91.116.14:4190 , piece_id=BP6JJNRGTCQIYUFXHX4WOJJK3Z3RRMGJAM4URTY4UYHPUZIXVVKQ, seg_pos={0 0}, upload=65240]: Done uploading piece. err: <nil> Sep 9 15:36:44.465218512 (74h8m20.504791632s) [noise=true , address=45.91.116.8:4045 , piece_id=OHRP5VYOWJDHGMTMMEVWCK25ASVT52JL7DSSFFSTH3UJEWFK7QFA, seg_pos={0 0}, upload=65240]: Done uploading piece. err: <nil> Sep 9 15:36:44.465546720 (74h8m20.50511986s) [noise=true , address=45.91.116.7:4009 , piece_id=ZGMIN6S66PCTST5IODNAIBT3UGKF2XN5RKY2VGUZ4PNPIZQ5HS5Q, seg_pos={0 0}, upload=65240]: Done uploading piece. err: <nil> Sep 9 15:36:44.471542292 (74h8m20.511115412s) [noise=true , address=45.91.116.6:4975 , piece_id=3HLR7OB3KZRAGHUYOIC7S76JJLLKYNRCBON3LTTFIHR7NWLGA63Q, seg_pos={0 0}, upload=65240]: Done uploading piece. err: <nil> Sep 9 15:36:44.473942596 (74h8m20.513515716s) [noise=true , address=45.91.116.10:4081 , piece_id=DE3GWU7R3XKEDU43MPDMEHEMIEHX2XLDG2BBGTSTRA7JV4NHKFFA, seg_pos={0 0}, upload=65240]: Done uploading piece. err: <nil> Sep 9 15:36:44.497682695 (74h8m20.537255815s) [noise=true , address=45.91.116.8:4048 , piece_id=WIVPAYULYPDJO5AQ63NAZTO5HH5WSUJLRJMUOVSBV2GJAGCWYQTA, seg_pos={0 0}, upload=65240]: Done uploading piece. err: <nil> Sep 9 15:36:44.560727136 (74h8m20.600300256s) [noise=true , address=145.79.227.6:4257 , piece_id=MJNLPH2SZUDWY754MTOQAQ7JCOGOMG63W44BWMFGBDCF3FLL3P4Q, seg_pos={0 0}, upload=65240]: Done uploading piece. err: <nil> Sep 9 15:36:44.596859378 (74h8m20.636432498s) [noise=true , address=45.91.116.14:4189 , piece_id=SMHOGN5KYJSR5CHRNUX6222DA7JTLOV4WOVJNX77DIMHJUK2ZO7Q, seg_pos={0 0}, upload=65240]: Done uploading piece. err: <nil> Sep 9 15:36:44.769973820 (74h8m20.80954694s) [noise=true , address=45.91.116.10:4082 , piece_id=GIH6OZUP66G3DPXR2RXBL5YLH6YEPJPLBLJDL5FMBXLNSEHH2SQQ, seg_pos={0 0}, upload=65240]: Done uploading piece. err: <nil> Sep 9 15:36:44.770036920 (74h8m20.80961004s) [seg_pos={0 0}, upload=65240]: Segment reached optimal threshold of 13 pieces. Sep 9 15:36:44.770287019 (74h8m20.809860139s) [noise=true , address=77.90.31.14:4663 , piece_id=6H6PT2H3NO4OV4XNQAR7JTCAGFMRJ77UGHO5VLOZDY66CEMQWJBQ, seg_pos={0 0}, upload=65240]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF Sep 9 15:36:44.770311085 (74h8m20.809884205s) [noise=true , address=45.91.116.5:4299 , piece_id=EX4RRJZNANVXFHRVSNIR57TTBIMJGPXXYGQPBLCIRTSI53UN4GZQ, seg_pos={0 0}, upload=65240]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: write tcp 188.166.225.170:44884->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:44884->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44884->45.91.116.5:4299: use of closed network connection Sep 9 15:36:44.770348307 (74h8m20.809921427s) [noise=true , address=45.91.116.5:4297 , piece_id=M42AZLSSSXD6DJJFMARMIXF4O5POOAB4NT7HFTE3RT6EFVWKHBJA, seg_pos={0 0}, upload=65240]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Sep 9 15:36:44.770374546 (74h8m20.809947656s) [seg_pos={0 0}, upload=65240]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 15:36:44.770453397 (74h8m20.810026517s) [upload=65240]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 15:36:44.770457906 (74h8m20.810031026s) [upload=65240]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 15:36:45.062909569 (74h8m21.102482699s) [upload=65240]: Done uploading segments... Sep 9 15:36:45.062928886 (74h8m21.102502006s) [upload=65240]: Upload finished. err: <nil> Duration: 30.002617835s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 2.486670524s FAIL (2025-09-09 15:37:00 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.486694268s edge gateway us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 689.54009ms target: https://us1.storj.io/login FAIL (2025-09-09 15:36:55 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused Duration: 689.606336ms core satellite us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 8 out of 60 is failed (threshold=3) [................XX...X.X.......X.X....X...................X.] duration: 7.115462326s FAIL (2025-09-09 15:36:25 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.115482393s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 38 out of 60 is failed (threshold=3) [XXX.....XXXX.......X.X.XXX.XX..XX.X.XX..X.XXXXXXXXXXXXXXXXXX] duration: 30.00159398s FAIL (2025-09-09 15:36:00 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 15:35:31.116291434 (74h7m7.155864554s) [upload=65223]: Starting upload Sep 9 15:35:31.116349244 (74h7m7.155922405s) [upload=65223]: Done starting upload Sep 9 15:35:31.116430550 (74h7m7.15600367s) [upload=65223]: Uploading segments... Sep 9 15:35:31.116634140 (74h7m7.15620727s) [upload=65223]: Got next segment. Inline: false Sep 9 15:35:31.116662945 (74h7m7.156236065s) [upload=65223]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 15:35:31.116669117 (74h7m7.156242247s) [upload=65223]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 15:35:31.358426722 (74h7m7.397999872s) [seg_pos={0 0}, upload=65223]: Begin upload segment... Sep 9 15:35:31.358486127 (74h7m7.398059247s) [seg_pos={0 0}, upload=65223]: Done begin upload segment. Sep 9 15:35:31.358504251 (74h7m7.398077381s) [noise=true , address=77.90.31.16:4733 , piece_id=OF66S4LYGWZERCW6GJVEJIWKGU765DUUTJUCW4TWZRUN4ODFE3NQ, seg_pos={0 0}, upload=65223]: Uploading piece... Sep 9 15:35:31.358520181 (74h7m7.398093342s) [noise=true , address=45.91.116.14:4190 , piece_id=J3XXLOX6DF7ID5QSOFXJZNHXQOWHJEVANHYNOBZ4626NE6Q63UCA, seg_pos={0 0}, upload=65223]: Uploading piece... Sep 9 15:35:31.358585366 (74h7m7.398158486s) [noise=true , address=45.91.116.14:4191 , piece_id=NKIQA22SGQPBGVRZ2XB43KIJPRN3RUWVPTWELLSPHJ34IDWTN3AA, seg_pos={0 0}, upload=65223]: Uploading piece... Sep 9 15:35:31.359337035 (74h7m7.398910175s) [noise=true , address=45.91.116.12:4227 , piece_id=XW2ZTOYBGWS3HPKEAASSPKPBVFIWIFLGKU2MI2S2MEEMJPB7XGIQ, seg_pos={0 0}, upload=65223]: Uploading piece... Sep 9 15:35:31.359466643 (74h7m7.399039773s) [noise=true , address=77.90.31.10:4518 , piece_id=UOFQDCYVNUJNZI22JBPIAZ4CKU3W66B5E4JTTSJQ3346ZN7723XQ, seg_pos={0 0}, upload=65223]: Uploading piece... Sep 9 15:35:31.359772789 (74h7m7.399345919s) [noise=true , address=77.90.31.18:4807 , piece_id=R4LFVOLD7HY3UF2IXDDYF5LO2ZXCJ53IPHC73IHMY7QVRNX6HT4A, seg_pos={0 0}, upload=65223]: Uploading piece... Sep 9 15:35:31.359924168 (74h7m7.399497308s) [noise=true , address=45.91.116.8:4048 , piece_id=GWP3XW756LVZGHVS6YXYX55KDU3M26MBFN46MRJ3JL5EBZCZIUJQ, seg_pos={0 0}, upload=65223]: Uploading piece... Sep 9 15:35:31.360425057 (74h7m7.399998187s) [noise=true , address=145.79.227.16:4911 , piece_id=HL23RSDVDVKFUU4273H5FE2TVCDMFL5N7JYJJZZQP5GDD2VS27BA, seg_pos={0 0}, upload=65223]: Uploading piece... Sep 9 15:35:31.360825001 (74h7m7.400398132s) [noise=true , address=145.79.227.14:4838 , piece_id=VIUFO7ICVFL5QQ7DVBS2UJSCO33S5C57JFLLOLGZ5OUNSSTKAEDA, seg_pos={0 0}, upload=65223]: Uploading piece... Sep 9 15:35:31.361226961 (74h7m7.400800091s) [noise=true , address=77.90.31.14:4662 , piece_id=5KGTFPVQC7WEDM3FUABOZFZ4M2LS4VJOEBM4LCIJEEORZVIS6FBQ, seg_pos={0 0}, upload=65223]: Uploading piece... Sep 9 15:35:31.361549769 (74h7m7.401122889s) [noise=true , address=77.90.31.16:4734 , piece_id=5T74Q454MUPFDQRAB4U4RWE7IMYN6CJMCN3FUO6PAHOMJ2SX3WDA, seg_pos={0 0}, upload=65223]: Uploading piece... Sep 9 15:35:31.361891954 (74h7m7.401465084s) [noise=true , address=145.79.227.14:4837 , piece_id=4OQKDMKBYEEHGAXXTVCEDK2G7RNUZ4NKSNHOZCQWATKNBWR5JEAA, seg_pos={0 0}, upload=65223]: Uploading piece... Sep 9 15:35:31.362225282 (74h7m7.401798402s) [noise=true , address=45.91.116.7:4010 , piece_id=W5Y2IR7SDHE6BLABEK34YCHOU4JMCELGR3GCA4VWZRW3Q2SVNIYA, seg_pos={0 0}, upload=65223]: Uploading piece... Sep 9 15:35:31.362536807 (74h7m7.402109938s) [noise=true , address=45.91.116.9:4262 , piece_id=OV7564773IHJWH7Z57VUGBM7TDHP3XZNIYV3G7J6KIQ2EWP43JKA, seg_pos={0 0}, upload=65223]: Uploading piece... Sep 9 15:35:31.362861008 (74h7m7.402434138s) [noise=true , address=45.91.116.13:4154 , piece_id=LJF7U7DBFXXYYQHA6AQWCOL6536ONBV3BHADS7MNARCKGHLDCUWA, seg_pos={0 0}, upload=65223]: Uploading piece... Sep 9 15:35:31.363211799 (74h7m7.402784919s) [noise=true , address=77.90.31.19:4842 , piece_id=L24SPT3OTH2EZEH6Y5PCBPSSWFXL7M27NTS7EFPSQL4T725ICMYQ, seg_pos={0 0}, upload=65223]: Uploading piece... Sep 9 15:35:33.248813704 (74h7m9.288386824s) [upload=65223]: Next returned nil segment Sep 9 15:35:33.248835164 (74h7m9.288408284s) [upload=65223]: Waiting for error group managing segments... Sep 9 15:35:33.543818793 (74h7m9.583391913s) [noise=true , address=45.91.116.9:4262 , piece_id=OV7564773IHJWH7Z57VUGBM7TDHP3XZNIYV3G7J6KIQ2EWP43JKA, seg_pos={0 0}, upload=65223]: Done uploading piece. err: <nil> Sep 9 15:35:33.584937206 (74h7m9.624510326s) [noise=true , address=45.91.116.12:4227 , piece_id=XW2ZTOYBGWS3HPKEAASSPKPBVFIWIFLGKU2MI2S2MEEMJPB7XGIQ, seg_pos={0 0}, upload=65223]: Done uploading piece. err: <nil> Sep 9 15:35:33.612242237 (74h7m9.651815347s) [noise=true , address=77.90.31.14:4662 , piece_id=5KGTFPVQC7WEDM3FUABOZFZ4M2LS4VJOEBM4LCIJEEORZVIS6FBQ, seg_pos={0 0}, upload=65223]: Done uploading piece. err: <nil> Sep 9 15:35:33.622080343 (74h7m9.661653463s) [noise=true , address=45.91.116.13:4154 , piece_id=LJF7U7DBFXXYYQHA6AQWCOL6536ONBV3BHADS7MNARCKGHLDCUWA, seg_pos={0 0}, upload=65223]: Done uploading piece. err: <nil> Sep 9 15:35:33.636257483 (74h7m9.675830603s) [noise=true , address=45.91.116.14:4190 , piece_id=J3XXLOX6DF7ID5QSOFXJZNHXQOWHJEVANHYNOBZ4626NE6Q63UCA, seg_pos={0 0}, upload=65223]: Done uploading piece. err: <nil> Sep 9 15:35:33.670040329 (74h7m9.709613449s) [noise=true , address=77.90.31.16:4734 , piece_id=5T74Q454MUPFDQRAB4U4RWE7IMYN6CJMCN3FUO6PAHOMJ2SX3WDA, seg_pos={0 0}, upload=65223]: Done uploading piece. err: <nil> Sep 9 15:35:33.674744842 (74h7m9.714317962s) [noise=true , address=77.90.31.10:4518 , piece_id=UOFQDCYVNUJNZI22JBPIAZ4CKU3W66B5E4JTTSJQ3346ZN7723XQ, seg_pos={0 0}, upload=65223]: Done uploading piece. err: <nil> Sep 9 15:35:33.677792664 (74h7m9.717365784s) [noise=true , address=77.90.31.19:4842 , piece_id=L24SPT3OTH2EZEH6Y5PCBPSSWFXL7M27NTS7EFPSQL4T725ICMYQ, seg_pos={0 0}, upload=65223]: Done uploading piece. err: <nil> Sep 9 15:35:33.682754659 (74h7m9.722327779s) [noise=true , address=77.90.31.18:4807 , piece_id=R4LFVOLD7HY3UF2IXDDYF5LO2ZXCJ53IPHC73IHMY7QVRNX6HT4A, seg_pos={0 0}, upload=65223]: Done uploading piece. err: <nil> Sep 9 15:35:33.793783092 (74h7m9.833356212s) [noise=true , address=45.91.116.8:4048 , piece_id=GWP3XW756LVZGHVS6YXYX55KDU3M26MBFN46MRJ3JL5EBZCZIUJQ, seg_pos={0 0}, upload=65223]: Done uploading piece. err: <nil> Sep 9 15:35:33.824647374 (74h7m9.864220494s) [noise=true , address=77.90.31.16:4733 , piece_id=OF66S4LYGWZERCW6GJVEJIWKGU765DUUTJUCW4TWZRUN4ODFE3NQ, seg_pos={0 0}, upload=65223]: Done uploading piece. err: <nil> Sep 9 15:35:33.861663187 (74h7m9.901236307s) [noise=true , address=145.79.227.16:4911 , piece_id=HL23RSDVDVKFUU4273H5FE2TVCDMFL5N7JYJJZZQP5GDD2VS27BA, seg_pos={0 0}, upload=65223]: Done uploading piece. err: <nil> Sep 9 15:35:33.863037457 (74h7m9.902610577s) [noise=true , address=45.91.116.7:4010 , piece_id=W5Y2IR7SDHE6BLABEK34YCHOU4JMCELGR3GCA4VWZRW3Q2SVNIYA, seg_pos={0 0}, upload=65223]: Done uploading piece. err: <nil> Sep 9 15:35:33.863047085 (74h7m9.902620205s) [seg_pos={0 0}, upload=65223]: Segment reached optimal threshold of 13 pieces. Sep 9 15:35:33.863549277 (74h7m9.903122407s) [noise=true , address=45.91.116.14:4191 , piece_id=NKIQA22SGQPBGVRZ2XB43KIJPRN3RUWVPTWELLSPHJ34IDWTN3AA, seg_pos={0 0}, upload=65223]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq): protocol: read tcp 188.166.225.170:60150->45.91.116.14:4191: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 9 15:35:33.863609973 (74h7m9.903183093s) [noise=true , address=145.79.227.14:4837 , piece_id=4OQKDMKBYEEHGAXXTVCEDK2G7RNUZ4NKSNHOZCQWATKNBWR5JEAA, seg_pos={0 0}, upload=65223]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV): protocol: write tcp 188.166.225.170:47036->145.79.227.14:4837: use of closed network connection; write tcp 188.166.225.170:47036->145.79.227.14:4837: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47036->145.79.227.14:4837: use of closed network connection Sep 9 15:35:33.863647604 (74h7m9.903220724s) [noise=true , address=145.79.227.14:4838 , piece_id=VIUFO7ICVFL5QQ7DVBS2UJSCO33S5C57JFLLOLGZ5OUNSSTKAEDA, seg_pos={0 0}, upload=65223]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:47290->145.79.227.14:4838: use of closed network connection; write tcp 188.166.225.170:47290->145.79.227.14:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47290->145.79.227.14:4838: use of closed network connection Sep 9 15:35:33.863657524 (74h7m9.903230644s) [seg_pos={0 0}, upload=65223]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 15:35:33.863724451 (74h7m9.903297572s) [upload=65223]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 15:35:33.863728429 (74h7m9.903301549s) [upload=65223]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 15:35:34.163873054 (74h7m10.203446174s) [upload=65223]: Done uploading segments... Sep 9 15:35:34.163895176 (74h7m10.203468296s) [upload=65223]: Upload finished. err: <nil> Duration: 30.001614049s core uplink us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 697.846294ms target: https://us1.storj.io/login FAIL (2025-09-09 15:36:00 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused Duration: 697.8707ms core satellite us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 2.575671269s FAIL (2025-09-09 15:35:55 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.575692118s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 8 out of 60 is failed (threshold=3) [.................XX...X.X.......X.X....X...................X] duration: 30.001078268s FAIL (2025-09-09 15:35:40 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.001090652s edge gateway us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 681.729894ms target: https://us1.storj.io/login FAIL (2025-09-09 15:35:39 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused Duration: 681.74929ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 38 out of 60 is failed (threshold=3) [XXXX.....XXXX.......X.X.XXX.XX..XX.X.XX..X.XXXXXXXXXXXXXXXXX] duration: 30.00198779s FAIL (2025-09-09 15:35:12 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 15:34:42.757415732 (74h6m18.796988852s) [upload=65212]: Starting upload Sep 9 15:34:42.757523689 (74h6m18.797096819s) [upload=65212]: Done starting upload Sep 9 15:34:42.757610806 (74h6m18.797183966s) [upload=65212]: Uploading segments... Sep 9 15:34:42.757912714 (74h6m18.797485844s) [upload=65212]: Got next segment. Inline: false Sep 9 15:34:42.757968090 (74h6m18.79754123s) [upload=65212]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 15:34:42.757975574 (74h6m18.797548734s) [upload=65212]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 15:34:43.010706277 (74h6m19.050279397s) [seg_pos={0 0}, upload=65212]: Begin upload segment... Sep 9 15:34:43.010751624 (74h6m19.050324744s) [seg_pos={0 0}, upload=65212]: Done begin upload segment. Sep 9 15:34:43.010772203 (74h6m19.050345323s) [noise=true , address=77.90.31.10:4517 , piece_id=BY6GM7WJYCMC4MKHXS64N2TIJG375NCWAU4GNW4T3ZWHJ7NSOJCA, seg_pos={0 0}, upload=65212]: Uploading piece... Sep 9 15:34:43.010786150 (74h6m19.05035927s) [noise=true , address=77.90.31.21:4877 , piece_id=RO7QE7WO5S5JT2ZZWTRNZ543BZQQD2NXJ6PSGO3C7SKOXO5HZKHQ, seg_pos={0 0}, upload=65212]: Uploading piece... Sep 9 15:34:43.010832729 (74h6m19.050405849s) [noise=true , address=45.91.116.4:4939 , piece_id=AAGFXBBU6FOZL3EYH467JHYNW5UXMJNY73246OPPPONH7MGBFV5A, seg_pos={0 0}, upload=65212]: Uploading piece... Sep 9 15:34:43.011201164 (74h6m19.050774284s) [noise=true , address=45.91.116.7:4011 , piece_id=T3Q4N7O777OB3WXZAD7WD6Y7LHMU74HLNWJCSGJKNTEBARAG5Q5A, seg_pos={0 0}, upload=65212]: Uploading piece... Sep 9 15:34:43.011210071 (74h6m19.050783191s) [noise=true , address=45.91.116.8:4045 , piece_id=OH2UAFEXUO53COEJQAH3VYP4I4VGA35MFRN46PJ76OQPI5XJ2LDA, seg_pos={0 0}, upload=65212]: Uploading piece... Sep 9 15:34:43.011482873 (74h6m19.051055993s) [noise=true , address=145.79.227.3:4149 , piece_id=EUIGQN2QWEE6CNYGJJL2IN5XHIIKACEJRQSOYESRPXLFAKZJPDSQ, seg_pos={0 0}, upload=65212]: Uploading piece... Sep 9 15:34:43.011746998 (74h6m19.051320118s) [noise=true , address=45.91.116.5:4299 , piece_id=RRTBOV4CN7HU4Z7FHPNTIE5KFBUDTTHXKDRFANLBO7COPYWSSV7A, seg_pos={0 0}, upload=65212]: Uploading piece... Sep 9 15:34:43.012051461 (74h6m19.051624581s) [noise=true , address=45.91.116.5:4298 , piece_id=VLZETJFOPVQSN2ZPLD6PHO5XKQGWMPJF6PSO6NWJRADIFPZPQSVQ, seg_pos={0 0}, upload=65212]: Uploading piece... Sep 9 15:34:43.012280279 (74h6m19.051853399s) [noise=true , address=45.91.116.9:4261 , piece_id=SRDGLVSHUOA5KSEGL2OJBWCH26LVIFDOCOMOX6ISMEAE5ROBH6DA, seg_pos={0 0}, upload=65212]: Uploading piece... Sep 9 15:34:43.012500160 (74h6m19.05207328s) [noise=true , address=77.90.31.18:4807 , piece_id=G3QR4PBEUFBJTZXXTNEBRVWDQK2DDJWW4COIATEIKQ3SOWK4TTQQ, seg_pos={0 0}, upload=65212]: Uploading piece... Sep 9 15:34:43.012723627 (74h6m19.052296747s) [noise=true , address=77.90.31.16:4733 , piece_id=D47PWTOX3ZREHPUFG2OGUR6NYJYTUZCWQ25V54QARXZDLSZED4MA, seg_pos={0 0}, upload=65212]: Uploading piece... Sep 9 15:34:43.012942516 (74h6m19.052515636s) [noise=true , address=45.91.116.4:4938 , piece_id=QU7SSOK3QDETZHQRV3BSWU3QAU4QU3XEEN637GHO5T4ALJFNALKA, seg_pos={0 0}, upload=65212]: Uploading piece... Sep 9 15:34:43.013163008 (74h6m19.052736128s) [noise=true , address=77.90.31.13:4626 , piece_id=63KSTGIZQWALY6CNEBNNWEL6W5COG4BF7OGOOEGSOAYWLYM5JMJA, seg_pos={0 0}, upload=65212]: Uploading piece... Sep 9 15:34:43.013379703 (74h6m19.052952823s) [noise=true , address=45.91.116.10:4081 , piece_id=C2B64BDX6NKZAMPVJEURXYOVRRRIWHZFIYAHZU42T36SHPQQN2AA, seg_pos={0 0}, upload=65212]: Uploading piece... Sep 9 15:34:43.013627627 (74h6m19.053200747s) [noise=true , address=77.90.31.14:4662 , piece_id=AQP7OQUJO6REAYH5LDDDO35Y3ATINHQ2UY524ICJ6LYG6WZM2NCA, seg_pos={0 0}, upload=65212]: Uploading piece... Sep 9 15:34:43.013878677 (74h6m19.053451797s) [noise=true , address=145.79.227.5:4221 , piece_id=FR65EXLEHQKZPABDPCRGCZDWAOZY55FLT7CZDYUYPTZLEZ3GLJDA, seg_pos={0 0}, upload=65212]: Uploading piece... Sep 9 15:34:44.821036612 (74h6m20.860609732s) [upload=65212]: Next returned nil segment Sep 9 15:34:44.821053904 (74h6m20.860627024s) [upload=65212]: Waiting for error group managing segments... Sep 9 15:34:45.218129606 (74h6m21.257702726s) [noise=true , address=77.90.31.10:4517 , piece_id=BY6GM7WJYCMC4MKHXS64N2TIJG375NCWAU4GNW4T3ZWHJ7NSOJCA, seg_pos={0 0}, upload=65212]: Done uploading piece. err: <nil> Sep 9 15:34:45.229858119 (74h6m21.269431239s) [noise=true , address=77.90.31.14:4662 , piece_id=AQP7OQUJO6REAYH5LDDDO35Y3ATINHQ2UY524ICJ6LYG6WZM2NCA, seg_pos={0 0}, upload=65212]: Done uploading piece. err: <nil> Sep 9 15:34:45.230132905 (74h6m21.269706025s) [noise=true , address=77.90.31.13:4626 , piece_id=63KSTGIZQWALY6CNEBNNWEL6W5COG4BF7OGOOEGSOAYWLYM5JMJA, seg_pos={0 0}, upload=65212]: Done uploading piece. err: <nil> Sep 9 15:34:45.247739266 (74h6m21.287312386s) [noise=true , address=45.91.116.5:4299 , piece_id=RRTBOV4CN7HU4Z7FHPNTIE5KFBUDTTHXKDRFANLBO7COPYWSSV7A, seg_pos={0 0}, upload=65212]: Done uploading piece. err: <nil> Sep 9 15:34:45.254419700 (74h6m21.29399282s) [noise=true , address=145.79.227.5:4221 , piece_id=FR65EXLEHQKZPABDPCRGCZDWAOZY55FLT7CZDYUYPTZLEZ3GLJDA, seg_pos={0 0}, upload=65212]: Done uploading piece. err: <nil> Sep 9 15:34:45.275255271 (74h6m21.314828391s) [noise=true , address=45.91.116.4:4938 , piece_id=QU7SSOK3QDETZHQRV3BSWU3QAU4QU3XEEN637GHO5T4ALJFNALKA, seg_pos={0 0}, upload=65212]: Done uploading piece. err: <nil> Sep 9 15:34:45.275974376 (74h6m21.315547506s) [noise=true , address=45.91.116.10:4081 , piece_id=C2B64BDX6NKZAMPVJEURXYOVRRRIWHZFIYAHZU42T36SHPQQN2AA, seg_pos={0 0}, upload=65212]: Done uploading piece. err: <nil> Sep 9 15:34:45.301169009 (74h6m21.340742139s) [noise=true , address=77.90.31.16:4733 , piece_id=D47PWTOX3ZREHPUFG2OGUR6NYJYTUZCWQ25V54QARXZDLSZED4MA, seg_pos={0 0}, upload=65212]: Done uploading piece. err: <nil> Sep 9 15:34:45.301678594 (74h6m21.341251714s) [noise=true , address=45.91.116.9:4261 , piece_id=SRDGLVSHUOA5KSEGL2OJBWCH26LVIFDOCOMOX6ISMEAE5ROBH6DA, seg_pos={0 0}, upload=65212]: Done uploading piece. err: <nil> Sep 9 15:34:45.310684077 (74h6m21.350257197s) [noise=true , address=45.91.116.5:4298 , piece_id=VLZETJFOPVQSN2ZPLD6PHO5XKQGWMPJF6PSO6NWJRADIFPZPQSVQ, seg_pos={0 0}, upload=65212]: Done uploading piece. err: <nil> Sep 9 15:34:45.404947659 (74h6m21.444520779s) [noise=true , address=77.90.31.18:4807 , piece_id=G3QR4PBEUFBJTZXXTNEBRVWDQK2DDJWW4COIATEIKQ3SOWK4TTQQ, seg_pos={0 0}, upload=65212]: Done uploading piece. err: <nil> Sep 9 15:34:45.521705165 (74h6m21.561278315s) [noise=true , address=45.91.116.7:4011 , piece_id=T3Q4N7O777OB3WXZAD7WD6Y7LHMU74HLNWJCSGJKNTEBARAG5Q5A, seg_pos={0 0}, upload=65212]: Done uploading piece. err: <nil> Sep 9 15:34:45.938410008 (74h6m21.977983128s) [noise=true , address=45.91.116.4:4939 , piece_id=AAGFXBBU6FOZL3EYH467JHYNW5UXMJNY73246OPPPONH7MGBFV5A, seg_pos={0 0}, upload=65212]: Done uploading piece. err: <nil> Sep 9 15:34:45.938437431 (74h6m21.978010551s) [seg_pos={0 0}, upload=65212]: Segment reached optimal threshold of 13 pieces. Sep 9 15:34:45.938595333 (74h6m21.978168453s) [noise=true , address=45.91.116.8:4045 , piece_id=OH2UAFEXUO53COEJQAH3VYP4I4VGA35MFRN46PJ76OQPI5XJ2LDA, seg_pos={0 0}, upload=65212]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: expected piece hash; context canceled; EOF Sep 9 15:34:45.938694343 (74h6m21.978267473s) [noise=true , address=77.90.31.21:4877 , piece_id=RO7QE7WO5S5JT2ZZWTRNZ543BZQQD2NXJ6PSGO3C7SKOXO5HZKHQ, seg_pos={0 0}, upload=65212]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2): protocol: expected piece hash; context canceled; EOF Sep 9 15:34:45.938741763 (74h6m21.978314883s) [noise=true , address=145.79.227.3:4149 , piece_id=EUIGQN2QWEE6CNYGJJL2IN5XHIIKACEJRQSOYESRPXLFAKZJPDSQ, seg_pos={0 0}, upload=65212]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: expected piece hash; context canceled; EOF Sep 9 15:34:45.938817157 (74h6m21.978390287s) [seg_pos={0 0}, upload=65212]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 15:34:45.938913242 (74h6m21.978486362s) [upload=65212]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 15:34:45.938918431 (74h6m21.978491551s) [upload=65212]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 15:34:46.251809297 (74h6m22.291382417s) [upload=65212]: Done uploading segments... Sep 9 15:34:46.251829135 (74h6m22.291402255s) [upload=65212]: Upload finished. err: <nil> Duration: 30.002016614s core uplink us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 695.240506ms target: https://us1.storj.io/login FAIL (2025-09-09 15:35:08 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused Duration: 695.262118ms core satellite us1

1
...
5793
5794
5795
5796
5797
...
9652