Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 3 out of 60 is failed (threshold=3) [....X................................................XX.....] duration: 6.01693148s FAIL (2025-08-31 11:18:02 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 6.016956197s core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 6.769157545s FAIL (2025-08-31 11:17:58 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.769183103s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 2.001860523s FAIL (2025-08-31 11:17:57 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.001889377s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.XXX........................................................] duration: 5.897732167s FAIL (2025-08-31 11:17:55 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.897752767s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.................................................X....X.....] duration: 1.964597933s FAIL (2025-08-31 11:17:49 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 31 11:13:44.970873573 (45h5m41.651069142s) [upload=39634]: Starting upload Aug 31 11:13:44.970949158 (45h5m41.651144727s) [upload=39634]: Done starting upload Aug 31 11:13:44.971018871 (45h5m41.65121444s) [upload=39634]: Uploading segments... Aug 31 11:13:44.971078174 (45h5m41.651273743s) [upload=39634]: Got next segment. Inline: true Aug 31 11:13:44.971082704 (45h5m41.651278273s) [upload=39634]: Waiting for error group managing segments... Aug 31 11:13:44.971114825 (45h5m41.651310394s) [upload=39634]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 11:13:44.971118532 (45h5m41.651314101s) [upload=39634]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 31 11:13:44.971121528 (45h5m41.651317097s) [upload=39634]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 31 11:13:50.376332558 (45h5m47.056528127s) [upload=39634]: Done uploading segments... Aug 31 11:13:50.376399666 (45h5m47.056595235s) [upload=39634]: Upload finished. err: <nil> Duration:* 1.964630765s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 2.042343402s FAIL (2025-08-31 11:17:48 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.042381474s core uplink us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 708.874267ms target: https://us1.storj.io/login FAIL (2025-08-31 11:17:42 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout Duration: 708.890988ms core satellite us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 6.510647503s FAIL (2025-08-31 11:17:41 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.510670288s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 6.233932697s FAIL (2025-08-31 11:17:37 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Aug 31 11:13:00.825343942 (45h4m57.505539511s) [upload=39627]: Starting upload Aug 31 11:13:00.825384589 (45h4m57.505580149s) [upload=39627]: Done starting upload Aug 31 11:13:00.825541009 (45h4m57.505736568s) [upload=39627]: Uploading segments... Aug 31 11:13:00.825579793 (45h4m57.505775362s) [upload=39627]: Got next segment. Inline: false Aug 31 11:13:00.825600693 (45h4m57.505796252s) [upload=39627]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 11:13:00.825604560 (45h4m57.505800129s) [upload=39627]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 31 11:13:01.708167688 (45h4m58.388363257s) [seg_pos={0 0}, upload=39627]: Begin upload segment... Aug 31 11:13:01.708224125 (45h4m58.388419695s) [seg_pos={0 0}, upload=39627]: Done begin upload segment. Aug 31 11:13:01.708248382 (45h4m58.388443961s) [noise=true , address=64.49.13.169:4709 , piece_id=5FUJXDUJJLTSAGJROSEZIBYUDPBF55XTNQLOD5WJHSJCVTRSO4UA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.708346640 (45h4m58.388542209s) [noise=true , address=104.36.82.35:4593 , piece_id=PRCATZUEA72YG2S4BTGEQ4ETUWVKMO3OCURBNLFAEGCSB5MDUKUQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.708955535 (45h4m58.389151114s) [noise=true , address=45.91.116.14:4195 , piece_id=UTIYQKVEKCDYGFQ6LX7PBJCGTA2QBMEN5Y7L5REIX4PUJ7WQSZ6Q, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709102236 (45h4m58.389297805s) [noise=true , address=104.36.82.15:4288 , piece_id=RHCPDOB7TEL65DYGJLJRJWC2SUHOV5FT5IZRERXUKHWZQVPGBHTA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709344399 (45h4m58.389539968s) [noise=true , address=64.49.13.155:4917 , piece_id=GSN5BNXY6VQJ63KASNN3MONOM6SV4BRM6WVIYLHGCGZNVK53HWXA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709551927 (45h4m58.389747506s) [noise=true , address=45.91.116.7:4034 , piece_id=LT7WEH3NX6T43P6WZFPREGKZ35R3UMEQYJBHAS4SW7N6CXHTUBOA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709590730 (45h4m58.3897863s) [noise=true , address=104.36.82.41:4775 , piece_id=7ESRGGJBNYHH4GH3PAACKOTPDKWV7ZRGQXYOUGVQJMYK2FQSNK4Q, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709842191 (45h4m58.390037771s) [noise=true , address=104.36.82.5:4853 , piece_id=O7HRHC2V53F22YV4FRE3F6U64PBVZK2AV2KYC4GNFEWHYZRJEOXA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710024290 (45h4m58.390219859s) [noise=true , address=77.90.31.21:4903 , piece_id=64466RMNHODOUS4YMYJBS46QNXS37PN3ZCMX56J6AWPF76BDJIFA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710071431 (45h4m58.390267s) [noise=true , address=104.36.82.48:4592 , piece_id=PACCJAF3QJXJSEUEJL7MRRLVR6ZRR4NLGDU42EAYK2VRTOBLAWGQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710298846 (45h4m58.390494415s) [noise=true , address=104.36.82.60:4360 , piece_id=JHBHFUQNTTMN6IVKTAVL4SUG27G2HHQOVY3VTFJDH4CZF7AEF56Q, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710486405 (45h4m58.390681984s) [noise=true , address=77.90.31.15:4714 , piece_id=EQ5HVZ67YWZTSI6K5FPNOAIIDBPV32KSCEZFP2MY45WALWMQNPDA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710556819 (45h4m58.390752388s) [noise=true , address=77.90.31.10:4544 , piece_id=YKJJXXMH3K2IJ2VGMRNCEEHUMOKMX3F4ZD72HPRQ6G7XNI5MPICA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710813581 (45h4m58.39100915s) [noise=true , address=77.90.31.11:4566 , piece_id=L5AZKS66QFUKXBCVO5NFR5MEDYTGIIHODHNBYXAFIH2YSE2TZR2A, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710945823 (45h4m58.391141402s) [noise=true , address=64.49.13.140:4508 , piece_id=O52JQJINRPKWLZI6NNPFJPZQYGDWHOMV3OHH6WYR2GFBKYRT7N3A, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.711040525 (45h4m58.391236094s) [noise=true , address=79.127.205.246:4263 , piece_id=2KPRXAVRMFEEMS32L3W2MSG7QJD5NLL2XVH5GOJIBDCVHUECVAEQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.711384572 (45h4m58.391580151s) [noise=true , address=104.36.82.53:4138 , piece_id=MFMGL7KSLNHYC4IQWD63O5KNIUOCDGYDKZUGGRTKAWMFTKZNFULQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.711796601 (45h4m58.39199218s) [noise=true , address=79.127.205.245:4251 , piece_id=G7VYPKSXFPKHVBAQDRKC7YCWWHZEQJUKWK4I3CAU4XMM2RRKM2YQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:02.809033683 (45h4m59.489229262s) [upload=39627]: Next returned nil segment Aug 31 11:13:02.809052139 (45h4m59.489247708s) [upload=39627]: Waiting for error group managing segments... Aug 31 11:13:03.110429755 (45h4m59.790625324s) [noise=true , address=79.127.205.245:4251 , piece_id=G7VYPKSXFPKHVBAQDRKC7YCWWHZEQJUKWK4I3CAU4XMM2RRKM2YQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.112669791 (45h4m59.79286538s) [noise=true , address=64.49.13.140:4508 , piece_id=O52JQJINRPKWLZI6NNPFJPZQYGDWHOMV3OHH6WYR2GFBKYRT7N3A, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.128781550 (45h4m59.808977119s) [noise=true , address=79.127.205.246:4263 , piece_id=2KPRXAVRMFEEMS32L3W2MSG7QJD5NLL2XVH5GOJIBDCVHUECVAEQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.142878824 (45h4m59.823074393s) [noise=true , address=64.49.13.155:4917 , piece_id=GSN5BNXY6VQJ63KASNN3MONOM6SV4BRM6WVIYLHGCGZNVK53HWXA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.202555682 (45h4m59.882751251s) [noise=true , address=64.49.13.169:4709 , piece_id=5FUJXDUJJLTSAGJROSEZIBYUDPBF55XTNQLOD5WJHSJCVTRSO4UA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.647619373 (45h5m0.327814942s) [noise=true , address=45.91.116.14:4195 , piece_id=UTIYQKVEKCDYGFQ6LX7PBJCGTA2QBMEN5Y7L5REIX4PUJ7WQSZ6Q, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.680334441 (45h5m0.36053001s) [noise=true , address=104.36.82.35:4593 , piece_id=PRCATZUEA72YG2S4BTGEQ4ETUWVKMO3OCURBNLFAEGCSB5MDUKUQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.737634971 (45h5m0.41783054s) [noise=true , address=45.91.116.7:4034 , piece_id=LT7WEH3NX6T43P6WZFPREGKZ35R3UMEQYJBHAS4SW7N6CXHTUBOA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.749306554 (45h5m0.429502124s) [noise=true , address=104.36.82.48:4592 , piece_id=PACCJAF3QJXJSEUEJL7MRRLVR6ZRR4NLGDU42EAYK2VRTOBLAWGQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.750058222 (45h5m0.430253791s) [noise=true , address=104.36.82.5:4853 , piece_id=O7HRHC2V53F22YV4FRE3F6U64PBVZK2AV2KYC4GNFEWHYZRJEOXA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.752613201 (45h5m0.43280877s) [noise=true , address=104.36.82.15:4288 , piece_id=RHCPDOB7TEL65DYGJLJRJWC2SUHOV5FT5IZRERXUKHWZQVPGBHTA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.783046874 (45h5m0.463242443s) [noise=true , address=77.90.31.11:4566 , piece_id=L5AZKS66QFUKXBCVO5NFR5MEDYTGIIHODHNBYXAFIH2YSE2TZR2A, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.783337791 (45h5m0.46353336s) [noise=true , address=77.90.31.15:4714 , piece_id=EQ5HVZ67YWZTSI6K5FPNOAIIDBPV32KSCEZFP2MY45WALWMQNPDA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.814218168 (45h5m0.494413727s) [noise=true , address=77.90.31.10:4544 , piece_id=YKJJXXMH3K2IJ2VGMRNCEEHUMOKMX3F4ZD72HPRQ6G7XNI5MPICA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.814246252 (45h5m0.494441811s) [seg_pos={0 0}, upload=39627]: Segment reached optimal threshold of 14 pieces. Aug 31 11:13:03.814359448 (45h5m0.494555017s) [noise=true , address=104.36.82.60:4360 , piece_id=JHBHFUQNTTMN6IVKTAVL4SUG27G2HHQOVY3VTFJDH4CZF7AEF56Q, seg_pos={0 0}, upload=39627]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T24rtYBJ47E6Ef1ZZKMWcpBrWBpCg5QV2ZHniCZZkzJF2yUNk): protocol: expected piece hash; context canceled; EOF Aug 31 11:13:03.814418081 (45h5m0.49461364s) [noise=true , address=104.36.82.53:4138 , piece_id=MFMGL7KSLNHYC4IQWD63O5KNIUOCDGYDKZUGGRTKAWMFTKZNFULQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YUGGJg6mWeQMmzSNWtLFWAaWwaKWfEf8wxXs1jwiZaA9nhsr3): protocol: expected piece hash; context canceled; EOF Aug 31 11:13:03.814483546 (45h5m0.494679115s) [noise=true , address=104.36.82.41:4775 , piece_id=7ESRGGJBNYHH4GH3PAACKOTPDKWV7ZRGQXYOUGVQJMYK2FQSNK4Q, seg_pos={0 0}, upload=39627]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:166yRbNnnDeZRifM5q7vUVLx7iV5cZ9GqQnmvD9AbUUJsaCjmj): protocol: expected piece hash; context canceled; EOF Aug 31 11:13:03.814510187 (45h5m0.494705746s) [noise=true , address=77.90.31.21:4903 , piece_id=64466RMNHODOUS4YMYJBS46QNXS37PN3ZCMX56J6AWPF76BDJIFA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZYWQ1a2sTKnFpF28iQVrem2s8nSpXkeJzZDaS7jvTZNANdfp): protocol: expected piece hash; context canceled; EOF Aug 31 11:13:03.814533913 (45h5m0.494729482s) [seg_pos={0 0}, upload=39627]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 31 11:13:03.814608635 (45h5m0.494804204s) [upload=39627]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 31 11:13:03.814612623 (45h5m0.494808193s) [upload=39627]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 31 11:13:06.785691131 (45h5m3.4658867s) [upload=39627]: Done uploading segments... Aug 31 11:13:06.785708434 (45h5m3.465904004s) [upload=39627]: Upload finished. err: <nil> Duration: 6.233957304s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 2.145255874s FAIL (2025-08-31 11:17:32 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.14528092s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 6.772390831s FAIL (2025-08-31 11:17:23 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.77241683s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 2.010313376s FAIL (2025-08-31 11:17:15 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.010339986s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.....X................................................XX....] duration: 6.011894619s FAIL (2025-08-31 11:17:13 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 6.01192081s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 2.07727443s FAIL (2025-08-31 11:17:13 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.077300881s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 7.075410305s FAIL (2025-08-31 11:17:09 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Aug 31 11:13:00.825343942 (45h4m57.505539511s) [upload=39627]: Starting upload Aug 31 11:13:00.825384589 (45h4m57.505580149s) [upload=39627]: Done starting upload Aug 31 11:13:00.825541009 (45h4m57.505736568s) [upload=39627]: Uploading segments... Aug 31 11:13:00.825579793 (45h4m57.505775362s) [upload=39627]: Got next segment. Inline: false Aug 31 11:13:00.825600693 (45h4m57.505796252s) [upload=39627]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 11:13:00.825604560 (45h4m57.505800129s) [upload=39627]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 31 11:13:01.708167688 (45h4m58.388363257s) [seg_pos={0 0}, upload=39627]: Begin upload segment... Aug 31 11:13:01.708224125 (45h4m58.388419695s) [seg_pos={0 0}, upload=39627]: Done begin upload segment. Aug 31 11:13:01.708248382 (45h4m58.388443961s) [noise=true , address=64.49.13.169:4709 , piece_id=5FUJXDUJJLTSAGJROSEZIBYUDPBF55XTNQLOD5WJHSJCVTRSO4UA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.708346640 (45h4m58.388542209s) [noise=true , address=104.36.82.35:4593 , piece_id=PRCATZUEA72YG2S4BTGEQ4ETUWVKMO3OCURBNLFAEGCSB5MDUKUQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.708955535 (45h4m58.389151114s) [noise=true , address=45.91.116.14:4195 , piece_id=UTIYQKVEKCDYGFQ6LX7PBJCGTA2QBMEN5Y7L5REIX4PUJ7WQSZ6Q, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709102236 (45h4m58.389297805s) [noise=true , address=104.36.82.15:4288 , piece_id=RHCPDOB7TEL65DYGJLJRJWC2SUHOV5FT5IZRERXUKHWZQVPGBHTA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709344399 (45h4m58.389539968s) [noise=true , address=64.49.13.155:4917 , piece_id=GSN5BNXY6VQJ63KASNN3MONOM6SV4BRM6WVIYLHGCGZNVK53HWXA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709551927 (45h4m58.389747506s) [noise=true , address=45.91.116.7:4034 , piece_id=LT7WEH3NX6T43P6WZFPREGKZ35R3UMEQYJBHAS4SW7N6CXHTUBOA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709590730 (45h4m58.3897863s) [noise=true , address=104.36.82.41:4775 , piece_id=7ESRGGJBNYHH4GH3PAACKOTPDKWV7ZRGQXYOUGVQJMYK2FQSNK4Q, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709842191 (45h4m58.390037771s) [noise=true , address=104.36.82.5:4853 , piece_id=O7HRHC2V53F22YV4FRE3F6U64PBVZK2AV2KYC4GNFEWHYZRJEOXA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710024290 (45h4m58.390219859s) [noise=true , address=77.90.31.21:4903 , piece_id=64466RMNHODOUS4YMYJBS46QNXS37PN3ZCMX56J6AWPF76BDJIFA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710071431 (45h4m58.390267s) [noise=true , address=104.36.82.48:4592 , piece_id=PACCJAF3QJXJSEUEJL7MRRLVR6ZRR4NLGDU42EAYK2VRTOBLAWGQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710298846 (45h4m58.390494415s) [noise=true , address=104.36.82.60:4360 , piece_id=JHBHFUQNTTMN6IVKTAVL4SUG27G2HHQOVY3VTFJDH4CZF7AEF56Q, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710486405 (45h4m58.390681984s) [noise=true , address=77.90.31.15:4714 , piece_id=EQ5HVZ67YWZTSI6K5FPNOAIIDBPV32KSCEZFP2MY45WALWMQNPDA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710556819 (45h4m58.390752388s) [noise=true , address=77.90.31.10:4544 , piece_id=YKJJXXMH3K2IJ2VGMRNCEEHUMOKMX3F4ZD72HPRQ6G7XNI5MPICA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710813581 (45h4m58.39100915s) [noise=true , address=77.90.31.11:4566 , piece_id=L5AZKS66QFUKXBCVO5NFR5MEDYTGIIHODHNBYXAFIH2YSE2TZR2A, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710945823 (45h4m58.391141402s) [noise=true , address=64.49.13.140:4508 , piece_id=O52JQJINRPKWLZI6NNPFJPZQYGDWHOMV3OHH6WYR2GFBKYRT7N3A, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.711040525 (45h4m58.391236094s) [noise=true , address=79.127.205.246:4263 , piece_id=2KPRXAVRMFEEMS32L3W2MSG7QJD5NLL2XVH5GOJIBDCVHUECVAEQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.711384572 (45h4m58.391580151s) [noise=true , address=104.36.82.53:4138 , piece_id=MFMGL7KSLNHYC4IQWD63O5KNIUOCDGYDKZUGGRTKAWMFTKZNFULQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.711796601 (45h4m58.39199218s) [noise=true , address=79.127.205.245:4251 , piece_id=G7VYPKSXFPKHVBAQDRKC7YCWWHZEQJUKWK4I3CAU4XMM2RRKM2YQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:02.809033683 (45h4m59.489229262s) [upload=39627]: Next returned nil segment Aug 31 11:13:02.809052139 (45h4m59.489247708s) [upload=39627]: Waiting for error group managing segments... Aug 31 11:13:03.110429755 (45h4m59.790625324s) [noise=true , address=79.127.205.245:4251 , piece_id=G7VYPKSXFPKHVBAQDRKC7YCWWHZEQJUKWK4I3CAU4XMM2RRKM2YQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.112669791 (45h4m59.79286538s) [noise=true , address=64.49.13.140:4508 , piece_id=O52JQJINRPKWLZI6NNPFJPZQYGDWHOMV3OHH6WYR2GFBKYRT7N3A, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.128781550 (45h4m59.808977119s) [noise=true , address=79.127.205.246:4263 , piece_id=2KPRXAVRMFEEMS32L3W2MSG7QJD5NLL2XVH5GOJIBDCVHUECVAEQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.142878824 (45h4m59.823074393s) [noise=true , address=64.49.13.155:4917 , piece_id=GSN5BNXY6VQJ63KASNN3MONOM6SV4BRM6WVIYLHGCGZNVK53HWXA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.202555682 (45h4m59.882751251s) [noise=true , address=64.49.13.169:4709 , piece_id=5FUJXDUJJLTSAGJROSEZIBYUDPBF55XTNQLOD5WJHSJCVTRSO4UA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.647619373 (45h5m0.327814942s) [noise=true , address=45.91.116.14:4195 , piece_id=UTIYQKVEKCDYGFQ6LX7PBJCGTA2QBMEN5Y7L5REIX4PUJ7WQSZ6Q, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.680334441 (45h5m0.36053001s) [noise=true , address=104.36.82.35:4593 , piece_id=PRCATZUEA72YG2S4BTGEQ4ETUWVKMO3OCURBNLFAEGCSB5MDUKUQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.737634971 (45h5m0.41783054s) [noise=true , address=45.91.116.7:4034 , piece_id=LT7WEH3NX6T43P6WZFPREGKZ35R3UMEQYJBHAS4SW7N6CXHTUBOA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.749306554 (45h5m0.429502124s) [noise=true , address=104.36.82.48:4592 , piece_id=PACCJAF3QJXJSEUEJL7MRRLVR6ZRR4NLGDU42EAYK2VRTOBLAWGQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.750058222 (45h5m0.430253791s) [noise=true , address=104.36.82.5:4853 , piece_id=O7HRHC2V53F22YV4FRE3F6U64PBVZK2AV2KYC4GNFEWHYZRJEOXA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.752613201 (45h5m0.43280877s) [noise=true , address=104.36.82.15:4288 , piece_id=RHCPDOB7TEL65DYGJLJRJWC2SUHOV5FT5IZRERXUKHWZQVPGBHTA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.783046874 (45h5m0.463242443s) [noise=true , address=77.90.31.11:4566 , piece_id=L5AZKS66QFUKXBCVO5NFR5MEDYTGIIHODHNBYXAFIH2YSE2TZR2A, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.783337791 (45h5m0.46353336s) [noise=true , address=77.90.31.15:4714 , piece_id=EQ5HVZ67YWZTSI6K5FPNOAIIDBPV32KSCEZFP2MY45WALWMQNPDA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.814218168 (45h5m0.494413727s) [noise=true , address=77.90.31.10:4544 , piece_id=YKJJXXMH3K2IJ2VGMRNCEEHUMOKMX3F4ZD72HPRQ6G7XNI5MPICA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.814246252 (45h5m0.494441811s) [seg_pos={0 0}, upload=39627]: Segment reached optimal threshold of 14 pieces. Aug 31 11:13:03.814359448 (45h5m0.494555017s) [noise=true , address=104.36.82.60:4360 , piece_id=JHBHFUQNTTMN6IVKTAVL4SUG27G2HHQOVY3VTFJDH4CZF7AEF56Q, seg_pos={0 0}, upload=39627]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T24rtYBJ47E6Ef1ZZKMWcpBrWBpCg5QV2ZHniCZZkzJF2yUNk): protocol: expected piece hash; context canceled; EOF Aug 31 11:13:03.814418081 (45h5m0.49461364s) [noise=true , address=104.36.82.53:4138 , piece_id=MFMGL7KSLNHYC4IQWD63O5KNIUOCDGYDKZUGGRTKAWMFTKZNFULQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YUGGJg6mWeQMmzSNWtLFWAaWwaKWfEf8wxXs1jwiZaA9nhsr3): protocol: expected piece hash; context canceled; EOF Aug 31 11:13:03.814483546 (45h5m0.494679115s) [noise=true , address=104.36.82.41:4775 , piece_id=7ESRGGJBNYHH4GH3PAACKOTPDKWV7ZRGQXYOUGVQJMYK2FQSNK4Q, seg_pos={0 0}, upload=39627]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:166yRbNnnDeZRifM5q7vUVLx7iV5cZ9GqQnmvD9AbUUJsaCjmj): protocol: expected piece hash; context canceled; EOF Aug 31 11:13:03.814510187 (45h5m0.494705746s) [noise=true , address=77.90.31.21:4903 , piece_id=64466RMNHODOUS4YMYJBS46QNXS37PN3ZCMX56J6AWPF76BDJIFA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZYWQ1a2sTKnFpF28iQVrem2s8nSpXkeJzZDaS7jvTZNANdfp): protocol: expected piece hash; context canceled; EOF Aug 31 11:13:03.814533913 (45h5m0.494729482s) [seg_pos={0 0}, upload=39627]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 31 11:13:03.814608635 (45h5m0.494804204s) [upload=39627]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 31 11:13:03.814612623 (45h5m0.494808193s) [upload=39627]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 31 11:13:06.785691131 (45h5m3.4658867s) [upload=39627]: Done uploading segments... Aug 31 11:13:06.785708434 (45h5m3.465904004s) [upload=39627]: Upload finished. err: <nil> Duration: 7.075440253s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [...X..............................................XX........] duration: 6.06007437s FAIL (2025-08-31 11:17:03 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Aug 31 11:11:03.184991323 (45h2m59.865186892s) [upload=39597]: Starting upload Aug 31 11:11:03.185066988 (45h2m59.865262567s) [upload=39597]: Done starting upload Aug 31 11:11:03.185180816 (45h2m59.865376395s) [upload=39597]: Uploading segments... Aug 31 11:11:03.185275988 (45h2m59.865471557s) [upload=39597]: Got next segment. Inline: false Aug 31 11:11:03.185312367 (45h2m59.865507936s) [upload=39597]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 11:11:03.185316826 (45h2m59.865512395s) [upload=39597]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 31 11:11:31.966176185 (45h3m28.646371754s) [upload=39597]: Next segment err: context deadline exceeded Aug 31 11:11:31.966314379 (45h3m28.646509938s) [upload=39597]: Done uploading segments... Aug 31 11:11:31.966328927 (45h3m28.646524497s) [upload=39597]: Upload finished. err: context deadline exceeded Duration: 6.060136059s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 2.000572446s FAIL (2025-08-31 11:16:59 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.000600028s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [..XXX.......................................................] duration: 5.819012402s FAIL (2025-08-31 11:16:55 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.819035026s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 3 out of 60 is failed (threshold=3) [......X................................................XX...] duration: 6.036021985s FAIL (2025-08-31 11:16:39 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 6.036053014s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 3 out of 60 is failed (threshold=3) [X.................................................X....X....] duration: 1.988938486s FAIL (2025-08-31 11:16:35 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 31 11:13:44.970873573 (45h5m41.651069142s) [upload=39634]: Starting upload Aug 31 11:13:44.970949158 (45h5m41.651144727s) [upload=39634]: Done starting upload Aug 31 11:13:44.971018871 (45h5m41.65121444s) [upload=39634]: Uploading segments... Aug 31 11:13:44.971078174 (45h5m41.651273743s) [upload=39634]: Got next segment. Inline: true Aug 31 11:13:44.971082704 (45h5m41.651278273s) [upload=39634]: Waiting for error group managing segments... Aug 31 11:13:44.971114825 (45h5m41.651310394s) [upload=39634]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 11:13:44.971118532 (45h5m41.651314101s) [upload=39634]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 31 11:13:44.971121528 (45h5m41.651317097s) [upload=39634]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 31 11:13:50.376332558 (45h5m47.056528127s) [upload=39634]: Done uploading segments... Aug 31 11:13:50.376399666 (45h5m47.056595235s) [upload=39634]: Upload finished. err: <nil> Duration:* 1.98896258s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 6.00759282s FAIL (2025-08-31 11:16:35 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Aug 31 11:13:00.825343942 (45h4m57.505539511s) [upload=39627]: Starting upload Aug 31 11:13:00.825384589 (45h4m57.505580149s) [upload=39627]: Done starting upload Aug 31 11:13:00.825541009 (45h4m57.505736568s) [upload=39627]: Uploading segments... Aug 31 11:13:00.825579793 (45h4m57.505775362s) [upload=39627]: Got next segment. Inline: false Aug 31 11:13:00.825600693 (45h4m57.505796252s) [upload=39627]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 11:13:00.825604560 (45h4m57.505800129s) [upload=39627]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 31 11:13:01.708167688 (45h4m58.388363257s) [seg_pos={0 0}, upload=39627]: Begin upload segment... Aug 31 11:13:01.708224125 (45h4m58.388419695s) [seg_pos={0 0}, upload=39627]: Done begin upload segment. Aug 31 11:13:01.708248382 (45h4m58.388443961s) [noise=true , address=64.49.13.169:4709 , piece_id=5FUJXDUJJLTSAGJROSEZIBYUDPBF55XTNQLOD5WJHSJCVTRSO4UA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.708346640 (45h4m58.388542209s) [noise=true , address=104.36.82.35:4593 , piece_id=PRCATZUEA72YG2S4BTGEQ4ETUWVKMO3OCURBNLFAEGCSB5MDUKUQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.708955535 (45h4m58.389151114s) [noise=true , address=45.91.116.14:4195 , piece_id=UTIYQKVEKCDYGFQ6LX7PBJCGTA2QBMEN5Y7L5REIX4PUJ7WQSZ6Q, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709102236 (45h4m58.389297805s) [noise=true , address=104.36.82.15:4288 , piece_id=RHCPDOB7TEL65DYGJLJRJWC2SUHOV5FT5IZRERXUKHWZQVPGBHTA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709344399 (45h4m58.389539968s) [noise=true , address=64.49.13.155:4917 , piece_id=GSN5BNXY6VQJ63KASNN3MONOM6SV4BRM6WVIYLHGCGZNVK53HWXA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709551927 (45h4m58.389747506s) [noise=true , address=45.91.116.7:4034 , piece_id=LT7WEH3NX6T43P6WZFPREGKZ35R3UMEQYJBHAS4SW7N6CXHTUBOA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709590730 (45h4m58.3897863s) [noise=true , address=104.36.82.41:4775 , piece_id=7ESRGGJBNYHH4GH3PAACKOTPDKWV7ZRGQXYOUGVQJMYK2FQSNK4Q, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709842191 (45h4m58.390037771s) [noise=true , address=104.36.82.5:4853 , piece_id=O7HRHC2V53F22YV4FRE3F6U64PBVZK2AV2KYC4GNFEWHYZRJEOXA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710024290 (45h4m58.390219859s) [noise=true , address=77.90.31.21:4903 , piece_id=64466RMNHODOUS4YMYJBS46QNXS37PN3ZCMX56J6AWPF76BDJIFA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710071431 (45h4m58.390267s) [noise=true , address=104.36.82.48:4592 , piece_id=PACCJAF3QJXJSEUEJL7MRRLVR6ZRR4NLGDU42EAYK2VRTOBLAWGQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710298846 (45h4m58.390494415s) [noise=true , address=104.36.82.60:4360 , piece_id=JHBHFUQNTTMN6IVKTAVL4SUG27G2HHQOVY3VTFJDH4CZF7AEF56Q, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710486405 (45h4m58.390681984s) [noise=true , address=77.90.31.15:4714 , piece_id=EQ5HVZ67YWZTSI6K5FPNOAIIDBPV32KSCEZFP2MY45WALWMQNPDA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710556819 (45h4m58.390752388s) [noise=true , address=77.90.31.10:4544 , piece_id=YKJJXXMH3K2IJ2VGMRNCEEHUMOKMX3F4ZD72HPRQ6G7XNI5MPICA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710813581 (45h4m58.39100915s) [noise=true , address=77.90.31.11:4566 , piece_id=L5AZKS66QFUKXBCVO5NFR5MEDYTGIIHODHNBYXAFIH2YSE2TZR2A, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710945823 (45h4m58.391141402s) [noise=true , address=64.49.13.140:4508 , piece_id=O52JQJINRPKWLZI6NNPFJPZQYGDWHOMV3OHH6WYR2GFBKYRT7N3A, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.711040525 (45h4m58.391236094s) [noise=true , address=79.127.205.246:4263 , piece_id=2KPRXAVRMFEEMS32L3W2MSG7QJD5NLL2XVH5GOJIBDCVHUECVAEQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.711384572 (45h4m58.391580151s) [noise=true , address=104.36.82.53:4138 , piece_id=MFMGL7KSLNHYC4IQWD63O5KNIUOCDGYDKZUGGRTKAWMFTKZNFULQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.711796601 (45h4m58.39199218s) [noise=true , address=79.127.205.245:4251 , piece_id=G7VYPKSXFPKHVBAQDRKC7YCWWHZEQJUKWK4I3CAU4XMM2RRKM2YQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:02.809033683 (45h4m59.489229262s) [upload=39627]: Next returned nil segment Aug 31 11:13:02.809052139 (45h4m59.489247708s) [upload=39627]: Waiting for error group managing segments... Aug 31 11:13:03.110429755 (45h4m59.790625324s) [noise=true , address=79.127.205.245:4251 , piece_id=G7VYPKSXFPKHVBAQDRKC7YCWWHZEQJUKWK4I3CAU4XMM2RRKM2YQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.112669791 (45h4m59.79286538s) [noise=true , address=64.49.13.140:4508 , piece_id=O52JQJINRPKWLZI6NNPFJPZQYGDWHOMV3OHH6WYR2GFBKYRT7N3A, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.128781550 (45h4m59.808977119s) [noise=true , address=79.127.205.246:4263 , piece_id=2KPRXAVRMFEEMS32L3W2MSG7QJD5NLL2XVH5GOJIBDCVHUECVAEQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.142878824 (45h4m59.823074393s) [noise=true , address=64.49.13.155:4917 , piece_id=GSN5BNXY6VQJ63KASNN3MONOM6SV4BRM6WVIYLHGCGZNVK53HWXA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.202555682 (45h4m59.882751251s) [noise=true , address=64.49.13.169:4709 , piece_id=5FUJXDUJJLTSAGJROSEZIBYUDPBF55XTNQLOD5WJHSJCVTRSO4UA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.647619373 (45h5m0.327814942s) [noise=true , address=45.91.116.14:4195 , piece_id=UTIYQKVEKCDYGFQ6LX7PBJCGTA2QBMEN5Y7L5REIX4PUJ7WQSZ6Q, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.680334441 (45h5m0.36053001s) [noise=true , address=104.36.82.35:4593 , piece_id=PRCATZUEA72YG2S4BTGEQ4ETUWVKMO3OCURBNLFAEGCSB5MDUKUQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.737634971 (45h5m0.41783054s) [noise=true , address=45.91.116.7:4034 , piece_id=LT7WEH3NX6T43P6WZFPREGKZ35R3UMEQYJBHAS4SW7N6CXHTUBOA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.749306554 (45h5m0.429502124s) [noise=true , address=104.36.82.48:4592 , piece_id=PACCJAF3QJXJSEUEJL7MRRLVR6ZRR4NLGDU42EAYK2VRTOBLAWGQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.750058222 (45h5m0.430253791s) [noise=true , address=104.36.82.5:4853 , piece_id=O7HRHC2V53F22YV4FRE3F6U64PBVZK2AV2KYC4GNFEWHYZRJEOXA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.752613201 (45h5m0.43280877s) [noise=true , address=104.36.82.15:4288 , piece_id=RHCPDOB7TEL65DYGJLJRJWC2SUHOV5FT5IZRERXUKHWZQVPGBHTA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.783046874 (45h5m0.463242443s) [noise=true , address=77.90.31.11:4566 , piece_id=L5AZKS66QFUKXBCVO5NFR5MEDYTGIIHODHNBYXAFIH2YSE2TZR2A, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.783337791 (45h5m0.46353336s) [noise=true , address=77.90.31.15:4714 , piece_id=EQ5HVZ67YWZTSI6K5FPNOAIIDBPV32KSCEZFP2MY45WALWMQNPDA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.814218168 (45h5m0.494413727s) [noise=true , address=77.90.31.10:4544 , piece_id=YKJJXXMH3K2IJ2VGMRNCEEHUMOKMX3F4ZD72HPRQ6G7XNI5MPICA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.814246252 (45h5m0.494441811s) [seg_pos={0 0}, upload=39627]: Segment reached optimal threshold of 14 pieces. Aug 31 11:13:03.814359448 (45h5m0.494555017s) [noise=true , address=104.36.82.60:4360 , piece_id=JHBHFUQNTTMN6IVKTAVL4SUG27G2HHQOVY3VTFJDH4CZF7AEF56Q, seg_pos={0 0}, upload=39627]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T24rtYBJ47E6Ef1ZZKMWcpBrWBpCg5QV2ZHniCZZkzJF2yUNk): protocol: expected piece hash; context canceled; EOF Aug 31 11:13:03.814418081 (45h5m0.49461364s) [noise=true , address=104.36.82.53:4138 , piece_id=MFMGL7KSLNHYC4IQWD63O5KNIUOCDGYDKZUGGRTKAWMFTKZNFULQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YUGGJg6mWeQMmzSNWtLFWAaWwaKWfEf8wxXs1jwiZaA9nhsr3): protocol: expected piece hash; context canceled; EOF Aug 31 11:13:03.814483546 (45h5m0.494679115s) [noise=true , address=104.36.82.41:4775 , piece_id=7ESRGGJBNYHH4GH3PAACKOTPDKWV7ZRGQXYOUGVQJMYK2FQSNK4Q, seg_pos={0 0}, upload=39627]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:166yRbNnnDeZRifM5q7vUVLx7iV5cZ9GqQnmvD9AbUUJsaCjmj): protocol: expected piece hash; context canceled; EOF Aug 31 11:13:03.814510187 (45h5m0.494705746s) [noise=true , address=77.90.31.21:4903 , piece_id=64466RMNHODOUS4YMYJBS46QNXS37PN3ZCMX56J6AWPF76BDJIFA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZYWQ1a2sTKnFpF28iQVrem2s8nSpXkeJzZDaS7jvTZNANdfp): protocol: expected piece hash; context canceled; EOF Aug 31 11:13:03.814533913 (45h5m0.494729482s) [seg_pos={0 0}, upload=39627]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 31 11:13:03.814608635 (45h5m0.494804204s) [upload=39627]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 31 11:13:03.814612623 (45h5m0.494808193s) [upload=39627]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 31 11:13:06.785691131 (45h5m3.4658867s) [upload=39627]: Done uploading segments... Aug 31 11:13:06.785708434 (45h5m3.465904004s) [upload=39627]: Upload finished. err: <nil> Duration: 6.007622357s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 6.828260894s FAIL (2025-08-31 11:16:34 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.828286112s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [....X..............................................XX.......] duration: 6.09765082s FAIL (2025-08-31 11:16:32 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Aug 31 11:11:03.184991323 (45h2m59.865186892s) [upload=39597]: Starting upload Aug 31 11:11:03.185066988 (45h2m59.865262567s) [upload=39597]: Done starting upload Aug 31 11:11:03.185180816 (45h2m59.865376395s) [upload=39597]: Uploading segments... Aug 31 11:11:03.185275988 (45h2m59.865471557s) [upload=39597]: Got next segment. Inline: false Aug 31 11:11:03.185312367 (45h2m59.865507936s) [upload=39597]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 11:11:03.185316826 (45h2m59.865512395s) [upload=39597]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 31 11:11:31.966176185 (45h3m28.646371754s) [upload=39597]: Next segment err: context deadline exceeded Aug 31 11:11:31.966314379 (45h3m28.646509938s) [upload=39597]: Done uploading segments... Aug 31 11:11:31.966328927 (45h3m28.646524497s) [upload=39597]: Upload finished. err: context deadline exceeded Duration: 6.097669025s core uplink us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 2 out of 60 is failed (threshold=3) [X....................................................X......] duration: 706.476247ms target: https://us1.storj.io/login FAIL (2025-08-31 11:16:28 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout Duration: 706.490404ms core satellite us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [...XXX......................................................] duration: 5.932324304s FAIL (2025-08-31 11:16:25 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.932347719s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 2.117938149s FAIL (2025-08-31 11:16:24 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.117962156s core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 6.426693225s FAIL (2025-08-31 11:16:16 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.426900531s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 4 out of 60 is failed (threshold=3) [XX.................................................X....X...] duration: 1.990602279s FAIL (2025-08-31 11:16:11 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 31 11:13:44.970873573 (45h5m41.651069142s) [upload=39634]: Starting upload Aug 31 11:13:44.970949158 (45h5m41.651144727s) [upload=39634]: Done starting upload Aug 31 11:13:44.971018871 (45h5m41.65121444s) [upload=39634]: Uploading segments... Aug 31 11:13:44.971078174 (45h5m41.651273743s) [upload=39634]: Got next segment. Inline: true Aug 31 11:13:44.971082704 (45h5m41.651278273s) [upload=39634]: Waiting for error group managing segments... Aug 31 11:13:44.971114825 (45h5m41.651310394s) [upload=39634]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 11:13:44.971118532 (45h5m41.651314101s) [upload=39634]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 31 11:13:44.971121528 (45h5m41.651317097s) [upload=39634]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 31 11:13:50.376332558 (45h5m47.056528127s) [upload=39634]: Done uploading segments... Aug 31 11:13:50.376399666 (45h5m47.056595235s) [upload=39634]: Upload finished. err: <nil> Duration:* 1.990629232s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 2.011585779s FAIL (2025-08-31 11:16:04 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.011639502s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 1.995576618s FAIL (2025-08-31 11:16:00 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 1.995602537s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 2 out of 60 is failed (threshold=3) [.X....................................................X.....] duration: 703.189058ms target: https://us1.storj.io/login FAIL (2025-08-31 11:16:00 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout Duration: 703.209659ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 1.958637726s FAIL (2025-08-31 11:15:45 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 1.958664056s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.....X..............................................XX......] duration: 5.941201351s FAIL (2025-08-31 11:15:40 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Aug 31 11:11:03.184991323 (45h2m59.865186892s) [upload=39597]: Starting upload Aug 31 11:11:03.185066988 (45h2m59.865262567s) [upload=39597]: Done starting upload Aug 31 11:11:03.185180816 (45h2m59.865376395s) [upload=39597]: Uploading segments... Aug 31 11:11:03.185275988 (45h2m59.865471557s) [upload=39597]: Got next segment. Inline: false Aug 31 11:11:03.185312367 (45h2m59.865507936s) [upload=39597]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 11:11:03.185316826 (45h2m59.865512395s) [upload=39597]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 31 11:11:31.966176185 (45h3m28.646371754s) [upload=39597]: Next segment err: context deadline exceeded Aug 31 11:11:31.966314379 (45h3m28.646509938s) [upload=39597]: Done uploading segments... Aug 31 11:11:31.966328927 (45h3m28.646524497s) [upload=39597]: Upload finished. err: context deadline exceeded Duration: 5.941225887s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 21.350978973s FAIL (2025-08-31 11:15:30 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 21.350998661s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 4 out of 60 is failed (threshold=3) [.XX.................................................X....X..] duration: 2.041684471s FAIL (2025-08-31 11:15:29 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 31 11:13:44.970873573 (45h5m41.651069142s) [upload=39634]: Starting upload Aug 31 11:13:44.970949158 (45h5m41.651144727s) [upload=39634]: Done starting upload Aug 31 11:13:44.971018871 (45h5m41.65121444s) [upload=39634]: Uploading segments... Aug 31 11:13:44.971078174 (45h5m41.651273743s) [upload=39634]: Got next segment. Inline: true Aug 31 11:13:44.971082704 (45h5m41.651278273s) [upload=39634]: Waiting for error group managing segments... Aug 31 11:13:44.971114825 (45h5m41.651310394s) [upload=39634]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 11:13:44.971118532 (45h5m41.651314101s) [upload=39634]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 31 11:13:44.971121528 (45h5m41.651317097s) [upload=39634]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 31 11:13:50.376332558 (45h5m47.056528127s) [upload=39634]: Done uploading segments... Aug 31 11:13:50.376399666 (45h5m47.056595235s) [upload=39634]: Upload finished. err: <nil> Duration:* 2.041708097s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.......X................................................XX..] duration: 6.132615353s FAIL (2025-08-31 11:15:29 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 6.132642314s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 2.015088053s FAIL (2025-08-31 11:15:28 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.015114973s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [......X..............................................XX.....] duration: 7.071503914s FAIL (2025-08-31 11:15:24 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Aug 31 11:11:03.184991323 (45h2m59.865186892s) [upload=39597]: Starting upload Aug 31 11:11:03.185066988 (45h2m59.865262567s) [upload=39597]: Done starting upload Aug 31 11:11:03.185180816 (45h2m59.865376395s) [upload=39597]: Uploading segments... Aug 31 11:11:03.185275988 (45h2m59.865471557s) [upload=39597]: Got next segment. Inline: false Aug 31 11:11:03.185312367 (45h2m59.865507936s) [upload=39597]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 11:11:03.185316826 (45h2m59.865512395s) [upload=39597]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 31 11:11:31.966176185 (45h3m28.646371754s) [upload=39597]: Next segment err: context deadline exceeded Aug 31 11:11:31.966314379 (45h3m28.646509938s) [upload=39597]: Done uploading segments... Aug 31 11:11:31.966328927 (45h3m28.646524497s) [upload=39597]: Upload finished. err: context deadline exceeded Duration: 7.071531217s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 5.834570382s FAIL (2025-08-31 11:15:21 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Aug 31 11:13:00.825343942 (45h4m57.505539511s) [upload=39627]: Starting upload Aug 31 11:13:00.825384589 (45h4m57.505580149s) [upload=39627]: Done starting upload Aug 31 11:13:00.825541009 (45h4m57.505736568s) [upload=39627]: Uploading segments... Aug 31 11:13:00.825579793 (45h4m57.505775362s) [upload=39627]: Got next segment. Inline: false Aug 31 11:13:00.825600693 (45h4m57.505796252s) [upload=39627]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 11:13:00.825604560 (45h4m57.505800129s) [upload=39627]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 31 11:13:01.708167688 (45h4m58.388363257s) [seg_pos={0 0}, upload=39627]: Begin upload segment... Aug 31 11:13:01.708224125 (45h4m58.388419695s) [seg_pos={0 0}, upload=39627]: Done begin upload segment. Aug 31 11:13:01.708248382 (45h4m58.388443961s) [noise=true , address=64.49.13.169:4709 , piece_id=5FUJXDUJJLTSAGJROSEZIBYUDPBF55XTNQLOD5WJHSJCVTRSO4UA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.708346640 (45h4m58.388542209s) [noise=true , address=104.36.82.35:4593 , piece_id=PRCATZUEA72YG2S4BTGEQ4ETUWVKMO3OCURBNLFAEGCSB5MDUKUQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.708955535 (45h4m58.389151114s) [noise=true , address=45.91.116.14:4195 , piece_id=UTIYQKVEKCDYGFQ6LX7PBJCGTA2QBMEN5Y7L5REIX4PUJ7WQSZ6Q, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709102236 (45h4m58.389297805s) [noise=true , address=104.36.82.15:4288 , piece_id=RHCPDOB7TEL65DYGJLJRJWC2SUHOV5FT5IZRERXUKHWZQVPGBHTA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709344399 (45h4m58.389539968s) [noise=true , address=64.49.13.155:4917 , piece_id=GSN5BNXY6VQJ63KASNN3MONOM6SV4BRM6WVIYLHGCGZNVK53HWXA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709551927 (45h4m58.389747506s) [noise=true , address=45.91.116.7:4034 , piece_id=LT7WEH3NX6T43P6WZFPREGKZ35R3UMEQYJBHAS4SW7N6CXHTUBOA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709590730 (45h4m58.3897863s) [noise=true , address=104.36.82.41:4775 , piece_id=7ESRGGJBNYHH4GH3PAACKOTPDKWV7ZRGQXYOUGVQJMYK2FQSNK4Q, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709842191 (45h4m58.390037771s) [noise=true , address=104.36.82.5:4853 , piece_id=O7HRHC2V53F22YV4FRE3F6U64PBVZK2AV2KYC4GNFEWHYZRJEOXA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710024290 (45h4m58.390219859s) [noise=true , address=77.90.31.21:4903 , piece_id=64466RMNHODOUS4YMYJBS46QNXS37PN3ZCMX56J6AWPF76BDJIFA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710071431 (45h4m58.390267s) [noise=true , address=104.36.82.48:4592 , piece_id=PACCJAF3QJXJSEUEJL7MRRLVR6ZRR4NLGDU42EAYK2VRTOBLAWGQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710298846 (45h4m58.390494415s) [noise=true , address=104.36.82.60:4360 , piece_id=JHBHFUQNTTMN6IVKTAVL4SUG27G2HHQOVY3VTFJDH4CZF7AEF56Q, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710486405 (45h4m58.390681984s) [noise=true , address=77.90.31.15:4714 , piece_id=EQ5HVZ67YWZTSI6K5FPNOAIIDBPV32KSCEZFP2MY45WALWMQNPDA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710556819 (45h4m58.390752388s) [noise=true , address=77.90.31.10:4544 , piece_id=YKJJXXMH3K2IJ2VGMRNCEEHUMOKMX3F4ZD72HPRQ6G7XNI5MPICA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710813581 (45h4m58.39100915s) [noise=true , address=77.90.31.11:4566 , piece_id=L5AZKS66QFUKXBCVO5NFR5MEDYTGIIHODHNBYXAFIH2YSE2TZR2A, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710945823 (45h4m58.391141402s) [noise=true , address=64.49.13.140:4508 , piece_id=O52JQJINRPKWLZI6NNPFJPZQYGDWHOMV3OHH6WYR2GFBKYRT7N3A, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.711040525 (45h4m58.391236094s) [noise=true , address=79.127.205.246:4263 , piece_id=2KPRXAVRMFEEMS32L3W2MSG7QJD5NLL2XVH5GOJIBDCVHUECVAEQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.711384572 (45h4m58.391580151s) [noise=true , address=104.36.82.53:4138 , piece_id=MFMGL7KSLNHYC4IQWD63O5KNIUOCDGYDKZUGGRTKAWMFTKZNFULQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.711796601 (45h4m58.39199218s) [noise=true , address=79.127.205.245:4251 , piece_id=G7VYPKSXFPKHVBAQDRKC7YCWWHZEQJUKWK4I3CAU4XMM2RRKM2YQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:02.809033683 (45h4m59.489229262s) [upload=39627]: Next returned nil segment Aug 31 11:13:02.809052139 (45h4m59.489247708s) [upload=39627]: Waiting for error group managing segments... Aug 31 11:13:03.110429755 (45h4m59.790625324s) [noise=true , address=79.127.205.245:4251 , piece_id=G7VYPKSXFPKHVBAQDRKC7YCWWHZEQJUKWK4I3CAU4XMM2RRKM2YQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.112669791 (45h4m59.79286538s) [noise=true , address=64.49.13.140:4508 , piece_id=O52JQJINRPKWLZI6NNPFJPZQYGDWHOMV3OHH6WYR2GFBKYRT7N3A, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.128781550 (45h4m59.808977119s) [noise=true , address=79.127.205.246:4263 , piece_id=2KPRXAVRMFEEMS32L3W2MSG7QJD5NLL2XVH5GOJIBDCVHUECVAEQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.142878824 (45h4m59.823074393s) [noise=true , address=64.49.13.155:4917 , piece_id=GSN5BNXY6VQJ63KASNN3MONOM6SV4BRM6WVIYLHGCGZNVK53HWXA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.202555682 (45h4m59.882751251s) [noise=true , address=64.49.13.169:4709 , piece_id=5FUJXDUJJLTSAGJROSEZIBYUDPBF55XTNQLOD5WJHSJCVTRSO4UA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.647619373 (45h5m0.327814942s) [noise=true , address=45.91.116.14:4195 , piece_id=UTIYQKVEKCDYGFQ6LX7PBJCGTA2QBMEN5Y7L5REIX4PUJ7WQSZ6Q, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.680334441 (45h5m0.36053001s) [noise=true , address=104.36.82.35:4593 , piece_id=PRCATZUEA72YG2S4BTGEQ4ETUWVKMO3OCURBNLFAEGCSB5MDUKUQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.737634971 (45h5m0.41783054s) [noise=true , address=45.91.116.7:4034 , piece_id=LT7WEH3NX6T43P6WZFPREGKZ35R3UMEQYJBHAS4SW7N6CXHTUBOA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.749306554 (45h5m0.429502124s) [noise=true , address=104.36.82.48:4592 , piece_id=PACCJAF3QJXJSEUEJL7MRRLVR6ZRR4NLGDU42EAYK2VRTOBLAWGQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.750058222 (45h5m0.430253791s) [noise=true , address=104.36.82.5:4853 , piece_id=O7HRHC2V53F22YV4FRE3F6U64PBVZK2AV2KYC4GNFEWHYZRJEOXA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.752613201 (45h5m0.43280877s) [noise=true , address=104.36.82.15:4288 , piece_id=RHCPDOB7TEL65DYGJLJRJWC2SUHOV5FT5IZRERXUKHWZQVPGBHTA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.783046874 (45h5m0.463242443s) [noise=true , address=77.90.31.11:4566 , piece_id=L5AZKS66QFUKXBCVO5NFR5MEDYTGIIHODHNBYXAFIH2YSE2TZR2A, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.783337791 (45h5m0.46353336s) [noise=true , address=77.90.31.15:4714 , piece_id=EQ5HVZ67YWZTSI6K5FPNOAIIDBPV32KSCEZFP2MY45WALWMQNPDA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.814218168 (45h5m0.494413727s) [noise=true , address=77.90.31.10:4544 , piece_id=YKJJXXMH3K2IJ2VGMRNCEEHUMOKMX3F4ZD72HPRQ6G7XNI5MPICA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.814246252 (45h5m0.494441811s) [seg_pos={0 0}, upload=39627]: Segment reached optimal threshold of 14 pieces. Aug 31 11:13:03.814359448 (45h5m0.494555017s) [noise=true , address=104.36.82.60:4360 , piece_id=JHBHFUQNTTMN6IVKTAVL4SUG27G2HHQOVY3VTFJDH4CZF7AEF56Q, seg_pos={0 0}, upload=39627]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T24rtYBJ47E6Ef1ZZKMWcpBrWBpCg5QV2ZHniCZZkzJF2yUNk): protocol: expected piece hash; context canceled; EOF Aug 31 11:13:03.814418081 (45h5m0.49461364s) [noise=true , address=104.36.82.53:4138 , piece_id=MFMGL7KSLNHYC4IQWD63O5KNIUOCDGYDKZUGGRTKAWMFTKZNFULQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YUGGJg6mWeQMmzSNWtLFWAaWwaKWfEf8wxXs1jwiZaA9nhsr3): protocol: expected piece hash; context canceled; EOF Aug 31 11:13:03.814483546 (45h5m0.494679115s) [noise=true , address=104.36.82.41:4775 , piece_id=7ESRGGJBNYHH4GH3PAACKOTPDKWV7ZRGQXYOUGVQJMYK2FQSNK4Q, seg_pos={0 0}, upload=39627]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:166yRbNnnDeZRifM5q7vUVLx7iV5cZ9GqQnmvD9AbUUJsaCjmj): protocol: expected piece hash; context canceled; EOF Aug 31 11:13:03.814510187 (45h5m0.494705746s) [noise=true , address=77.90.31.21:4903 , piece_id=64466RMNHODOUS4YMYJBS46QNXS37PN3ZCMX56J6AWPF76BDJIFA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZYWQ1a2sTKnFpF28iQVrem2s8nSpXkeJzZDaS7jvTZNANdfp): protocol: expected piece hash; context canceled; EOF Aug 31 11:13:03.814533913 (45h5m0.494729482s) [seg_pos={0 0}, upload=39627]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 31 11:13:03.814608635 (45h5m0.494804204s) [upload=39627]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 31 11:13:03.814612623 (45h5m0.494808193s) [upload=39627]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 31 11:13:06.785691131 (45h5m3.4658867s) [upload=39627]: Done uploading segments... Aug 31 11:13:06.785708434 (45h5m3.465904004s) [upload=39627]: Upload finished. err: <nil> Duration: 5.834596991s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [....XXX.....................................................] duration: 6.111269096s FAIL (2025-08-31 11:15:19 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.111289955s edge gateway us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 2 out of 60 is failed (threshold=3) [..X....................................................X....] duration: 725.441376ms target: https://us1.storj.io/login FAIL (2025-08-31 11:15:18 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout Duration: 725.471032ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [X.......................................................X...] duration: 2.006986879s FAIL (2025-08-31 11:15:10 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.007006849s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 3 out of 60 is failed (threshold=3) [........X................................................XX.] duration: 12.030468222s FAIL (2025-08-31 11:15:08 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 12.030502158s core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 11.006953415s FAIL (2025-08-31 11:15:04 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 11.006973043s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 12.983048223s FAIL (2025-08-31 11:15:02 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Aug 31 11:13:00.825343942 (45h4m57.505539511s) [upload=39627]: Starting upload Aug 31 11:13:00.825384589 (45h4m57.505580149s) [upload=39627]: Done starting upload Aug 31 11:13:00.825541009 (45h4m57.505736568s) [upload=39627]: Uploading segments... Aug 31 11:13:00.825579793 (45h4m57.505775362s) [upload=39627]: Got next segment. Inline: false Aug 31 11:13:00.825600693 (45h4m57.505796252s) [upload=39627]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 11:13:00.825604560 (45h4m57.505800129s) [upload=39627]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 31 11:13:01.708167688 (45h4m58.388363257s) [seg_pos={0 0}, upload=39627]: Begin upload segment... Aug 31 11:13:01.708224125 (45h4m58.388419695s) [seg_pos={0 0}, upload=39627]: Done begin upload segment. Aug 31 11:13:01.708248382 (45h4m58.388443961s) [noise=true , address=64.49.13.169:4709 , piece_id=5FUJXDUJJLTSAGJROSEZIBYUDPBF55XTNQLOD5WJHSJCVTRSO4UA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.708346640 (45h4m58.388542209s) [noise=true , address=104.36.82.35:4593 , piece_id=PRCATZUEA72YG2S4BTGEQ4ETUWVKMO3OCURBNLFAEGCSB5MDUKUQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.708955535 (45h4m58.389151114s) [noise=true , address=45.91.116.14:4195 , piece_id=UTIYQKVEKCDYGFQ6LX7PBJCGTA2QBMEN5Y7L5REIX4PUJ7WQSZ6Q, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709102236 (45h4m58.389297805s) [noise=true , address=104.36.82.15:4288 , piece_id=RHCPDOB7TEL65DYGJLJRJWC2SUHOV5FT5IZRERXUKHWZQVPGBHTA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709344399 (45h4m58.389539968s) [noise=true , address=64.49.13.155:4917 , piece_id=GSN5BNXY6VQJ63KASNN3MONOM6SV4BRM6WVIYLHGCGZNVK53HWXA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709551927 (45h4m58.389747506s) [noise=true , address=45.91.116.7:4034 , piece_id=LT7WEH3NX6T43P6WZFPREGKZ35R3UMEQYJBHAS4SW7N6CXHTUBOA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709590730 (45h4m58.3897863s) [noise=true , address=104.36.82.41:4775 , piece_id=7ESRGGJBNYHH4GH3PAACKOTPDKWV7ZRGQXYOUGVQJMYK2FQSNK4Q, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709842191 (45h4m58.390037771s) [noise=true , address=104.36.82.5:4853 , piece_id=O7HRHC2V53F22YV4FRE3F6U64PBVZK2AV2KYC4GNFEWHYZRJEOXA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710024290 (45h4m58.390219859s) [noise=true , address=77.90.31.21:4903 , piece_id=64466RMNHODOUS4YMYJBS46QNXS37PN3ZCMX56J6AWPF76BDJIFA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710071431 (45h4m58.390267s) [noise=true , address=104.36.82.48:4592 , piece_id=PACCJAF3QJXJSEUEJL7MRRLVR6ZRR4NLGDU42EAYK2VRTOBLAWGQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710298846 (45h4m58.390494415s) [noise=true , address=104.36.82.60:4360 , piece_id=JHBHFUQNTTMN6IVKTAVL4SUG27G2HHQOVY3VTFJDH4CZF7AEF56Q, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710486405 (45h4m58.390681984s) [noise=true , address=77.90.31.15:4714 , piece_id=EQ5HVZ67YWZTSI6K5FPNOAIIDBPV32KSCEZFP2MY45WALWMQNPDA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710556819 (45h4m58.390752388s) [noise=true , address=77.90.31.10:4544 , piece_id=YKJJXXMH3K2IJ2VGMRNCEEHUMOKMX3F4ZD72HPRQ6G7XNI5MPICA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710813581 (45h4m58.39100915s) [noise=true , address=77.90.31.11:4566 , piece_id=L5AZKS66QFUKXBCVO5NFR5MEDYTGIIHODHNBYXAFIH2YSE2TZR2A, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710945823 (45h4m58.391141402s) [noise=true , address=64.49.13.140:4508 , piece_id=O52JQJINRPKWLZI6NNPFJPZQYGDWHOMV3OHH6WYR2GFBKYRT7N3A, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.711040525 (45h4m58.391236094s) [noise=true , address=79.127.205.246:4263 , piece_id=2KPRXAVRMFEEMS32L3W2MSG7QJD5NLL2XVH5GOJIBDCVHUECVAEQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.711384572 (45h4m58.391580151s) [noise=true , address=104.36.82.53:4138 , piece_id=MFMGL7KSLNHYC4IQWD63O5KNIUOCDGYDKZUGGRTKAWMFTKZNFULQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.711796601 (45h4m58.39199218s) [noise=true , address=79.127.205.245:4251 , piece_id=G7VYPKSXFPKHVBAQDRKC7YCWWHZEQJUKWK4I3CAU4XMM2RRKM2YQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:02.809033683 (45h4m59.489229262s) [upload=39627]: Next returned nil segment Aug 31 11:13:02.809052139 (45h4m59.489247708s) [upload=39627]: Waiting for error group managing segments... Aug 31 11:13:03.110429755 (45h4m59.790625324s) [noise=true , address=79.127.205.245:4251 , piece_id=G7VYPKSXFPKHVBAQDRKC7YCWWHZEQJUKWK4I3CAU4XMM2RRKM2YQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.112669791 (45h4m59.79286538s) [noise=true , address=64.49.13.140:4508 , piece_id=O52JQJINRPKWLZI6NNPFJPZQYGDWHOMV3OHH6WYR2GFBKYRT7N3A, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.128781550 (45h4m59.808977119s) [noise=true , address=79.127.205.246:4263 , piece_id=2KPRXAVRMFEEMS32L3W2MSG7QJD5NLL2XVH5GOJIBDCVHUECVAEQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.142878824 (45h4m59.823074393s) [noise=true , address=64.49.13.155:4917 , piece_id=GSN5BNXY6VQJ63KASNN3MONOM6SV4BRM6WVIYLHGCGZNVK53HWXA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.202555682 (45h4m59.882751251s) [noise=true , address=64.49.13.169:4709 , piece_id=5FUJXDUJJLTSAGJROSEZIBYUDPBF55XTNQLOD5WJHSJCVTRSO4UA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.647619373 (45h5m0.327814942s) [noise=true , address=45.91.116.14:4195 , piece_id=UTIYQKVEKCDYGFQ6LX7PBJCGTA2QBMEN5Y7L5REIX4PUJ7WQSZ6Q, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.680334441 (45h5m0.36053001s) [noise=true , address=104.36.82.35:4593 , piece_id=PRCATZUEA72YG2S4BTGEQ4ETUWVKMO3OCURBNLFAEGCSB5MDUKUQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.737634971 (45h5m0.41783054s) [noise=true , address=45.91.116.7:4034 , piece_id=LT7WEH3NX6T43P6WZFPREGKZ35R3UMEQYJBHAS4SW7N6CXHTUBOA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.749306554 (45h5m0.429502124s) [noise=true , address=104.36.82.48:4592 , piece_id=PACCJAF3QJXJSEUEJL7MRRLVR6ZRR4NLGDU42EAYK2VRTOBLAWGQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.750058222 (45h5m0.430253791s) [noise=true , address=104.36.82.5:4853 , piece_id=O7HRHC2V53F22YV4FRE3F6U64PBVZK2AV2KYC4GNFEWHYZRJEOXA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.752613201 (45h5m0.43280877s) [noise=true , address=104.36.82.15:4288 , piece_id=RHCPDOB7TEL65DYGJLJRJWC2SUHOV5FT5IZRERXUKHWZQVPGBHTA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.783046874 (45h5m0.463242443s) [noise=true , address=77.90.31.11:4566 , piece_id=L5AZKS66QFUKXBCVO5NFR5MEDYTGIIHODHNBYXAFIH2YSE2TZR2A, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.783337791 (45h5m0.46353336s) [noise=true , address=77.90.31.15:4714 , piece_id=EQ5HVZ67YWZTSI6K5FPNOAIIDBPV32KSCEZFP2MY45WALWMQNPDA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.814218168 (45h5m0.494413727s) [noise=true , address=77.90.31.10:4544 , piece_id=YKJJXXMH3K2IJ2VGMRNCEEHUMOKMX3F4ZD72HPRQ6G7XNI5MPICA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.814246252 (45h5m0.494441811s) [seg_pos={0 0}, upload=39627]: Segment reached optimal threshold of 14 pieces. Aug 31 11:13:03.814359448 (45h5m0.494555017s) [noise=true , address=104.36.82.60:4360 , piece_id=JHBHFUQNTTMN6IVKTAVL4SUG27G2HHQOVY3VTFJDH4CZF7AEF56Q, seg_pos={0 0}, upload=39627]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T24rtYBJ47E6Ef1ZZKMWcpBrWBpCg5QV2ZHniCZZkzJF2yUNk): protocol: expected piece hash; context canceled; EOF Aug 31 11:13:03.814418081 (45h5m0.49461364s) [noise=true , address=104.36.82.53:4138 , piece_id=MFMGL7KSLNHYC4IQWD63O5KNIUOCDGYDKZUGGRTKAWMFTKZNFULQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YUGGJg6mWeQMmzSNWtLFWAaWwaKWfEf8wxXs1jwiZaA9nhsr3): protocol: expected piece hash; context canceled; EOF Aug 31 11:13:03.814483546 (45h5m0.494679115s) [noise=true , address=104.36.82.41:4775 , piece_id=7ESRGGJBNYHH4GH3PAACKOTPDKWV7ZRGQXYOUGVQJMYK2FQSNK4Q, seg_pos={0 0}, upload=39627]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:166yRbNnnDeZRifM5q7vUVLx7iV5cZ9GqQnmvD9AbUUJsaCjmj): protocol: expected piece hash; context canceled; EOF Aug 31 11:13:03.814510187 (45h5m0.494705746s) [noise=true , address=77.90.31.21:4903 , piece_id=64466RMNHODOUS4YMYJBS46QNXS37PN3ZCMX56J6AWPF76BDJIFA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZYWQ1a2sTKnFpF28iQVrem2s8nSpXkeJzZDaS7jvTZNANdfp): protocol: expected piece hash; context canceled; EOF Aug 31 11:13:03.814533913 (45h5m0.494729482s) [seg_pos={0 0}, upload=39627]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 31 11:13:03.814608635 (45h5m0.494804204s) [upload=39627]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 31 11:13:03.814612623 (45h5m0.494808193s) [upload=39627]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 31 11:13:06.785691131 (45h5m3.4658867s) [upload=39627]: Done uploading segments... Aug 31 11:13:06.785708434 (45h5m3.465904004s) [upload=39627]: Upload finished. err: <nil> Duration: 12.983080735s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.....XXX....................................................] duration: 5.812897145s FAIL (2025-08-31 11:14:59 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.812917594s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.........X................................................XX] duration: 30.003525339s FAIL (2025-08-31 11:14:54 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 30.00355746s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 12.143509036s FAIL (2025-08-31 11:14:51 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 12.143536329s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.......X..............................................XX....] duration: 16.016572725s FAIL (2025-08-31 11:14:50 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Aug 31 11:11:03.184991323 (45h2m59.865186892s) [upload=39597]: Starting upload Aug 31 11:11:03.185066988 (45h2m59.865262567s) [upload=39597]: Done starting upload Aug 31 11:11:03.185180816 (45h2m59.865376395s) [upload=39597]: Uploading segments... Aug 31 11:11:03.185275988 (45h2m59.865471557s) [upload=39597]: Got next segment. Inline: false Aug 31 11:11:03.185312367 (45h2m59.865507936s) [upload=39597]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 11:11:03.185316826 (45h2m59.865512395s) [upload=39597]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 31 11:11:31.966176185 (45h3m28.646371754s) [upload=39597]: Next segment err: context deadline exceeded Aug 31 11:11:31.966314379 (45h3m28.646509938s) [upload=39597]: Done uploading segments... Aug 31 11:11:31.966328927 (45h3m28.646524497s) [upload=39597]: Upload finished. err: context deadline exceeded Duration: 16.016595138s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 4 out of 60 is failed (threshold=3) [..XX.................................................X....X.] duration: 16.585423934s FAIL (2025-08-31 11:14:50 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 31 11:13:44.970873573 (45h5m41.651069142s) [upload=39634]: Starting upload Aug 31 11:13:44.970949158 (45h5m41.651144727s) [upload=39634]: Done starting upload Aug 31 11:13:44.971018871 (45h5m41.65121444s) [upload=39634]: Uploading segments... Aug 31 11:13:44.971078174 (45h5m41.651273743s) [upload=39634]: Got next segment. Inline: true Aug 31 11:13:44.971082704 (45h5m41.651278273s) [upload=39634]: Waiting for error group managing segments... Aug 31 11:13:44.971114825 (45h5m41.651310394s) [upload=39634]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 11:13:44.971118532 (45h5m41.651314101s) [upload=39634]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 31 11:13:44.971121528 (45h5m41.651317097s) [upload=39634]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 31 11:13:50.376332558 (45h5m47.056528127s) [upload=39634]: Done uploading segments... Aug 31 11:13:50.376399666 (45h5m47.056595235s) [upload=39634]: Upload finished. err: <nil> Duration:* 16.585448742s core uplink us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)