Orbiter History

checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 6.411728757s FAIL (2025-08-31 11:39:25 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.411747372s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........................XX................................] duration: 6.095122884s FAIL (2025-08-31 11:39:22 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 6.095151759s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..................XX........................................] duration: 6.990738903s FAIL (2025-08-31 11:39:20 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Aug 31 11:11:03.184991323 (45h2m59.865186892s) [upload=39597]: Starting upload Aug 31 11:11:03.185066988 (45h2m59.865262567s) [upload=39597]: Done starting upload Aug 31 11:11:03.185180816 (45h2m59.865376395s) [upload=39597]: Uploading segments... Aug 31 11:11:03.185275988 (45h2m59.865471557s) [upload=39597]: Got next segment. Inline: false Aug 31 11:11:03.185312367 (45h2m59.865507936s) [upload=39597]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 11:11:03.185316826 (45h2m59.865512395s) [upload=39597]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 31 11:11:31.966176185 (45h3m28.646371754s) [upload=39597]: Next segment err: context deadline exceeded Aug 31 11:11:31.966314379 (45h3m28.646509938s) [upload=39597]: Done uploading segments... Aug 31 11:11:31.966328927 (45h3m28.646524497s) [upload=39597]: Upload finished. err: context deadline exceeded Duration: 6.990768139s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 1.914188109s FAIL (2025-08-31 11:39:19 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 1.914207807s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 4.082959345s FAIL (2025-08-31 11:39:17 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 4.08301975s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 7.100500651s FAIL (2025-08-31 11:39:10 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Aug 31 11:13:00.825343942 (45h4m57.505539511s) [upload=39627]: Starting upload Aug 31 11:13:00.825384589 (45h4m57.505580149s) [upload=39627]: Done starting upload Aug 31 11:13:00.825541009 (45h4m57.505736568s) [upload=39627]: Uploading segments... Aug 31 11:13:00.825579793 (45h4m57.505775362s) [upload=39627]: Got next segment. Inline: false Aug 31 11:13:00.825600693 (45h4m57.505796252s) [upload=39627]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 11:13:00.825604560 (45h4m57.505800129s) [upload=39627]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 31 11:13:01.708167688 (45h4m58.388363257s) [seg_pos={0 0}, upload=39627]: Begin upload segment... Aug 31 11:13:01.708224125 (45h4m58.388419695s) [seg_pos={0 0}, upload=39627]: Done begin upload segment. Aug 31 11:13:01.708248382 (45h4m58.388443961s) [noise=true , address=64.49.13.169:4709 , piece_id=5FUJXDUJJLTSAGJROSEZIBYUDPBF55XTNQLOD5WJHSJCVTRSO4UA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.708346640 (45h4m58.388542209s) [noise=true , address=104.36.82.35:4593 , piece_id=PRCATZUEA72YG2S4BTGEQ4ETUWVKMO3OCURBNLFAEGCSB5MDUKUQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.708955535 (45h4m58.389151114s) [noise=true , address=45.91.116.14:4195 , piece_id=UTIYQKVEKCDYGFQ6LX7PBJCGTA2QBMEN5Y7L5REIX4PUJ7WQSZ6Q, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709102236 (45h4m58.389297805s) [noise=true , address=104.36.82.15:4288 , piece_id=RHCPDOB7TEL65DYGJLJRJWC2SUHOV5FT5IZRERXUKHWZQVPGBHTA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709344399 (45h4m58.389539968s) [noise=true , address=64.49.13.155:4917 , piece_id=GSN5BNXY6VQJ63KASNN3MONOM6SV4BRM6WVIYLHGCGZNVK53HWXA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709551927 (45h4m58.389747506s) [noise=true , address=45.91.116.7:4034 , piece_id=LT7WEH3NX6T43P6WZFPREGKZ35R3UMEQYJBHAS4SW7N6CXHTUBOA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709590730 (45h4m58.3897863s) [noise=true , address=104.36.82.41:4775 , piece_id=7ESRGGJBNYHH4GH3PAACKOTPDKWV7ZRGQXYOUGVQJMYK2FQSNK4Q, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709842191 (45h4m58.390037771s) [noise=true , address=104.36.82.5:4853 , piece_id=O7HRHC2V53F22YV4FRE3F6U64PBVZK2AV2KYC4GNFEWHYZRJEOXA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710024290 (45h4m58.390219859s) [noise=true , address=77.90.31.21:4903 , piece_id=64466RMNHODOUS4YMYJBS46QNXS37PN3ZCMX56J6AWPF76BDJIFA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710071431 (45h4m58.390267s) [noise=true , address=104.36.82.48:4592 , piece_id=PACCJAF3QJXJSEUEJL7MRRLVR6ZRR4NLGDU42EAYK2VRTOBLAWGQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710298846 (45h4m58.390494415s) [noise=true , address=104.36.82.60:4360 , piece_id=JHBHFUQNTTMN6IVKTAVL4SUG27G2HHQOVY3VTFJDH4CZF7AEF56Q, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710486405 (45h4m58.390681984s) [noise=true , address=77.90.31.15:4714 , piece_id=EQ5HVZ67YWZTSI6K5FPNOAIIDBPV32KSCEZFP2MY45WALWMQNPDA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710556819 (45h4m58.390752388s) [noise=true , address=77.90.31.10:4544 , piece_id=YKJJXXMH3K2IJ2VGMRNCEEHUMOKMX3F4ZD72HPRQ6G7XNI5MPICA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710813581 (45h4m58.39100915s) [noise=true , address=77.90.31.11:4566 , piece_id=L5AZKS66QFUKXBCVO5NFR5MEDYTGIIHODHNBYXAFIH2YSE2TZR2A, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710945823 (45h4m58.391141402s) [noise=true , address=64.49.13.140:4508 , piece_id=O52JQJINRPKWLZI6NNPFJPZQYGDWHOMV3OHH6WYR2GFBKYRT7N3A, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.711040525 (45h4m58.391236094s) [noise=true , address=79.127.205.246:4263 , piece_id=2KPRXAVRMFEEMS32L3W2MSG7QJD5NLL2XVH5GOJIBDCVHUECVAEQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.711384572 (45h4m58.391580151s) [noise=true , address=104.36.82.53:4138 , piece_id=MFMGL7KSLNHYC4IQWD63O5KNIUOCDGYDKZUGGRTKAWMFTKZNFULQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.711796601 (45h4m58.39199218s) [noise=true , address=79.127.205.245:4251 , piece_id=G7VYPKSXFPKHVBAQDRKC7YCWWHZEQJUKWK4I3CAU4XMM2RRKM2YQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:02.809033683 (45h4m59.489229262s) [upload=39627]: Next returned nil segment Aug 31 11:13:02.809052139 (45h4m59.489247708s) [upload=39627]: Waiting for error group managing segments... Aug 31 11:13:03.110429755 (45h4m59.790625324s) [noise=true , address=79.127.205.245:4251 , piece_id=G7VYPKSXFPKHVBAQDRKC7YCWWHZEQJUKWK4I3CAU4XMM2RRKM2YQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.112669791 (45h4m59.79286538s) [noise=true , address=64.49.13.140:4508 , piece_id=O52JQJINRPKWLZI6NNPFJPZQYGDWHOMV3OHH6WYR2GFBKYRT7N3A, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.128781550 (45h4m59.808977119s) [noise=true , address=79.127.205.246:4263 , piece_id=2KPRXAVRMFEEMS32L3W2MSG7QJD5NLL2XVH5GOJIBDCVHUECVAEQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.142878824 (45h4m59.823074393s) [noise=true , address=64.49.13.155:4917 , piece_id=GSN5BNXY6VQJ63KASNN3MONOM6SV4BRM6WVIYLHGCGZNVK53HWXA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.202555682 (45h4m59.882751251s) [noise=true , address=64.49.13.169:4709 , piece_id=5FUJXDUJJLTSAGJROSEZIBYUDPBF55XTNQLOD5WJHSJCVTRSO4UA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.647619373 (45h5m0.327814942s) [noise=true , address=45.91.116.14:4195 , piece_id=UTIYQKVEKCDYGFQ6LX7PBJCGTA2QBMEN5Y7L5REIX4PUJ7WQSZ6Q, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.680334441 (45h5m0.36053001s) [noise=true , address=104.36.82.35:4593 , piece_id=PRCATZUEA72YG2S4BTGEQ4ETUWVKMO3OCURBNLFAEGCSB5MDUKUQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.737634971 (45h5m0.41783054s) [noise=true , address=45.91.116.7:4034 , piece_id=LT7WEH3NX6T43P6WZFPREGKZ35R3UMEQYJBHAS4SW7N6CXHTUBOA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.749306554 (45h5m0.429502124s) [noise=true , address=104.36.82.48:4592 , piece_id=PACCJAF3QJXJSEUEJL7MRRLVR6ZRR4NLGDU42EAYK2VRTOBLAWGQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.750058222 (45h5m0.430253791s) [noise=true , address=104.36.82.5:4853 , piece_id=O7HRHC2V53F22YV4FRE3F6U64PBVZK2AV2KYC4GNFEWHYZRJEOXA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.752613201 (45h5m0.43280877s) [noise=true , address=104.36.82.15:4288 , piece_id=RHCPDOB7TEL65DYGJLJRJWC2SUHOV5FT5IZRERXUKHWZQVPGBHTA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.783046874 (45h5m0.463242443s) [noise=true , address=77.90.31.11:4566 , piece_id=L5AZKS66QFUKXBCVO5NFR5MEDYTGIIHODHNBYXAFIH2YSE2TZR2A, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.783337791 (45h5m0.46353336s) [noise=true , address=77.90.31.15:4714 , piece_id=EQ5HVZ67YWZTSI6K5FPNOAIIDBPV32KSCEZFP2MY45WALWMQNPDA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.814218168 (45h5m0.494413727s) [noise=true , address=77.90.31.10:4544 , piece_id=YKJJXXMH3K2IJ2VGMRNCEEHUMOKMX3F4ZD72HPRQ6G7XNI5MPICA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.814246252 (45h5m0.494441811s) [seg_pos={0 0}, upload=39627]: Segment reached optimal threshold of 14 pieces. Aug 31 11:13:03.814359448 (45h5m0.494555017s) [noise=true , address=104.36.82.60:4360 , piece_id=JHBHFUQNTTMN6IVKTAVL4SUG27G2HHQOVY3VTFJDH4CZF7AEF56Q, seg_pos={0 0}, upload=39627]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T24rtYBJ47E6Ef1ZZKMWcpBrWBpCg5QV2ZHniCZZkzJF2yUNk): protocol: expected piece hash; context canceled; EOF Aug 31 11:13:03.814418081 (45h5m0.49461364s) [noise=true , address=104.36.82.53:4138 , piece_id=MFMGL7KSLNHYC4IQWD63O5KNIUOCDGYDKZUGGRTKAWMFTKZNFULQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YUGGJg6mWeQMmzSNWtLFWAaWwaKWfEf8wxXs1jwiZaA9nhsr3): protocol: expected piece hash; context canceled; EOF Aug 31 11:13:03.814483546 (45h5m0.494679115s) [noise=true , address=104.36.82.41:4775 , piece_id=7ESRGGJBNYHH4GH3PAACKOTPDKWV7ZRGQXYOUGVQJMYK2FQSNK4Q, seg_pos={0 0}, upload=39627]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:166yRbNnnDeZRifM5q7vUVLx7iV5cZ9GqQnmvD9AbUUJsaCjmj): protocol: expected piece hash; context canceled; EOF Aug 31 11:13:03.814510187 (45h5m0.494705746s) [noise=true , address=77.90.31.21:4903 , piece_id=64466RMNHODOUS4YMYJBS46QNXS37PN3ZCMX56J6AWPF76BDJIFA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZYWQ1a2sTKnFpF28iQVrem2s8nSpXkeJzZDaS7jvTZNANdfp): protocol: expected piece hash; context canceled; EOF Aug 31 11:13:03.814533913 (45h5m0.494729482s) [seg_pos={0 0}, upload=39627]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 31 11:13:03.814608635 (45h5m0.494804204s) [upload=39627]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 31 11:13:03.814612623 (45h5m0.494808193s) [upload=39627]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 31 11:13:06.785691131 (45h5m3.4658867s) [upload=39627]: Done uploading segments... Aug 31 11:13:06.785708434 (45h5m3.465904004s) [upload=39627]: Upload finished. err: <nil> Duration: 7.100517593s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 26.976091443s FAIL (2025-08-31 11:39:03 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Aug 31 11:13:00.825343942 (45h4m57.505539511s) [upload=39627]: Starting upload Aug 31 11:13:00.825384589 (45h4m57.505580149s) [upload=39627]: Done starting upload Aug 31 11:13:00.825541009 (45h4m57.505736568s) [upload=39627]: Uploading segments... Aug 31 11:13:00.825579793 (45h4m57.505775362s) [upload=39627]: Got next segment. Inline: false Aug 31 11:13:00.825600693 (45h4m57.505796252s) [upload=39627]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 11:13:00.825604560 (45h4m57.505800129s) [upload=39627]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 31 11:13:01.708167688 (45h4m58.388363257s) [seg_pos={0 0}, upload=39627]: Begin upload segment... Aug 31 11:13:01.708224125 (45h4m58.388419695s) [seg_pos={0 0}, upload=39627]: Done begin upload segment. Aug 31 11:13:01.708248382 (45h4m58.388443961s) [noise=true , address=64.49.13.169:4709 , piece_id=5FUJXDUJJLTSAGJROSEZIBYUDPBF55XTNQLOD5WJHSJCVTRSO4UA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.708346640 (45h4m58.388542209s) [noise=true , address=104.36.82.35:4593 , piece_id=PRCATZUEA72YG2S4BTGEQ4ETUWVKMO3OCURBNLFAEGCSB5MDUKUQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.708955535 (45h4m58.389151114s) [noise=true , address=45.91.116.14:4195 , piece_id=UTIYQKVEKCDYGFQ6LX7PBJCGTA2QBMEN5Y7L5REIX4PUJ7WQSZ6Q, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709102236 (45h4m58.389297805s) [noise=true , address=104.36.82.15:4288 , piece_id=RHCPDOB7TEL65DYGJLJRJWC2SUHOV5FT5IZRERXUKHWZQVPGBHTA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709344399 (45h4m58.389539968s) [noise=true , address=64.49.13.155:4917 , piece_id=GSN5BNXY6VQJ63KASNN3MONOM6SV4BRM6WVIYLHGCGZNVK53HWXA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709551927 (45h4m58.389747506s) [noise=true , address=45.91.116.7:4034 , piece_id=LT7WEH3NX6T43P6WZFPREGKZ35R3UMEQYJBHAS4SW7N6CXHTUBOA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709590730 (45h4m58.3897863s) [noise=true , address=104.36.82.41:4775 , piece_id=7ESRGGJBNYHH4GH3PAACKOTPDKWV7ZRGQXYOUGVQJMYK2FQSNK4Q, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709842191 (45h4m58.390037771s) [noise=true , address=104.36.82.5:4853 , piece_id=O7HRHC2V53F22YV4FRE3F6U64PBVZK2AV2KYC4GNFEWHYZRJEOXA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710024290 (45h4m58.390219859s) [noise=true , address=77.90.31.21:4903 , piece_id=64466RMNHODOUS4YMYJBS46QNXS37PN3ZCMX56J6AWPF76BDJIFA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710071431 (45h4m58.390267s) [noise=true , address=104.36.82.48:4592 , piece_id=PACCJAF3QJXJSEUEJL7MRRLVR6ZRR4NLGDU42EAYK2VRTOBLAWGQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710298846 (45h4m58.390494415s) [noise=true , address=104.36.82.60:4360 , piece_id=JHBHFUQNTTMN6IVKTAVL4SUG27G2HHQOVY3VTFJDH4CZF7AEF56Q, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710486405 (45h4m58.390681984s) [noise=true , address=77.90.31.15:4714 , piece_id=EQ5HVZ67YWZTSI6K5FPNOAIIDBPV32KSCEZFP2MY45WALWMQNPDA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710556819 (45h4m58.390752388s) [noise=true , address=77.90.31.10:4544 , piece_id=YKJJXXMH3K2IJ2VGMRNCEEHUMOKMX3F4ZD72HPRQ6G7XNI5MPICA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710813581 (45h4m58.39100915s) [noise=true , address=77.90.31.11:4566 , piece_id=L5AZKS66QFUKXBCVO5NFR5MEDYTGIIHODHNBYXAFIH2YSE2TZR2A, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710945823 (45h4m58.391141402s) [noise=true , address=64.49.13.140:4508 , piece_id=O52JQJINRPKWLZI6NNPFJPZQYGDWHOMV3OHH6WYR2GFBKYRT7N3A, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.711040525 (45h4m58.391236094s) [noise=true , address=79.127.205.246:4263 , piece_id=2KPRXAVRMFEEMS32L3W2MSG7QJD5NLL2XVH5GOJIBDCVHUECVAEQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.711384572 (45h4m58.391580151s) [noise=true , address=104.36.82.53:4138 , piece_id=MFMGL7KSLNHYC4IQWD63O5KNIUOCDGYDKZUGGRTKAWMFTKZNFULQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.711796601 (45h4m58.39199218s) [noise=true , address=79.127.205.245:4251 , piece_id=G7VYPKSXFPKHVBAQDRKC7YCWWHZEQJUKWK4I3CAU4XMM2RRKM2YQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:02.809033683 (45h4m59.489229262s) [upload=39627]: Next returned nil segment Aug 31 11:13:02.809052139 (45h4m59.489247708s) [upload=39627]: Waiting for error group managing segments... Aug 31 11:13:03.110429755 (45h4m59.790625324s) [noise=true , address=79.127.205.245:4251 , piece_id=G7VYPKSXFPKHVBAQDRKC7YCWWHZEQJUKWK4I3CAU4XMM2RRKM2YQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.112669791 (45h4m59.79286538s) [noise=true , address=64.49.13.140:4508 , piece_id=O52JQJINRPKWLZI6NNPFJPZQYGDWHOMV3OHH6WYR2GFBKYRT7N3A, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.128781550 (45h4m59.808977119s) [noise=true , address=79.127.205.246:4263 , piece_id=2KPRXAVRMFEEMS32L3W2MSG7QJD5NLL2XVH5GOJIBDCVHUECVAEQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.142878824 (45h4m59.823074393s) [noise=true , address=64.49.13.155:4917 , piece_id=GSN5BNXY6VQJ63KASNN3MONOM6SV4BRM6WVIYLHGCGZNVK53HWXA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.202555682 (45h4m59.882751251s) [noise=true , address=64.49.13.169:4709 , piece_id=5FUJXDUJJLTSAGJROSEZIBYUDPBF55XTNQLOD5WJHSJCVTRSO4UA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.647619373 (45h5m0.327814942s) [noise=true , address=45.91.116.14:4195 , piece_id=UTIYQKVEKCDYGFQ6LX7PBJCGTA2QBMEN5Y7L5REIX4PUJ7WQSZ6Q, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.680334441 (45h5m0.36053001s) [noise=true , address=104.36.82.35:4593 , piece_id=PRCATZUEA72YG2S4BTGEQ4ETUWVKMO3OCURBNLFAEGCSB5MDUKUQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.737634971 (45h5m0.41783054s) [noise=true , address=45.91.116.7:4034 , piece_id=LT7WEH3NX6T43P6WZFPREGKZ35R3UMEQYJBHAS4SW7N6CXHTUBOA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.749306554 (45h5m0.429502124s) [noise=true , address=104.36.82.48:4592 , piece_id=PACCJAF3QJXJSEUEJL7MRRLVR6ZRR4NLGDU42EAYK2VRTOBLAWGQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.750058222 (45h5m0.430253791s) [noise=true , address=104.36.82.5:4853 , piece_id=O7HRHC2V53F22YV4FRE3F6U64PBVZK2AV2KYC4GNFEWHYZRJEOXA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.752613201 (45h5m0.43280877s) [noise=true , address=104.36.82.15:4288 , piece_id=RHCPDOB7TEL65DYGJLJRJWC2SUHOV5FT5IZRERXUKHWZQVPGBHTA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.783046874 (45h5m0.463242443s) [noise=true , address=77.90.31.11:4566 , piece_id=L5AZKS66QFUKXBCVO5NFR5MEDYTGIIHODHNBYXAFIH2YSE2TZR2A, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.783337791 (45h5m0.46353336s) [noise=true , address=77.90.31.15:4714 , piece_id=EQ5HVZ67YWZTSI6K5FPNOAIIDBPV32KSCEZFP2MY45WALWMQNPDA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.814218168 (45h5m0.494413727s) [noise=true , address=77.90.31.10:4544 , piece_id=YKJJXXMH3K2IJ2VGMRNCEEHUMOKMX3F4ZD72HPRQ6G7XNI5MPICA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.814246252 (45h5m0.494441811s) [seg_pos={0 0}, upload=39627]: Segment reached optimal threshold of 14 pieces. Aug 31 11:13:03.814359448 (45h5m0.494555017s) [noise=true , address=104.36.82.60:4360 , piece_id=JHBHFUQNTTMN6IVKTAVL4SUG27G2HHQOVY3VTFJDH4CZF7AEF56Q, seg_pos={0 0}, upload=39627]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T24rtYBJ47E6Ef1ZZKMWcpBrWBpCg5QV2ZHniCZZkzJF2yUNk): protocol: expected piece hash; context canceled; EOF Aug 31 11:13:03.814418081 (45h5m0.49461364s) [noise=true , address=104.36.82.53:4138 , piece_id=MFMGL7KSLNHYC4IQWD63O5KNIUOCDGYDKZUGGRTKAWMFTKZNFULQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YUGGJg6mWeQMmzSNWtLFWAaWwaKWfEf8wxXs1jwiZaA9nhsr3): protocol: expected piece hash; context canceled; EOF Aug 31 11:13:03.814483546 (45h5m0.494679115s) [noise=true , address=104.36.82.41:4775 , piece_id=7ESRGGJBNYHH4GH3PAACKOTPDKWV7ZRGQXYOUGVQJMYK2FQSNK4Q, seg_pos={0 0}, upload=39627]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:166yRbNnnDeZRifM5q7vUVLx7iV5cZ9GqQnmvD9AbUUJsaCjmj): protocol: expected piece hash; context canceled; EOF Aug 31 11:13:03.814510187 (45h5m0.494705746s) [noise=true , address=77.90.31.21:4903 , piece_id=64466RMNHODOUS4YMYJBS46QNXS37PN3ZCMX56J6AWPF76BDJIFA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZYWQ1a2sTKnFpF28iQVrem2s8nSpXkeJzZDaS7jvTZNANdfp): protocol: expected piece hash; context canceled; EOF Aug 31 11:13:03.814533913 (45h5m0.494729482s) [seg_pos={0 0}, upload=39627]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 31 11:13:03.814608635 (45h5m0.494804204s) [upload=39627]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 31 11:13:03.814612623 (45h5m0.494808193s) [upload=39627]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 31 11:13:06.785691131 (45h5m3.4658867s) [upload=39627]: Done uploading segments... Aug 31 11:13:06.785708434 (45h5m3.465904004s) [upload=39627]: Upload finished. err: <nil> Duration: 26.976116842s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 2 out of 60 is failed (threshold=3) [....................X....X..................................] duration: 2.137371765s FAIL (2025-08-31 11:39:02 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 31 11:13:44.970873573 (45h5m41.651069142s) [upload=39634]: Starting upload Aug 31 11:13:44.970949158 (45h5m41.651144727s) [upload=39634]: Done starting upload Aug 31 11:13:44.971018871 (45h5m41.65121444s) [upload=39634]: Uploading segments... Aug 31 11:13:44.971078174 (45h5m41.651273743s) [upload=39634]: Got next segment. Inline: true Aug 31 11:13:44.971082704 (45h5m41.651278273s) [upload=39634]: Waiting for error group managing segments... Aug 31 11:13:44.971114825 (45h5m41.651310394s) [upload=39634]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 11:13:44.971118532 (45h5m41.651314101s) [upload=39634]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 31 11:13:44.971121528 (45h5m41.651317097s) [upload=39634]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 31 11:13:50.376332558 (45h5m47.056528127s) [upload=39634]: Done uploading segments... Aug 31 11:13:50.376399666 (45h5m47.056595235s) [upload=39634]: Upload finished. err: <nil> Duration:* 2.137390952s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...................XX.......................................] duration: 6.192456836s FAIL (2025-08-31 11:39:01 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Aug 31 11:11:03.184991323 (45h2m59.865186892s) [upload=39597]: Starting upload Aug 31 11:11:03.185066988 (45h2m59.865262567s) [upload=39597]: Done starting upload Aug 31 11:11:03.185180816 (45h2m59.865376395s) [upload=39597]: Uploading segments... Aug 31 11:11:03.185275988 (45h2m59.865471557s) [upload=39597]: Got next segment. Inline: false Aug 31 11:11:03.185312367 (45h2m59.865507936s) [upload=39597]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 11:11:03.185316826 (45h2m59.865512395s) [upload=39597]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 31 11:11:31.966176185 (45h3m28.646371754s) [upload=39597]: Next segment err: context deadline exceeded Aug 31 11:11:31.966314379 (45h3m28.646509938s) [upload=39597]: Done uploading segments... Aug 31 11:11:31.966328927 (45h3m28.646524497s) [upload=39597]: Upload finished. err: context deadline exceeded Duration: 6.19251194s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 2.063819388s FAIL (2025-08-31 11:38:52 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.063858583s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 5.937591218s FAIL (2025-08-31 11:38:50 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 5.937631245s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [....................XX......................................] duration: 14.465590089s FAIL (2025-08-31 11:38:46 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Aug 31 11:11:03.184991323 (45h2m59.865186892s) [upload=39597]: Starting upload Aug 31 11:11:03.185066988 (45h2m59.865262567s) [upload=39597]: Done starting upload Aug 31 11:11:03.185180816 (45h2m59.865376395s) [upload=39597]: Uploading segments... Aug 31 11:11:03.185275988 (45h2m59.865471557s) [upload=39597]: Got next segment. Inline: false Aug 31 11:11:03.185312367 (45h2m59.865507936s) [upload=39597]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 11:11:03.185316826 (45h2m59.865512395s) [upload=39597]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 31 11:11:31.966176185 (45h3m28.646371754s) [upload=39597]: Next segment err: context deadline exceeded Aug 31 11:11:31.966314379 (45h3m28.646509938s) [upload=39597]: Done uploading segments... Aug 31 11:11:31.966328927 (45h3m28.646524497s) [upload=39597]: Upload finished. err: context deadline exceeded Duration: 14.465621068s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.....................X....X.................................] duration: 10.049971481s FAIL (2025-08-31 11:38:45 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 31 11:13:44.970873573 (45h5m41.651069142s) [upload=39634]: Starting upload Aug 31 11:13:44.970949158 (45h5m41.651144727s) [upload=39634]: Done starting upload Aug 31 11:13:44.971018871 (45h5m41.65121444s) [upload=39634]: Uploading segments... Aug 31 11:13:44.971078174 (45h5m41.651273743s) [upload=39634]: Got next segment. Inline: true Aug 31 11:13:44.971082704 (45h5m41.651278273s) [upload=39634]: Waiting for error group managing segments... Aug 31 11:13:44.971114825 (45h5m41.651310394s) [upload=39634]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 11:13:44.971118532 (45h5m41.651314101s) [upload=39634]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 31 11:13:44.971121528 (45h5m41.651317097s) [upload=39634]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 31 11:13:50.376332558 (45h5m47.056528127s) [upload=39634]: Done uploading segments... Aug 31 11:13:50.376399666 (45h5m47.056595235s) [upload=39634]: Upload finished. err: <nil> Duration:* 10.050012259s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 17.40789591s FAIL (2025-08-31 11:38:44 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 17.40791172s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 4.193227787s target: https://us1.storj.io/login FAIL (2025-08-31 11:38:40 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout Duration: 4.193256113s core satellite us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 10.983151426s FAIL (2025-08-31 11:38:32 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 10.983188858s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...........................XX...............................] duration: 13.02248001s FAIL (2025-08-31 11:38:30 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 13.022496252s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 14.442716856s FAIL (2025-08-31 11:38:26 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Aug 31 11:13:00.825343942 (45h4m57.505539511s) [upload=39627]: Starting upload Aug 31 11:13:00.825384589 (45h4m57.505580149s) [upload=39627]: Done starting upload Aug 31 11:13:00.825541009 (45h4m57.505736568s) [upload=39627]: Uploading segments... Aug 31 11:13:00.825579793 (45h4m57.505775362s) [upload=39627]: Got next segment. Inline: false Aug 31 11:13:00.825600693 (45h4m57.505796252s) [upload=39627]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 11:13:00.825604560 (45h4m57.505800129s) [upload=39627]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 31 11:13:01.708167688 (45h4m58.388363257s) [seg_pos={0 0}, upload=39627]: Begin upload segment... Aug 31 11:13:01.708224125 (45h4m58.388419695s) [seg_pos={0 0}, upload=39627]: Done begin upload segment. Aug 31 11:13:01.708248382 (45h4m58.388443961s) [noise=true , address=64.49.13.169:4709 , piece_id=5FUJXDUJJLTSAGJROSEZIBYUDPBF55XTNQLOD5WJHSJCVTRSO4UA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.708346640 (45h4m58.388542209s) [noise=true , address=104.36.82.35:4593 , piece_id=PRCATZUEA72YG2S4BTGEQ4ETUWVKMO3OCURBNLFAEGCSB5MDUKUQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.708955535 (45h4m58.389151114s) [noise=true , address=45.91.116.14:4195 , piece_id=UTIYQKVEKCDYGFQ6LX7PBJCGTA2QBMEN5Y7L5REIX4PUJ7WQSZ6Q, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709102236 (45h4m58.389297805s) [noise=true , address=104.36.82.15:4288 , piece_id=RHCPDOB7TEL65DYGJLJRJWC2SUHOV5FT5IZRERXUKHWZQVPGBHTA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709344399 (45h4m58.389539968s) [noise=true , address=64.49.13.155:4917 , piece_id=GSN5BNXY6VQJ63KASNN3MONOM6SV4BRM6WVIYLHGCGZNVK53HWXA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709551927 (45h4m58.389747506s) [noise=true , address=45.91.116.7:4034 , piece_id=LT7WEH3NX6T43P6WZFPREGKZ35R3UMEQYJBHAS4SW7N6CXHTUBOA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709590730 (45h4m58.3897863s) [noise=true , address=104.36.82.41:4775 , piece_id=7ESRGGJBNYHH4GH3PAACKOTPDKWV7ZRGQXYOUGVQJMYK2FQSNK4Q, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709842191 (45h4m58.390037771s) [noise=true , address=104.36.82.5:4853 , piece_id=O7HRHC2V53F22YV4FRE3F6U64PBVZK2AV2KYC4GNFEWHYZRJEOXA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710024290 (45h4m58.390219859s) [noise=true , address=77.90.31.21:4903 , piece_id=64466RMNHODOUS4YMYJBS46QNXS37PN3ZCMX56J6AWPF76BDJIFA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710071431 (45h4m58.390267s) [noise=true , address=104.36.82.48:4592 , piece_id=PACCJAF3QJXJSEUEJL7MRRLVR6ZRR4NLGDU42EAYK2VRTOBLAWGQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710298846 (45h4m58.390494415s) [noise=true , address=104.36.82.60:4360 , piece_id=JHBHFUQNTTMN6IVKTAVL4SUG27G2HHQOVY3VTFJDH4CZF7AEF56Q, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710486405 (45h4m58.390681984s) [noise=true , address=77.90.31.15:4714 , piece_id=EQ5HVZ67YWZTSI6K5FPNOAIIDBPV32KSCEZFP2MY45WALWMQNPDA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710556819 (45h4m58.390752388s) [noise=true , address=77.90.31.10:4544 , piece_id=YKJJXXMH3K2IJ2VGMRNCEEHUMOKMX3F4ZD72HPRQ6G7XNI5MPICA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710813581 (45h4m58.39100915s) [noise=true , address=77.90.31.11:4566 , piece_id=L5AZKS66QFUKXBCVO5NFR5MEDYTGIIHODHNBYXAFIH2YSE2TZR2A, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710945823 (45h4m58.391141402s) [noise=true , address=64.49.13.140:4508 , piece_id=O52JQJINRPKWLZI6NNPFJPZQYGDWHOMV3OHH6WYR2GFBKYRT7N3A, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.711040525 (45h4m58.391236094s) [noise=true , address=79.127.205.246:4263 , piece_id=2KPRXAVRMFEEMS32L3W2MSG7QJD5NLL2XVH5GOJIBDCVHUECVAEQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.711384572 (45h4m58.391580151s) [noise=true , address=104.36.82.53:4138 , piece_id=MFMGL7KSLNHYC4IQWD63O5KNIUOCDGYDKZUGGRTKAWMFTKZNFULQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.711796601 (45h4m58.39199218s) [noise=true , address=79.127.205.245:4251 , piece_id=G7VYPKSXFPKHVBAQDRKC7YCWWHZEQJUKWK4I3CAU4XMM2RRKM2YQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:02.809033683 (45h4m59.489229262s) [upload=39627]: Next returned nil segment Aug 31 11:13:02.809052139 (45h4m59.489247708s) [upload=39627]: Waiting for error group managing segments... Aug 31 11:13:03.110429755 (45h4m59.790625324s) [noise=true , address=79.127.205.245:4251 , piece_id=G7VYPKSXFPKHVBAQDRKC7YCWWHZEQJUKWK4I3CAU4XMM2RRKM2YQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.112669791 (45h4m59.79286538s) [noise=true , address=64.49.13.140:4508 , piece_id=O52JQJINRPKWLZI6NNPFJPZQYGDWHOMV3OHH6WYR2GFBKYRT7N3A, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.128781550 (45h4m59.808977119s) [noise=true , address=79.127.205.246:4263 , piece_id=2KPRXAVRMFEEMS32L3W2MSG7QJD5NLL2XVH5GOJIBDCVHUECVAEQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.142878824 (45h4m59.823074393s) [noise=true , address=64.49.13.155:4917 , piece_id=GSN5BNXY6VQJ63KASNN3MONOM6SV4BRM6WVIYLHGCGZNVK53HWXA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.202555682 (45h4m59.882751251s) [noise=true , address=64.49.13.169:4709 , piece_id=5FUJXDUJJLTSAGJROSEZIBYUDPBF55XTNQLOD5WJHSJCVTRSO4UA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.647619373 (45h5m0.327814942s) [noise=true , address=45.91.116.14:4195 , piece_id=UTIYQKVEKCDYGFQ6LX7PBJCGTA2QBMEN5Y7L5REIX4PUJ7WQSZ6Q, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.680334441 (45h5m0.36053001s) [noise=true , address=104.36.82.35:4593 , piece_id=PRCATZUEA72YG2S4BTGEQ4ETUWVKMO3OCURBNLFAEGCSB5MDUKUQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.737634971 (45h5m0.41783054s) [noise=true , address=45.91.116.7:4034 , piece_id=LT7WEH3NX6T43P6WZFPREGKZ35R3UMEQYJBHAS4SW7N6CXHTUBOA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.749306554 (45h5m0.429502124s) [noise=true , address=104.36.82.48:4592 , piece_id=PACCJAF3QJXJSEUEJL7MRRLVR6ZRR4NLGDU42EAYK2VRTOBLAWGQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.750058222 (45h5m0.430253791s) [noise=true , address=104.36.82.5:4853 , piece_id=O7HRHC2V53F22YV4FRE3F6U64PBVZK2AV2KYC4GNFEWHYZRJEOXA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.752613201 (45h5m0.43280877s) [noise=true , address=104.36.82.15:4288 , piece_id=RHCPDOB7TEL65DYGJLJRJWC2SUHOV5FT5IZRERXUKHWZQVPGBHTA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.783046874 (45h5m0.463242443s) [noise=true , address=77.90.31.11:4566 , piece_id=L5AZKS66QFUKXBCVO5NFR5MEDYTGIIHODHNBYXAFIH2YSE2TZR2A, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.783337791 (45h5m0.46353336s) [noise=true , address=77.90.31.15:4714 , piece_id=EQ5HVZ67YWZTSI6K5FPNOAIIDBPV32KSCEZFP2MY45WALWMQNPDA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.814218168 (45h5m0.494413727s) [noise=true , address=77.90.31.10:4544 , piece_id=YKJJXXMH3K2IJ2VGMRNCEEHUMOKMX3F4ZD72HPRQ6G7XNI5MPICA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.814246252 (45h5m0.494441811s) [seg_pos={0 0}, upload=39627]: Segment reached optimal threshold of 14 pieces. Aug 31 11:13:03.814359448 (45h5m0.494555017s) [noise=true , address=104.36.82.60:4360 , piece_id=JHBHFUQNTTMN6IVKTAVL4SUG27G2HHQOVY3VTFJDH4CZF7AEF56Q, seg_pos={0 0}, upload=39627]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T24rtYBJ47E6Ef1ZZKMWcpBrWBpCg5QV2ZHniCZZkzJF2yUNk): protocol: expected piece hash; context canceled; EOF Aug 31 11:13:03.814418081 (45h5m0.49461364s) [noise=true , address=104.36.82.53:4138 , piece_id=MFMGL7KSLNHYC4IQWD63O5KNIUOCDGYDKZUGGRTKAWMFTKZNFULQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YUGGJg6mWeQMmzSNWtLFWAaWwaKWfEf8wxXs1jwiZaA9nhsr3): protocol: expected piece hash; context canceled; EOF Aug 31 11:13:03.814483546 (45h5m0.494679115s) [noise=true , address=104.36.82.41:4775 , piece_id=7ESRGGJBNYHH4GH3PAACKOTPDKWV7ZRGQXYOUGVQJMYK2FQSNK4Q, seg_pos={0 0}, upload=39627]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:166yRbNnnDeZRifM5q7vUVLx7iV5cZ9GqQnmvD9AbUUJsaCjmj): protocol: expected piece hash; context canceled; EOF Aug 31 11:13:03.814510187 (45h5m0.494705746s) [noise=true , address=77.90.31.21:4903 , piece_id=64466RMNHODOUS4YMYJBS46QNXS37PN3ZCMX56J6AWPF76BDJIFA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZYWQ1a2sTKnFpF28iQVrem2s8nSpXkeJzZDaS7jvTZNANdfp): protocol: expected piece hash; context canceled; EOF Aug 31 11:13:03.814533913 (45h5m0.494729482s) [seg_pos={0 0}, upload=39627]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 31 11:13:03.814608635 (45h5m0.494804204s) [upload=39627]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 31 11:13:03.814612623 (45h5m0.494808193s) [upload=39627]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 31 11:13:06.785691131 (45h5m3.4658867s) [upload=39627]: Done uploading segments... Aug 31 11:13:06.785708434 (45h5m3.465904004s) [upload=39627]: Upload finished. err: <nil> Duration: 14.442744049s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 20.609792203s FAIL (2025-08-31 11:38:26 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 20.609844955s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....................XX.....................................] duration: 8.099893508s FAIL (2025-08-31 11:38:23 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Aug 31 11:11:03.184991323 (45h2m59.865186892s) [upload=39597]: Starting upload Aug 31 11:11:03.185066988 (45h2m59.865262567s) [upload=39597]: Done starting upload Aug 31 11:11:03.185180816 (45h2m59.865376395s) [upload=39597]: Uploading segments... Aug 31 11:11:03.185275988 (45h2m59.865471557s) [upload=39597]: Got next segment. Inline: false Aug 31 11:11:03.185312367 (45h2m59.865507936s) [upload=39597]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 11:11:03.185316826 (45h2m59.865512395s) [upload=39597]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 31 11:11:31.966176185 (45h3m28.646371754s) [upload=39597]: Next segment err: context deadline exceeded Aug 31 11:11:31.966314379 (45h3m28.646509938s) [upload=39597]: Done uploading segments... Aug 31 11:11:31.966328927 (45h3m28.646524497s) [upload=39597]: Upload finished. err: context deadline exceeded Duration: 8.099918145s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 6.472588243s FAIL (2025-08-31 11:38:00 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.472610105s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 2 out of 60 is failed (threshold=3) [......................X....X................................] duration: 2.148049839s FAIL (2025-08-31 11:37:57 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 31 11:13:44.970873573 (45h5m41.651069142s) [upload=39634]: Starting upload Aug 31 11:13:44.970949158 (45h5m41.651144727s) [upload=39634]: Done starting upload Aug 31 11:13:44.971018871 (45h5m41.65121444s) [upload=39634]: Uploading segments... Aug 31 11:13:44.971078174 (45h5m41.651273743s) [upload=39634]: Got next segment. Inline: true Aug 31 11:13:44.971082704 (45h5m41.651278273s) [upload=39634]: Waiting for error group managing segments... Aug 31 11:13:44.971114825 (45h5m41.651310394s) [upload=39634]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 11:13:44.971118532 (45h5m41.651314101s) [upload=39634]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 31 11:13:44.971121528 (45h5m41.651317097s) [upload=39634]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 31 11:13:50.376332558 (45h5m47.056528127s) [upload=39634]: Done uploading segments... Aug 31 11:13:50.376399666 (45h5m47.056595235s) [upload=39634]: Upload finished. err: <nil> Duration:* 2.14807689s core uplink us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 665.536387ms target: https://us1.storj.io/login FAIL (2025-08-31 11:37:48 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout Duration: 665.550264ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 2.05443859s FAIL (2025-08-31 11:37:47 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.05446456s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [......................XX....................................] duration: 5.972523744s FAIL (2025-08-31 11:37:42 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Aug 31 11:11:03.184991323 (45h2m59.865186892s) [upload=39597]: Starting upload Aug 31 11:11:03.185066988 (45h2m59.865262567s) [upload=39597]: Done starting upload Aug 31 11:11:03.185180816 (45h2m59.865376395s) [upload=39597]: Uploading segments... Aug 31 11:11:03.185275988 (45h2m59.865471557s) [upload=39597]: Got next segment. Inline: false Aug 31 11:11:03.185312367 (45h2m59.865507936s) [upload=39597]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 11:11:03.185316826 (45h2m59.865512395s) [upload=39597]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 31 11:11:31.966176185 (45h3m28.646371754s) [upload=39597]: Next segment err: context deadline exceeded Aug 31 11:11:31.966314379 (45h3m28.646509938s) [upload=39597]: Done uploading segments... Aug 31 11:11:31.966328927 (45h3m28.646524497s) [upload=39597]: Upload finished. err: context deadline exceeded Duration: 5.97255313s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 2.103857341s FAIL (2025-08-31 11:37:42 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.103885725s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 6.558787038s FAIL (2025-08-31 11:37:24 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.558809492s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......................XX...................................] duration: 5.989359779s FAIL (2025-08-31 11:37:15 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Aug 31 11:11:03.184991323 (45h2m59.865186892s) [upload=39597]: Starting upload Aug 31 11:11:03.185066988 (45h2m59.865262567s) [upload=39597]: Done starting upload Aug 31 11:11:03.185180816 (45h2m59.865376395s) [upload=39597]: Uploading segments... Aug 31 11:11:03.185275988 (45h2m59.865471557s) [upload=39597]: Got next segment. Inline: false Aug 31 11:11:03.185312367 (45h2m59.865507936s) [upload=39597]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 11:11:03.185316826 (45h2m59.865512395s) [upload=39597]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 31 11:11:31.966176185 (45h3m28.646371754s) [upload=39597]: Next segment err: context deadline exceeded Aug 31 11:11:31.966314379 (45h3m28.646509938s) [upload=39597]: Done uploading segments... Aug 31 11:11:31.966328927 (45h3m28.646524497s) [upload=39597]: Upload finished. err: context deadline exceeded Duration: 5.989383416s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 1.99620345s FAIL (2025-08-31 11:37:15 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 1.996233328s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [............................XX..............................] duration: 6.022757313s FAIL (2025-08-31 11:37:12 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 6.02278191s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.......................X....X...............................] duration: 1.98247277s FAIL (2025-08-31 11:37:08 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 31 11:13:44.970873573 (45h5m41.651069142s) [upload=39634]: Starting upload Aug 31 11:13:44.970949158 (45h5m41.651144727s) [upload=39634]: Done starting upload Aug 31 11:13:44.971018871 (45h5m41.65121444s) [upload=39634]: Uploading segments... Aug 31 11:13:44.971078174 (45h5m41.651273743s) [upload=39634]: Got next segment. Inline: true Aug 31 11:13:44.971082704 (45h5m41.651278273s) [upload=39634]: Waiting for error group managing segments... Aug 31 11:13:44.971114825 (45h5m41.651310394s) [upload=39634]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 11:13:44.971118532 (45h5m41.651314101s) [upload=39634]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 31 11:13:44.971121528 (45h5m41.651317097s) [upload=39634]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 31 11:13:50.376332558 (45h5m47.056528127s) [upload=39634]: Done uploading segments... Aug 31 11:13:50.376399666 (45h5m47.056595235s) [upload=39634]: Upload finished. err: <nil> Duration:* 1.982505242s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 5.976494122s FAIL (2025-08-31 11:37:05 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Aug 31 11:13:00.825343942 (45h4m57.505539511s) [upload=39627]: Starting upload Aug 31 11:13:00.825384589 (45h4m57.505580149s) [upload=39627]: Done starting upload Aug 31 11:13:00.825541009 (45h4m57.505736568s) [upload=39627]: Uploading segments... Aug 31 11:13:00.825579793 (45h4m57.505775362s) [upload=39627]: Got next segment. Inline: false Aug 31 11:13:00.825600693 (45h4m57.505796252s) [upload=39627]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 11:13:00.825604560 (45h4m57.505800129s) [upload=39627]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 31 11:13:01.708167688 (45h4m58.388363257s) [seg_pos={0 0}, upload=39627]: Begin upload segment... Aug 31 11:13:01.708224125 (45h4m58.388419695s) [seg_pos={0 0}, upload=39627]: Done begin upload segment. Aug 31 11:13:01.708248382 (45h4m58.388443961s) [noise=true , address=64.49.13.169:4709 , piece_id=5FUJXDUJJLTSAGJROSEZIBYUDPBF55XTNQLOD5WJHSJCVTRSO4UA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.708346640 (45h4m58.388542209s) [noise=true , address=104.36.82.35:4593 , piece_id=PRCATZUEA72YG2S4BTGEQ4ETUWVKMO3OCURBNLFAEGCSB5MDUKUQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.708955535 (45h4m58.389151114s) [noise=true , address=45.91.116.14:4195 , piece_id=UTIYQKVEKCDYGFQ6LX7PBJCGTA2QBMEN5Y7L5REIX4PUJ7WQSZ6Q, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709102236 (45h4m58.389297805s) [noise=true , address=104.36.82.15:4288 , piece_id=RHCPDOB7TEL65DYGJLJRJWC2SUHOV5FT5IZRERXUKHWZQVPGBHTA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709344399 (45h4m58.389539968s) [noise=true , address=64.49.13.155:4917 , piece_id=GSN5BNXY6VQJ63KASNN3MONOM6SV4BRM6WVIYLHGCGZNVK53HWXA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709551927 (45h4m58.389747506s) [noise=true , address=45.91.116.7:4034 , piece_id=LT7WEH3NX6T43P6WZFPREGKZ35R3UMEQYJBHAS4SW7N6CXHTUBOA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709590730 (45h4m58.3897863s) [noise=true , address=104.36.82.41:4775 , piece_id=7ESRGGJBNYHH4GH3PAACKOTPDKWV7ZRGQXYOUGVQJMYK2FQSNK4Q, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709842191 (45h4m58.390037771s) [noise=true , address=104.36.82.5:4853 , piece_id=O7HRHC2V53F22YV4FRE3F6U64PBVZK2AV2KYC4GNFEWHYZRJEOXA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710024290 (45h4m58.390219859s) [noise=true , address=77.90.31.21:4903 , piece_id=64466RMNHODOUS4YMYJBS46QNXS37PN3ZCMX56J6AWPF76BDJIFA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710071431 (45h4m58.390267s) [noise=true , address=104.36.82.48:4592 , piece_id=PACCJAF3QJXJSEUEJL7MRRLVR6ZRR4NLGDU42EAYK2VRTOBLAWGQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710298846 (45h4m58.390494415s) [noise=true , address=104.36.82.60:4360 , piece_id=JHBHFUQNTTMN6IVKTAVL4SUG27G2HHQOVY3VTFJDH4CZF7AEF56Q, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710486405 (45h4m58.390681984s) [noise=true , address=77.90.31.15:4714 , piece_id=EQ5HVZ67YWZTSI6K5FPNOAIIDBPV32KSCEZFP2MY45WALWMQNPDA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710556819 (45h4m58.390752388s) [noise=true , address=77.90.31.10:4544 , piece_id=YKJJXXMH3K2IJ2VGMRNCEEHUMOKMX3F4ZD72HPRQ6G7XNI5MPICA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710813581 (45h4m58.39100915s) [noise=true , address=77.90.31.11:4566 , piece_id=L5AZKS66QFUKXBCVO5NFR5MEDYTGIIHODHNBYXAFIH2YSE2TZR2A, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710945823 (45h4m58.391141402s) [noise=true , address=64.49.13.140:4508 , piece_id=O52JQJINRPKWLZI6NNPFJPZQYGDWHOMV3OHH6WYR2GFBKYRT7N3A, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.711040525 (45h4m58.391236094s) [noise=true , address=79.127.205.246:4263 , piece_id=2KPRXAVRMFEEMS32L3W2MSG7QJD5NLL2XVH5GOJIBDCVHUECVAEQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.711384572 (45h4m58.391580151s) [noise=true , address=104.36.82.53:4138 , piece_id=MFMGL7KSLNHYC4IQWD63O5KNIUOCDGYDKZUGGRTKAWMFTKZNFULQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.711796601 (45h4m58.39199218s) [noise=true , address=79.127.205.245:4251 , piece_id=G7VYPKSXFPKHVBAQDRKC7YCWWHZEQJUKWK4I3CAU4XMM2RRKM2YQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:02.809033683 (45h4m59.489229262s) [upload=39627]: Next returned nil segment Aug 31 11:13:02.809052139 (45h4m59.489247708s) [upload=39627]: Waiting for error group managing segments... Aug 31 11:13:03.110429755 (45h4m59.790625324s) [noise=true , address=79.127.205.245:4251 , piece_id=G7VYPKSXFPKHVBAQDRKC7YCWWHZEQJUKWK4I3CAU4XMM2RRKM2YQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.112669791 (45h4m59.79286538s) [noise=true , address=64.49.13.140:4508 , piece_id=O52JQJINRPKWLZI6NNPFJPZQYGDWHOMV3OHH6WYR2GFBKYRT7N3A, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.128781550 (45h4m59.808977119s) [noise=true , address=79.127.205.246:4263 , piece_id=2KPRXAVRMFEEMS32L3W2MSG7QJD5NLL2XVH5GOJIBDCVHUECVAEQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.142878824 (45h4m59.823074393s) [noise=true , address=64.49.13.155:4917 , piece_id=GSN5BNXY6VQJ63KASNN3MONOM6SV4BRM6WVIYLHGCGZNVK53HWXA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.202555682 (45h4m59.882751251s) [noise=true , address=64.49.13.169:4709 , piece_id=5FUJXDUJJLTSAGJROSEZIBYUDPBF55XTNQLOD5WJHSJCVTRSO4UA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.647619373 (45h5m0.327814942s) [noise=true , address=45.91.116.14:4195 , piece_id=UTIYQKVEKCDYGFQ6LX7PBJCGTA2QBMEN5Y7L5REIX4PUJ7WQSZ6Q, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.680334441 (45h5m0.36053001s) [noise=true , address=104.36.82.35:4593 , piece_id=PRCATZUEA72YG2S4BTGEQ4ETUWVKMO3OCURBNLFAEGCSB5MDUKUQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.737634971 (45h5m0.41783054s) [noise=true , address=45.91.116.7:4034 , piece_id=LT7WEH3NX6T43P6WZFPREGKZ35R3UMEQYJBHAS4SW7N6CXHTUBOA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.749306554 (45h5m0.429502124s) [noise=true , address=104.36.82.48:4592 , piece_id=PACCJAF3QJXJSEUEJL7MRRLVR6ZRR4NLGDU42EAYK2VRTOBLAWGQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.750058222 (45h5m0.430253791s) [noise=true , address=104.36.82.5:4853 , piece_id=O7HRHC2V53F22YV4FRE3F6U64PBVZK2AV2KYC4GNFEWHYZRJEOXA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.752613201 (45h5m0.43280877s) [noise=true , address=104.36.82.15:4288 , piece_id=RHCPDOB7TEL65DYGJLJRJWC2SUHOV5FT5IZRERXUKHWZQVPGBHTA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.783046874 (45h5m0.463242443s) [noise=true , address=77.90.31.11:4566 , piece_id=L5AZKS66QFUKXBCVO5NFR5MEDYTGIIHODHNBYXAFIH2YSE2TZR2A, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.783337791 (45h5m0.46353336s) [noise=true , address=77.90.31.15:4714 , piece_id=EQ5HVZ67YWZTSI6K5FPNOAIIDBPV32KSCEZFP2MY45WALWMQNPDA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.814218168 (45h5m0.494413727s) [noise=true , address=77.90.31.10:4544 , piece_id=YKJJXXMH3K2IJ2VGMRNCEEHUMOKMX3F4ZD72HPRQ6G7XNI5MPICA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.814246252 (45h5m0.494441811s) [seg_pos={0 0}, upload=39627]: Segment reached optimal threshold of 14 pieces. Aug 31 11:13:03.814359448 (45h5m0.494555017s) [noise=true , address=104.36.82.60:4360 , piece_id=JHBHFUQNTTMN6IVKTAVL4SUG27G2HHQOVY3VTFJDH4CZF7AEF56Q, seg_pos={0 0}, upload=39627]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T24rtYBJ47E6Ef1ZZKMWcpBrWBpCg5QV2ZHniCZZkzJF2yUNk): protocol: expected piece hash; context canceled; EOF Aug 31 11:13:03.814418081 (45h5m0.49461364s) [noise=true , address=104.36.82.53:4138 , piece_id=MFMGL7KSLNHYC4IQWD63O5KNIUOCDGYDKZUGGRTKAWMFTKZNFULQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YUGGJg6mWeQMmzSNWtLFWAaWwaKWfEf8wxXs1jwiZaA9nhsr3): protocol: expected piece hash; context canceled; EOF Aug 31 11:13:03.814483546 (45h5m0.494679115s) [noise=true , address=104.36.82.41:4775 , piece_id=7ESRGGJBNYHH4GH3PAACKOTPDKWV7ZRGQXYOUGVQJMYK2FQSNK4Q, seg_pos={0 0}, upload=39627]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:166yRbNnnDeZRifM5q7vUVLx7iV5cZ9GqQnmvD9AbUUJsaCjmj): protocol: expected piece hash; context canceled; EOF Aug 31 11:13:03.814510187 (45h5m0.494705746s) [noise=true , address=77.90.31.21:4903 , piece_id=64466RMNHODOUS4YMYJBS46QNXS37PN3ZCMX56J6AWPF76BDJIFA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZYWQ1a2sTKnFpF28iQVrem2s8nSpXkeJzZDaS7jvTZNANdfp): protocol: expected piece hash; context canceled; EOF Aug 31 11:13:03.814533913 (45h5m0.494729482s) [seg_pos={0 0}, upload=39627]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 31 11:13:03.814608635 (45h5m0.494804204s) [upload=39627]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 31 11:13:03.814612623 (45h5m0.494808193s) [upload=39627]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 31 11:13:06.785691131 (45h5m3.4658867s) [upload=39627]: Done uploading segments... Aug 31 11:13:06.785708434 (45h5m3.465904004s) [upload=39627]: Upload finished. err: <nil> Duration: 5.976520824s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 6.590291439s FAIL (2025-08-31 11:37:03 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.590312239s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 705.097974ms target: https://us1.storj.io/login FAIL (2025-08-31 11:36:55 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout Duration: 705.128584ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 1.992269684s FAIL (2025-08-31 11:36:53 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1.992296276s core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 6.809677382s FAIL (2025-08-31 11:36:39 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.809699453s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 2 out of 60 is failed (threshold=3) [........................X....X..............................] duration: 2.131243922s FAIL (2025-08-31 11:36:28 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 31 11:13:44.970873573 (45h5m41.651069142s) [upload=39634]: Starting upload Aug 31 11:13:44.970949158 (45h5m41.651144727s) [upload=39634]: Done starting upload Aug 31 11:13:44.971018871 (45h5m41.65121444s) [upload=39634]: Uploading segments... Aug 31 11:13:44.971078174 (45h5m41.651273743s) [upload=39634]: Got next segment. Inline: true Aug 31 11:13:44.971082704 (45h5m41.651278273s) [upload=39634]: Waiting for error group managing segments... Aug 31 11:13:44.971114825 (45h5m41.651310394s) [upload=39634]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 11:13:44.971118532 (45h5m41.651314101s) [upload=39634]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 31 11:13:44.971121528 (45h5m41.651317097s) [upload=39634]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 31 11:13:50.376332558 (45h5m47.056528127s) [upload=39634]: Done uploading segments... Aug 31 11:13:50.376399666 (45h5m47.056595235s) [upload=39634]: Upload finished. err: <nil> Duration:* 2.131270312s core uplink us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 739.709461ms target: https://us1.storj.io/login FAIL (2025-08-31 11:36:28 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout Duration: 739.733546ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [........................XX..................................] duration: 6.214669425s FAIL (2025-08-31 11:36:17 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Aug 31 11:11:03.184991323 (45h2m59.865186892s) [upload=39597]: Starting upload Aug 31 11:11:03.185066988 (45h2m59.865262567s) [upload=39597]: Done starting upload Aug 31 11:11:03.185180816 (45h2m59.865376395s) [upload=39597]: Uploading segments... Aug 31 11:11:03.185275988 (45h2m59.865471557s) [upload=39597]: Got next segment. Inline: false Aug 31 11:11:03.185312367 (45h2m59.865507936s) [upload=39597]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 11:11:03.185316826 (45h2m59.865512395s) [upload=39597]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 31 11:11:31.966176185 (45h3m28.646371754s) [upload=39597]: Next segment err: context deadline exceeded Aug 31 11:11:31.966314379 (45h3m28.646509938s) [upload=39597]: Done uploading segments... Aug 31 11:11:31.966328927 (45h3m28.646524497s) [upload=39597]: Upload finished. err: context deadline exceeded Duration: 6.214687348s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 2.056177619s FAIL (2025-08-31 11:36:03 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.056224189s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.............................XX.............................] duration: 5.999091508s FAIL (2025-08-31 11:36:00 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 5.999119673s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 2.059343316s FAIL (2025-08-31 11:35:55 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.059387109s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 5.86696228s FAIL (2025-08-31 11:35:51 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Aug 31 11:13:00.825343942 (45h4m57.505539511s) [upload=39627]: Starting upload Aug 31 11:13:00.825384589 (45h4m57.505580149s) [upload=39627]: Done starting upload Aug 31 11:13:00.825541009 (45h4m57.505736568s) [upload=39627]: Uploading segments... Aug 31 11:13:00.825579793 (45h4m57.505775362s) [upload=39627]: Got next segment. Inline: false Aug 31 11:13:00.825600693 (45h4m57.505796252s) [upload=39627]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 11:13:00.825604560 (45h4m57.505800129s) [upload=39627]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 31 11:13:01.708167688 (45h4m58.388363257s) [seg_pos={0 0}, upload=39627]: Begin upload segment... Aug 31 11:13:01.708224125 (45h4m58.388419695s) [seg_pos={0 0}, upload=39627]: Done begin upload segment. Aug 31 11:13:01.708248382 (45h4m58.388443961s) [noise=true , address=64.49.13.169:4709 , piece_id=5FUJXDUJJLTSAGJROSEZIBYUDPBF55XTNQLOD5WJHSJCVTRSO4UA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.708346640 (45h4m58.388542209s) [noise=true , address=104.36.82.35:4593 , piece_id=PRCATZUEA72YG2S4BTGEQ4ETUWVKMO3OCURBNLFAEGCSB5MDUKUQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.708955535 (45h4m58.389151114s) [noise=true , address=45.91.116.14:4195 , piece_id=UTIYQKVEKCDYGFQ6LX7PBJCGTA2QBMEN5Y7L5REIX4PUJ7WQSZ6Q, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709102236 (45h4m58.389297805s) [noise=true , address=104.36.82.15:4288 , piece_id=RHCPDOB7TEL65DYGJLJRJWC2SUHOV5FT5IZRERXUKHWZQVPGBHTA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709344399 (45h4m58.389539968s) [noise=true , address=64.49.13.155:4917 , piece_id=GSN5BNXY6VQJ63KASNN3MONOM6SV4BRM6WVIYLHGCGZNVK53HWXA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709551927 (45h4m58.389747506s) [noise=true , address=45.91.116.7:4034 , piece_id=LT7WEH3NX6T43P6WZFPREGKZ35R3UMEQYJBHAS4SW7N6CXHTUBOA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709590730 (45h4m58.3897863s) [noise=true , address=104.36.82.41:4775 , piece_id=7ESRGGJBNYHH4GH3PAACKOTPDKWV7ZRGQXYOUGVQJMYK2FQSNK4Q, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709842191 (45h4m58.390037771s) [noise=true , address=104.36.82.5:4853 , piece_id=O7HRHC2V53F22YV4FRE3F6U64PBVZK2AV2KYC4GNFEWHYZRJEOXA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710024290 (45h4m58.390219859s) [noise=true , address=77.90.31.21:4903 , piece_id=64466RMNHODOUS4YMYJBS46QNXS37PN3ZCMX56J6AWPF76BDJIFA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710071431 (45h4m58.390267s) [noise=true , address=104.36.82.48:4592 , piece_id=PACCJAF3QJXJSEUEJL7MRRLVR6ZRR4NLGDU42EAYK2VRTOBLAWGQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710298846 (45h4m58.390494415s) [noise=true , address=104.36.82.60:4360 , piece_id=JHBHFUQNTTMN6IVKTAVL4SUG27G2HHQOVY3VTFJDH4CZF7AEF56Q, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710486405 (45h4m58.390681984s) [noise=true , address=77.90.31.15:4714 , piece_id=EQ5HVZ67YWZTSI6K5FPNOAIIDBPV32KSCEZFP2MY45WALWMQNPDA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710556819 (45h4m58.390752388s) [noise=true , address=77.90.31.10:4544 , piece_id=YKJJXXMH3K2IJ2VGMRNCEEHUMOKMX3F4ZD72HPRQ6G7XNI5MPICA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710813581 (45h4m58.39100915s) [noise=true , address=77.90.31.11:4566 , piece_id=L5AZKS66QFUKXBCVO5NFR5MEDYTGIIHODHNBYXAFIH2YSE2TZR2A, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710945823 (45h4m58.391141402s) [noise=true , address=64.49.13.140:4508 , piece_id=O52JQJINRPKWLZI6NNPFJPZQYGDWHOMV3OHH6WYR2GFBKYRT7N3A, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.711040525 (45h4m58.391236094s) [noise=true , address=79.127.205.246:4263 , piece_id=2KPRXAVRMFEEMS32L3W2MSG7QJD5NLL2XVH5GOJIBDCVHUECVAEQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.711384572 (45h4m58.391580151s) [noise=true , address=104.36.82.53:4138 , piece_id=MFMGL7KSLNHYC4IQWD63O5KNIUOCDGYDKZUGGRTKAWMFTKZNFULQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.711796601 (45h4m58.39199218s) [noise=true , address=79.127.205.245:4251 , piece_id=G7VYPKSXFPKHVBAQDRKC7YCWWHZEQJUKWK4I3CAU4XMM2RRKM2YQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:02.809033683 (45h4m59.489229262s) [upload=39627]: Next returned nil segment Aug 31 11:13:02.809052139 (45h4m59.489247708s) [upload=39627]: Waiting for error group managing segments... Aug 31 11:13:03.110429755 (45h4m59.790625324s) [noise=true , address=79.127.205.245:4251 , piece_id=G7VYPKSXFPKHVBAQDRKC7YCWWHZEQJUKWK4I3CAU4XMM2RRKM2YQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.112669791 (45h4m59.79286538s) [noise=true , address=64.49.13.140:4508 , piece_id=O52JQJINRPKWLZI6NNPFJPZQYGDWHOMV3OHH6WYR2GFBKYRT7N3A, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.128781550 (45h4m59.808977119s) [noise=true , address=79.127.205.246:4263 , piece_id=2KPRXAVRMFEEMS32L3W2MSG7QJD5NLL2XVH5GOJIBDCVHUECVAEQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.142878824 (45h4m59.823074393s) [noise=true , address=64.49.13.155:4917 , piece_id=GSN5BNXY6VQJ63KASNN3MONOM6SV4BRM6WVIYLHGCGZNVK53HWXA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.202555682 (45h4m59.882751251s) [noise=true , address=64.49.13.169:4709 , piece_id=5FUJXDUJJLTSAGJROSEZIBYUDPBF55XTNQLOD5WJHSJCVTRSO4UA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.647619373 (45h5m0.327814942s) [noise=true , address=45.91.116.14:4195 , piece_id=UTIYQKVEKCDYGFQ6LX7PBJCGTA2QBMEN5Y7L5REIX4PUJ7WQSZ6Q, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.680334441 (45h5m0.36053001s) [noise=true , address=104.36.82.35:4593 , piece_id=PRCATZUEA72YG2S4BTGEQ4ETUWVKMO3OCURBNLFAEGCSB5MDUKUQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.737634971 (45h5m0.41783054s) [noise=true , address=45.91.116.7:4034 , piece_id=LT7WEH3NX6T43P6WZFPREGKZ35R3UMEQYJBHAS4SW7N6CXHTUBOA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.749306554 (45h5m0.429502124s) [noise=true , address=104.36.82.48:4592 , piece_id=PACCJAF3QJXJSEUEJL7MRRLVR6ZRR4NLGDU42EAYK2VRTOBLAWGQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.750058222 (45h5m0.430253791s) [noise=true , address=104.36.82.5:4853 , piece_id=O7HRHC2V53F22YV4FRE3F6U64PBVZK2AV2KYC4GNFEWHYZRJEOXA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.752613201 (45h5m0.43280877s) [noise=true , address=104.36.82.15:4288 , piece_id=RHCPDOB7TEL65DYGJLJRJWC2SUHOV5FT5IZRERXUKHWZQVPGBHTA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.783046874 (45h5m0.463242443s) [noise=true , address=77.90.31.11:4566 , piece_id=L5AZKS66QFUKXBCVO5NFR5MEDYTGIIHODHNBYXAFIH2YSE2TZR2A, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.783337791 (45h5m0.46353336s) [noise=true , address=77.90.31.15:4714 , piece_id=EQ5HVZ67YWZTSI6K5FPNOAIIDBPV32KSCEZFP2MY45WALWMQNPDA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.814218168 (45h5m0.494413727s) [noise=true , address=77.90.31.10:4544 , piece_id=YKJJXXMH3K2IJ2VGMRNCEEHUMOKMX3F4ZD72HPRQ6G7XNI5MPICA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.814246252 (45h5m0.494441811s) [seg_pos={0 0}, upload=39627]: Segment reached optimal threshold of 14 pieces. Aug 31 11:13:03.814359448 (45h5m0.494555017s) [noise=true , address=104.36.82.60:4360 , piece_id=JHBHFUQNTTMN6IVKTAVL4SUG27G2HHQOVY3VTFJDH4CZF7AEF56Q, seg_pos={0 0}, upload=39627]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T24rtYBJ47E6Ef1ZZKMWcpBrWBpCg5QV2ZHniCZZkzJF2yUNk): protocol: expected piece hash; context canceled; EOF Aug 31 11:13:03.814418081 (45h5m0.49461364s) [noise=true , address=104.36.82.53:4138 , piece_id=MFMGL7KSLNHYC4IQWD63O5KNIUOCDGYDKZUGGRTKAWMFTKZNFULQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YUGGJg6mWeQMmzSNWtLFWAaWwaKWfEf8wxXs1jwiZaA9nhsr3): protocol: expected piece hash; context canceled; EOF Aug 31 11:13:03.814483546 (45h5m0.494679115s) [noise=true , address=104.36.82.41:4775 , piece_id=7ESRGGJBNYHH4GH3PAACKOTPDKWV7ZRGQXYOUGVQJMYK2FQSNK4Q, seg_pos={0 0}, upload=39627]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:166yRbNnnDeZRifM5q7vUVLx7iV5cZ9GqQnmvD9AbUUJsaCjmj): protocol: expected piece hash; context canceled; EOF Aug 31 11:13:03.814510187 (45h5m0.494705746s) [noise=true , address=77.90.31.21:4903 , piece_id=64466RMNHODOUS4YMYJBS46QNXS37PN3ZCMX56J6AWPF76BDJIFA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZYWQ1a2sTKnFpF28iQVrem2s8nSpXkeJzZDaS7jvTZNANdfp): protocol: expected piece hash; context canceled; EOF Aug 31 11:13:03.814533913 (45h5m0.494729482s) [seg_pos={0 0}, upload=39627]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 31 11:13:03.814608635 (45h5m0.494804204s) [upload=39627]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 31 11:13:03.814612623 (45h5m0.494808193s) [upload=39627]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 31 11:13:06.785691131 (45h5m3.4658867s) [upload=39627]: Done uploading segments... Aug 31 11:13:06.785708434 (45h5m3.465904004s) [upload=39627]: Upload finished. err: <nil> Duration: 5.866992548s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........................XX.................................] duration: 5.972629298s FAIL (2025-08-31 11:35:40 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Aug 31 11:11:03.184991323 (45h2m59.865186892s) [upload=39597]: Starting upload Aug 31 11:11:03.185066988 (45h2m59.865262567s) [upload=39597]: Done starting upload Aug 31 11:11:03.185180816 (45h2m59.865376395s) [upload=39597]: Uploading segments... Aug 31 11:11:03.185275988 (45h2m59.865471557s) [upload=39597]: Got next segment. Inline: false Aug 31 11:11:03.185312367 (45h2m59.865507936s) [upload=39597]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 11:11:03.185316826 (45h2m59.865512395s) [upload=39597]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 31 11:11:31.966176185 (45h3m28.646371754s) [upload=39597]: Next segment err: context deadline exceeded Aug 31 11:11:31.966314379 (45h3m28.646509938s) [upload=39597]: Done uploading segments... Aug 31 11:11:31.966328927 (45h3m28.646524497s) [upload=39597]: Upload finished. err: context deadline exceeded Duration: 5.972651051s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..............................XX............................] duration: 6.448649046s FAIL (2025-08-31 11:35:39 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 6.44866723s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.........................X....X.............................] duration: 2.010472464s FAIL (2025-08-31 11:35:38 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 31 11:13:44.970873573 (45h5m41.651069142s) [upload=39634]: Starting upload Aug 31 11:13:44.970949158 (45h5m41.651144727s) [upload=39634]: Done starting upload Aug 31 11:13:44.971018871 (45h5m41.65121444s) [upload=39634]: Uploading segments... Aug 31 11:13:44.971078174 (45h5m41.651273743s) [upload=39634]: Got next segment. Inline: true Aug 31 11:13:44.971082704 (45h5m41.651278273s) [upload=39634]: Waiting for error group managing segments... Aug 31 11:13:44.971114825 (45h5m41.651310394s) [upload=39634]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 11:13:44.971118532 (45h5m41.651314101s) [upload=39634]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 31 11:13:44.971121528 (45h5m41.651317097s) [upload=39634]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 31 11:13:50.376332558 (45h5m47.056528127s) [upload=39634]: Done uploading segments... Aug 31 11:13:50.376399666 (45h5m47.056595235s) [upload=39634]: Upload finished. err: <nil> Duration:* 2.010501309s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 2.255833544s FAIL (2025-08-31 11:35:36 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.255858272s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 7.597327207s FAIL (2025-08-31 11:35:34 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.597348417s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 763.132979ms target: https://us1.storj.io/login FAIL (2025-08-31 11:35:15 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout Duration: 763.17043ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...............................XX...........................] duration: 6.053956592s FAIL (2025-08-31 11:35:07 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 6.05399707s core uplink us1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)