Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 2 out of 60 is failed (threshold=3) [............X....X..........................................] duration: 4.106023248s FAIL (2025-08-31 11:46:02 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 31 11:13:44.970873573 (45h5m41.651069142s) [upload=39634]: Starting upload Aug 31 11:13:44.970949158 (45h5m41.651144727s) [upload=39634]: Done starting upload Aug 31 11:13:44.971018871 (45h5m41.65121444s) [upload=39634]: Uploading segments... Aug 31 11:13:44.971078174 (45h5m41.651273743s) [upload=39634]: Got next segment. Inline: true Aug 31 11:13:44.971082704 (45h5m41.651278273s) [upload=39634]: Waiting for error group managing segments... Aug 31 11:13:44.971114825 (45h5m41.651310394s) [upload=39634]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 11:13:44.971118532 (45h5m41.651314101s) [upload=39634]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 31 11:13:44.971121528 (45h5m41.651317097s) [upload=39634]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 31 11:13:50.376332558 (45h5m47.056528127s) [upload=39634]: Done uploading segments... Aug 31 11:13:50.376399666 (45h5m47.056595235s) [upload=39634]: Upload finished. err: <nil> Duration:* 4.106058295s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........XX................................................] duration: 10.733614148s FAIL (2025-08-31 11:45:42 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Aug 31 11:11:03.184991323 (45h2m59.865186892s) [upload=39597]: Starting upload Aug 31 11:11:03.185066988 (45h2m59.865262567s) [upload=39597]: Done starting upload Aug 31 11:11:03.185180816 (45h2m59.865376395s) [upload=39597]: Uploading segments... Aug 31 11:11:03.185275988 (45h2m59.865471557s) [upload=39597]: Got next segment. Inline: false Aug 31 11:11:03.185312367 (45h2m59.865507936s) [upload=39597]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 11:11:03.185316826 (45h2m59.865512395s) [upload=39597]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 31 11:11:31.966176185 (45h3m28.646371754s) [upload=39597]: Next segment err: context deadline exceeded Aug 31 11:11:31.966314379 (45h3m28.646509938s) [upload=39597]: Done uploading segments... Aug 31 11:11:31.966328927 (45h3m28.646524497s) [upload=39597]: Upload finished. err: context deadline exceeded Duration: 10.733642854s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 9.216294286s FAIL (2025-08-31 11:45:39 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Aug 31 11:13:00.825343942 (45h4m57.505539511s) [upload=39627]: Starting upload Aug 31 11:13:00.825384589 (45h4m57.505580149s) [upload=39627]: Done starting upload Aug 31 11:13:00.825541009 (45h4m57.505736568s) [upload=39627]: Uploading segments... Aug 31 11:13:00.825579793 (45h4m57.505775362s) [upload=39627]: Got next segment. Inline: false Aug 31 11:13:00.825600693 (45h4m57.505796252s) [upload=39627]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 11:13:00.825604560 (45h4m57.505800129s) [upload=39627]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 31 11:13:01.708167688 (45h4m58.388363257s) [seg_pos={0 0}, upload=39627]: Begin upload segment... Aug 31 11:13:01.708224125 (45h4m58.388419695s) [seg_pos={0 0}, upload=39627]: Done begin upload segment. Aug 31 11:13:01.708248382 (45h4m58.388443961s) [noise=true , address=64.49.13.169:4709 , piece_id=5FUJXDUJJLTSAGJROSEZIBYUDPBF55XTNQLOD5WJHSJCVTRSO4UA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.708346640 (45h4m58.388542209s) [noise=true , address=104.36.82.35:4593 , piece_id=PRCATZUEA72YG2S4BTGEQ4ETUWVKMO3OCURBNLFAEGCSB5MDUKUQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.708955535 (45h4m58.389151114s) [noise=true , address=45.91.116.14:4195 , piece_id=UTIYQKVEKCDYGFQ6LX7PBJCGTA2QBMEN5Y7L5REIX4PUJ7WQSZ6Q, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709102236 (45h4m58.389297805s) [noise=true , address=104.36.82.15:4288 , piece_id=RHCPDOB7TEL65DYGJLJRJWC2SUHOV5FT5IZRERXUKHWZQVPGBHTA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709344399 (45h4m58.389539968s) [noise=true , address=64.49.13.155:4917 , piece_id=GSN5BNXY6VQJ63KASNN3MONOM6SV4BRM6WVIYLHGCGZNVK53HWXA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709551927 (45h4m58.389747506s) [noise=true , address=45.91.116.7:4034 , piece_id=LT7WEH3NX6T43P6WZFPREGKZ35R3UMEQYJBHAS4SW7N6CXHTUBOA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709590730 (45h4m58.3897863s) [noise=true , address=104.36.82.41:4775 , piece_id=7ESRGGJBNYHH4GH3PAACKOTPDKWV7ZRGQXYOUGVQJMYK2FQSNK4Q, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709842191 (45h4m58.390037771s) [noise=true , address=104.36.82.5:4853 , piece_id=O7HRHC2V53F22YV4FRE3F6U64PBVZK2AV2KYC4GNFEWHYZRJEOXA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710024290 (45h4m58.390219859s) [noise=true , address=77.90.31.21:4903 , piece_id=64466RMNHODOUS4YMYJBS46QNXS37PN3ZCMX56J6AWPF76BDJIFA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710071431 (45h4m58.390267s) [noise=true , address=104.36.82.48:4592 , piece_id=PACCJAF3QJXJSEUEJL7MRRLVR6ZRR4NLGDU42EAYK2VRTOBLAWGQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710298846 (45h4m58.390494415s) [noise=true , address=104.36.82.60:4360 , piece_id=JHBHFUQNTTMN6IVKTAVL4SUG27G2HHQOVY3VTFJDH4CZF7AEF56Q, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710486405 (45h4m58.390681984s) [noise=true , address=77.90.31.15:4714 , piece_id=EQ5HVZ67YWZTSI6K5FPNOAIIDBPV32KSCEZFP2MY45WALWMQNPDA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710556819 (45h4m58.390752388s) [noise=true , address=77.90.31.10:4544 , piece_id=YKJJXXMH3K2IJ2VGMRNCEEHUMOKMX3F4ZD72HPRQ6G7XNI5MPICA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710813581 (45h4m58.39100915s) [noise=true , address=77.90.31.11:4566 , piece_id=L5AZKS66QFUKXBCVO5NFR5MEDYTGIIHODHNBYXAFIH2YSE2TZR2A, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710945823 (45h4m58.391141402s) [noise=true , address=64.49.13.140:4508 , piece_id=O52JQJINRPKWLZI6NNPFJPZQYGDWHOMV3OHH6WYR2GFBKYRT7N3A, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.711040525 (45h4m58.391236094s) [noise=true , address=79.127.205.246:4263 , piece_id=2KPRXAVRMFEEMS32L3W2MSG7QJD5NLL2XVH5GOJIBDCVHUECVAEQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.711384572 (45h4m58.391580151s) [noise=true , address=104.36.82.53:4138 , piece_id=MFMGL7KSLNHYC4IQWD63O5KNIUOCDGYDKZUGGRTKAWMFTKZNFULQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.711796601 (45h4m58.39199218s) [noise=true , address=79.127.205.245:4251 , piece_id=G7VYPKSXFPKHVBAQDRKC7YCWWHZEQJUKWK4I3CAU4XMM2RRKM2YQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:02.809033683 (45h4m59.489229262s) [upload=39627]: Next returned nil segment Aug 31 11:13:02.809052139 (45h4m59.489247708s) [upload=39627]: Waiting for error group managing segments... Aug 31 11:13:03.110429755 (45h4m59.790625324s) [noise=true , address=79.127.205.245:4251 , piece_id=G7VYPKSXFPKHVBAQDRKC7YCWWHZEQJUKWK4I3CAU4XMM2RRKM2YQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.112669791 (45h4m59.79286538s) [noise=true , address=64.49.13.140:4508 , piece_id=O52JQJINRPKWLZI6NNPFJPZQYGDWHOMV3OHH6WYR2GFBKYRT7N3A, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.128781550 (45h4m59.808977119s) [noise=true , address=79.127.205.246:4263 , piece_id=2KPRXAVRMFEEMS32L3W2MSG7QJD5NLL2XVH5GOJIBDCVHUECVAEQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.142878824 (45h4m59.823074393s) [noise=true , address=64.49.13.155:4917 , piece_id=GSN5BNXY6VQJ63KASNN3MONOM6SV4BRM6WVIYLHGCGZNVK53HWXA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.202555682 (45h4m59.882751251s) [noise=true , address=64.49.13.169:4709 , piece_id=5FUJXDUJJLTSAGJROSEZIBYUDPBF55XTNQLOD5WJHSJCVTRSO4UA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.647619373 (45h5m0.327814942s) [noise=true , address=45.91.116.14:4195 , piece_id=UTIYQKVEKCDYGFQ6LX7PBJCGTA2QBMEN5Y7L5REIX4PUJ7WQSZ6Q, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.680334441 (45h5m0.36053001s) [noise=true , address=104.36.82.35:4593 , piece_id=PRCATZUEA72YG2S4BTGEQ4ETUWVKMO3OCURBNLFAEGCSB5MDUKUQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.737634971 (45h5m0.41783054s) [noise=true , address=45.91.116.7:4034 , piece_id=LT7WEH3NX6T43P6WZFPREGKZ35R3UMEQYJBHAS4SW7N6CXHTUBOA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.749306554 (45h5m0.429502124s) [noise=true , address=104.36.82.48:4592 , piece_id=PACCJAF3QJXJSEUEJL7MRRLVR6ZRR4NLGDU42EAYK2VRTOBLAWGQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.750058222 (45h5m0.430253791s) [noise=true , address=104.36.82.5:4853 , piece_id=O7HRHC2V53F22YV4FRE3F6U64PBVZK2AV2KYC4GNFEWHYZRJEOXA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.752613201 (45h5m0.43280877s) [noise=true , address=104.36.82.15:4288 , piece_id=RHCPDOB7TEL65DYGJLJRJWC2SUHOV5FT5IZRERXUKHWZQVPGBHTA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.783046874 (45h5m0.463242443s) [noise=true , address=77.90.31.11:4566 , piece_id=L5AZKS66QFUKXBCVO5NFR5MEDYTGIIHODHNBYXAFIH2YSE2TZR2A, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.783337791 (45h5m0.46353336s) [noise=true , address=77.90.31.15:4714 , piece_id=EQ5HVZ67YWZTSI6K5FPNOAIIDBPV32KSCEZFP2MY45WALWMQNPDA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.814218168 (45h5m0.494413727s) [noise=true , address=77.90.31.10:4544 , piece_id=YKJJXXMH3K2IJ2VGMRNCEEHUMOKMX3F4ZD72HPRQ6G7XNI5MPICA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.814246252 (45h5m0.494441811s) [seg_pos={0 0}, upload=39627]: Segment reached optimal threshold of 14 pieces. Aug 31 11:13:03.814359448 (45h5m0.494555017s) [noise=true , address=104.36.82.60:4360 , piece_id=JHBHFUQNTTMN6IVKTAVL4SUG27G2HHQOVY3VTFJDH4CZF7AEF56Q, seg_pos={0 0}, upload=39627]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T24rtYBJ47E6Ef1ZZKMWcpBrWBpCg5QV2ZHniCZZkzJF2yUNk): protocol: expected piece hash; context canceled; EOF Aug 31 11:13:03.814418081 (45h5m0.49461364s) [noise=true , address=104.36.82.53:4138 , piece_id=MFMGL7KSLNHYC4IQWD63O5KNIUOCDGYDKZUGGRTKAWMFTKZNFULQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YUGGJg6mWeQMmzSNWtLFWAaWwaKWfEf8wxXs1jwiZaA9nhsr3): protocol: expected piece hash; context canceled; EOF Aug 31 11:13:03.814483546 (45h5m0.494679115s) [noise=true , address=104.36.82.41:4775 , piece_id=7ESRGGJBNYHH4GH3PAACKOTPDKWV7ZRGQXYOUGVQJMYK2FQSNK4Q, seg_pos={0 0}, upload=39627]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:166yRbNnnDeZRifM5q7vUVLx7iV5cZ9GqQnmvD9AbUUJsaCjmj): protocol: expected piece hash; context canceled; EOF Aug 31 11:13:03.814510187 (45h5m0.494705746s) [noise=true , address=77.90.31.21:4903 , piece_id=64466RMNHODOUS4YMYJBS46QNXS37PN3ZCMX56J6AWPF76BDJIFA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZYWQ1a2sTKnFpF28iQVrem2s8nSpXkeJzZDaS7jvTZNANdfp): protocol: expected piece hash; context canceled; EOF Aug 31 11:13:03.814533913 (45h5m0.494729482s) [seg_pos={0 0}, upload=39627]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 31 11:13:03.814608635 (45h5m0.494804204s) [upload=39627]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 31 11:13:03.814612623 (45h5m0.494808193s) [upload=39627]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 31 11:13:06.785691131 (45h5m3.4658867s) [upload=39627]: Done uploading segments... Aug 31 11:13:06.785708434 (45h5m3.465904004s) [upload=39627]: Upload finished. err: <nil> Duration: 9.216326458s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 9.126046334s FAIL (2025-08-31 11:45:39 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 9.126068276s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...................XX.......................................] duration: 6.685007452s FAIL (2025-08-31 11:45:31 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 6.685031297s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 1.891911985s FAIL (2025-08-31 11:45:24 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 1.891939298s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 1.987000434s FAIL (2025-08-31 11:45:22 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1.987027806s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...........XX...............................................] duration: 8.158589532s FAIL (2025-08-31 11:45:20 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Aug 31 11:11:03.184991323 (45h2m59.865186892s) [upload=39597]: Starting upload Aug 31 11:11:03.185066988 (45h2m59.865262567s) [upload=39597]: Done starting upload Aug 31 11:11:03.185180816 (45h2m59.865376395s) [upload=39597]: Uploading segments... Aug 31 11:11:03.185275988 (45h2m59.865471557s) [upload=39597]: Got next segment. Inline: false Aug 31 11:11:03.185312367 (45h2m59.865507936s) [upload=39597]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 11:11:03.185316826 (45h2m59.865512395s) [upload=39597]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 31 11:11:31.966176185 (45h3m28.646371754s) [upload=39597]: Next segment err: context deadline exceeded Aug 31 11:11:31.966314379 (45h3m28.646509938s) [upload=39597]: Done uploading segments... Aug 31 11:11:31.966328927 (45h3m28.646524497s) [upload=39597]: Upload finished. err: context deadline exceeded Duration: 8.158617254s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.............X....X.........................................] duration: 5.114548413s FAIL (2025-08-31 11:45:16 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 31 11:13:44.970873573 (45h5m41.651069142s) [upload=39634]: Starting upload Aug 31 11:13:44.970949158 (45h5m41.651144727s) [upload=39634]: Done starting upload Aug 31 11:13:44.971018871 (45h5m41.65121444s) [upload=39634]: Uploading segments... Aug 31 11:13:44.971078174 (45h5m41.651273743s) [upload=39634]: Got next segment. Inline: true Aug 31 11:13:44.971082704 (45h5m41.651278273s) [upload=39634]: Waiting for error group managing segments... Aug 31 11:13:44.971114825 (45h5m41.651310394s) [upload=39634]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 11:13:44.971118532 (45h5m41.651314101s) [upload=39634]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 31 11:13:44.971121528 (45h5m41.651317097s) [upload=39634]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 31 11:13:50.376332558 (45h5m47.056528127s) [upload=39634]: Done uploading segments... Aug 31 11:13:50.376399666 (45h5m47.056595235s) [upload=39634]: Upload finished. err: <nil> Duration:* 5.114598849s core uplink us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 1.737057852s target: https://us1.storj.io/login FAIL (2025-08-31 11:45:16 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout Duration: 1.737085375s core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [....................XX......................................] duration: 6.468149483s FAIL (2025-08-31 11:45:09 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 6.468176023s core uplink us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 702.615456ms target: https://us1.storj.io/login FAIL (2025-08-31 11:44:53 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout Duration: 702.637399ms core satellite us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 6.644225074s FAIL (2025-08-31 11:44:53 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.644266094s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 1.986631265s FAIL (2025-08-31 11:44:52 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 1.986660039s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 13.521119674s FAIL (2025-08-31 11:44:47 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Aug 31 11:13:00.825343942 (45h4m57.505539511s) [upload=39627]: Starting upload Aug 31 11:13:00.825384589 (45h4m57.505580149s) [upload=39627]: Done starting upload Aug 31 11:13:00.825541009 (45h4m57.505736568s) [upload=39627]: Uploading segments... Aug 31 11:13:00.825579793 (45h4m57.505775362s) [upload=39627]: Got next segment. Inline: false Aug 31 11:13:00.825600693 (45h4m57.505796252s) [upload=39627]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 11:13:00.825604560 (45h4m57.505800129s) [upload=39627]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 31 11:13:01.708167688 (45h4m58.388363257s) [seg_pos={0 0}, upload=39627]: Begin upload segment... Aug 31 11:13:01.708224125 (45h4m58.388419695s) [seg_pos={0 0}, upload=39627]: Done begin upload segment. Aug 31 11:13:01.708248382 (45h4m58.388443961s) [noise=true , address=64.49.13.169:4709 , piece_id=5FUJXDUJJLTSAGJROSEZIBYUDPBF55XTNQLOD5WJHSJCVTRSO4UA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.708346640 (45h4m58.388542209s) [noise=true , address=104.36.82.35:4593 , piece_id=PRCATZUEA72YG2S4BTGEQ4ETUWVKMO3OCURBNLFAEGCSB5MDUKUQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.708955535 (45h4m58.389151114s) [noise=true , address=45.91.116.14:4195 , piece_id=UTIYQKVEKCDYGFQ6LX7PBJCGTA2QBMEN5Y7L5REIX4PUJ7WQSZ6Q, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709102236 (45h4m58.389297805s) [noise=true , address=104.36.82.15:4288 , piece_id=RHCPDOB7TEL65DYGJLJRJWC2SUHOV5FT5IZRERXUKHWZQVPGBHTA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709344399 (45h4m58.389539968s) [noise=true , address=64.49.13.155:4917 , piece_id=GSN5BNXY6VQJ63KASNN3MONOM6SV4BRM6WVIYLHGCGZNVK53HWXA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709551927 (45h4m58.389747506s) [noise=true , address=45.91.116.7:4034 , piece_id=LT7WEH3NX6T43P6WZFPREGKZ35R3UMEQYJBHAS4SW7N6CXHTUBOA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709590730 (45h4m58.3897863s) [noise=true , address=104.36.82.41:4775 , piece_id=7ESRGGJBNYHH4GH3PAACKOTPDKWV7ZRGQXYOUGVQJMYK2FQSNK4Q, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709842191 (45h4m58.390037771s) [noise=true , address=104.36.82.5:4853 , piece_id=O7HRHC2V53F22YV4FRE3F6U64PBVZK2AV2KYC4GNFEWHYZRJEOXA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710024290 (45h4m58.390219859s) [noise=true , address=77.90.31.21:4903 , piece_id=64466RMNHODOUS4YMYJBS46QNXS37PN3ZCMX56J6AWPF76BDJIFA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710071431 (45h4m58.390267s) [noise=true , address=104.36.82.48:4592 , piece_id=PACCJAF3QJXJSEUEJL7MRRLVR6ZRR4NLGDU42EAYK2VRTOBLAWGQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710298846 (45h4m58.390494415s) [noise=true , address=104.36.82.60:4360 , piece_id=JHBHFUQNTTMN6IVKTAVL4SUG27G2HHQOVY3VTFJDH4CZF7AEF56Q, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710486405 (45h4m58.390681984s) [noise=true , address=77.90.31.15:4714 , piece_id=EQ5HVZ67YWZTSI6K5FPNOAIIDBPV32KSCEZFP2MY45WALWMQNPDA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710556819 (45h4m58.390752388s) [noise=true , address=77.90.31.10:4544 , piece_id=YKJJXXMH3K2IJ2VGMRNCEEHUMOKMX3F4ZD72HPRQ6G7XNI5MPICA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710813581 (45h4m58.39100915s) [noise=true , address=77.90.31.11:4566 , piece_id=L5AZKS66QFUKXBCVO5NFR5MEDYTGIIHODHNBYXAFIH2YSE2TZR2A, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710945823 (45h4m58.391141402s) [noise=true , address=64.49.13.140:4508 , piece_id=O52JQJINRPKWLZI6NNPFJPZQYGDWHOMV3OHH6WYR2GFBKYRT7N3A, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.711040525 (45h4m58.391236094s) [noise=true , address=79.127.205.246:4263 , piece_id=2KPRXAVRMFEEMS32L3W2MSG7QJD5NLL2XVH5GOJIBDCVHUECVAEQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.711384572 (45h4m58.391580151s) [noise=true , address=104.36.82.53:4138 , piece_id=MFMGL7KSLNHYC4IQWD63O5KNIUOCDGYDKZUGGRTKAWMFTKZNFULQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.711796601 (45h4m58.39199218s) [noise=true , address=79.127.205.245:4251 , piece_id=G7VYPKSXFPKHVBAQDRKC7YCWWHZEQJUKWK4I3CAU4XMM2RRKM2YQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:02.809033683 (45h4m59.489229262s) [upload=39627]: Next returned nil segment Aug 31 11:13:02.809052139 (45h4m59.489247708s) [upload=39627]: Waiting for error group managing segments... Aug 31 11:13:03.110429755 (45h4m59.790625324s) [noise=true , address=79.127.205.245:4251 , piece_id=G7VYPKSXFPKHVBAQDRKC7YCWWHZEQJUKWK4I3CAU4XMM2RRKM2YQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.112669791 (45h4m59.79286538s) [noise=true , address=64.49.13.140:4508 , piece_id=O52JQJINRPKWLZI6NNPFJPZQYGDWHOMV3OHH6WYR2GFBKYRT7N3A, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.128781550 (45h4m59.808977119s) [noise=true , address=79.127.205.246:4263 , piece_id=2KPRXAVRMFEEMS32L3W2MSG7QJD5NLL2XVH5GOJIBDCVHUECVAEQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.142878824 (45h4m59.823074393s) [noise=true , address=64.49.13.155:4917 , piece_id=GSN5BNXY6VQJ63KASNN3MONOM6SV4BRM6WVIYLHGCGZNVK53HWXA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.202555682 (45h4m59.882751251s) [noise=true , address=64.49.13.169:4709 , piece_id=5FUJXDUJJLTSAGJROSEZIBYUDPBF55XTNQLOD5WJHSJCVTRSO4UA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.647619373 (45h5m0.327814942s) [noise=true , address=45.91.116.14:4195 , piece_id=UTIYQKVEKCDYGFQ6LX7PBJCGTA2QBMEN5Y7L5REIX4PUJ7WQSZ6Q, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.680334441 (45h5m0.36053001s) [noise=true , address=104.36.82.35:4593 , piece_id=PRCATZUEA72YG2S4BTGEQ4ETUWVKMO3OCURBNLFAEGCSB5MDUKUQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.737634971 (45h5m0.41783054s) [noise=true , address=45.91.116.7:4034 , piece_id=LT7WEH3NX6T43P6WZFPREGKZ35R3UMEQYJBHAS4SW7N6CXHTUBOA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.749306554 (45h5m0.429502124s) [noise=true , address=104.36.82.48:4592 , piece_id=PACCJAF3QJXJSEUEJL7MRRLVR6ZRR4NLGDU42EAYK2VRTOBLAWGQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.750058222 (45h5m0.430253791s) [noise=true , address=104.36.82.5:4853 , piece_id=O7HRHC2V53F22YV4FRE3F6U64PBVZK2AV2KYC4GNFEWHYZRJEOXA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.752613201 (45h5m0.43280877s) [noise=true , address=104.36.82.15:4288 , piece_id=RHCPDOB7TEL65DYGJLJRJWC2SUHOV5FT5IZRERXUKHWZQVPGBHTA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.783046874 (45h5m0.463242443s) [noise=true , address=77.90.31.11:4566 , piece_id=L5AZKS66QFUKXBCVO5NFR5MEDYTGIIHODHNBYXAFIH2YSE2TZR2A, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.783337791 (45h5m0.46353336s) [noise=true , address=77.90.31.15:4714 , piece_id=EQ5HVZ67YWZTSI6K5FPNOAIIDBPV32KSCEZFP2MY45WALWMQNPDA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.814218168 (45h5m0.494413727s) [noise=true , address=77.90.31.10:4544 , piece_id=YKJJXXMH3K2IJ2VGMRNCEEHUMOKMX3F4ZD72HPRQ6G7XNI5MPICA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.814246252 (45h5m0.494441811s) [seg_pos={0 0}, upload=39627]: Segment reached optimal threshold of 14 pieces. Aug 31 11:13:03.814359448 (45h5m0.494555017s) [noise=true , address=104.36.82.60:4360 , piece_id=JHBHFUQNTTMN6IVKTAVL4SUG27G2HHQOVY3VTFJDH4CZF7AEF56Q, seg_pos={0 0}, upload=39627]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T24rtYBJ47E6Ef1ZZKMWcpBrWBpCg5QV2ZHniCZZkzJF2yUNk): protocol: expected piece hash; context canceled; EOF Aug 31 11:13:03.814418081 (45h5m0.49461364s) [noise=true , address=104.36.82.53:4138 , piece_id=MFMGL7KSLNHYC4IQWD63O5KNIUOCDGYDKZUGGRTKAWMFTKZNFULQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YUGGJg6mWeQMmzSNWtLFWAaWwaKWfEf8wxXs1jwiZaA9nhsr3): protocol: expected piece hash; context canceled; EOF Aug 31 11:13:03.814483546 (45h5m0.494679115s) [noise=true , address=104.36.82.41:4775 , piece_id=7ESRGGJBNYHH4GH3PAACKOTPDKWV7ZRGQXYOUGVQJMYK2FQSNK4Q, seg_pos={0 0}, upload=39627]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:166yRbNnnDeZRifM5q7vUVLx7iV5cZ9GqQnmvD9AbUUJsaCjmj): protocol: expected piece hash; context canceled; EOF Aug 31 11:13:03.814510187 (45h5m0.494705746s) [noise=true , address=77.90.31.21:4903 , piece_id=64466RMNHODOUS4YMYJBS46QNXS37PN3ZCMX56J6AWPF76BDJIFA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZYWQ1a2sTKnFpF28iQVrem2s8nSpXkeJzZDaS7jvTZNANdfp): protocol: expected piece hash; context canceled; EOF Aug 31 11:13:03.814533913 (45h5m0.494729482s) [seg_pos={0 0}, upload=39627]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 31 11:13:03.814608635 (45h5m0.494804204s) [upload=39627]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 31 11:13:03.814612623 (45h5m0.494808193s) [upload=39627]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 31 11:13:06.785691131 (45h5m3.4658867s) [upload=39627]: Done uploading segments... Aug 31 11:13:06.785708434 (45h5m3.465904004s) [upload=39627]: Upload finished. err: <nil> Duration: 13.521146605s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 8.6645822s FAIL (2025-08-31 11:44:33 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 8.66460914s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....................XX.....................................] duration: 8.682419421s FAIL (2025-08-31 11:44:31 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 8.682443969s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [............XX..............................................] duration: 6.709700949s FAIL (2025-08-31 11:44:27 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Aug 31 11:11:03.184991323 (45h2m59.865186892s) [upload=39597]: Starting upload Aug 31 11:11:03.185066988 (45h2m59.865262567s) [upload=39597]: Done starting upload Aug 31 11:11:03.185180816 (45h2m59.865376395s) [upload=39597]: Uploading segments... Aug 31 11:11:03.185275988 (45h2m59.865471557s) [upload=39597]: Got next segment. Inline: false Aug 31 11:11:03.185312367 (45h2m59.865507936s) [upload=39597]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 11:11:03.185316826 (45h2m59.865512395s) [upload=39597]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 31 11:11:31.966176185 (45h3m28.646371754s) [upload=39597]: Next segment err: context deadline exceeded Aug 31 11:11:31.966314379 (45h3m28.646509938s) [upload=39597]: Done uploading segments... Aug 31 11:11:31.966328927 (45h3m28.646524497s) [upload=39597]: Upload finished. err: context deadline exceeded Duration: 6.709750614s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 9.367493583s FAIL (2025-08-31 11:44:17 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Aug 31 11:13:00.825343942 (45h4m57.505539511s) [upload=39627]: Starting upload Aug 31 11:13:00.825384589 (45h4m57.505580149s) [upload=39627]: Done starting upload Aug 31 11:13:00.825541009 (45h4m57.505736568s) [upload=39627]: Uploading segments... Aug 31 11:13:00.825579793 (45h4m57.505775362s) [upload=39627]: Got next segment. Inline: false Aug 31 11:13:00.825600693 (45h4m57.505796252s) [upload=39627]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 11:13:00.825604560 (45h4m57.505800129s) [upload=39627]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 31 11:13:01.708167688 (45h4m58.388363257s) [seg_pos={0 0}, upload=39627]: Begin upload segment... Aug 31 11:13:01.708224125 (45h4m58.388419695s) [seg_pos={0 0}, upload=39627]: Done begin upload segment. Aug 31 11:13:01.708248382 (45h4m58.388443961s) [noise=true , address=64.49.13.169:4709 , piece_id=5FUJXDUJJLTSAGJROSEZIBYUDPBF55XTNQLOD5WJHSJCVTRSO4UA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.708346640 (45h4m58.388542209s) [noise=true , address=104.36.82.35:4593 , piece_id=PRCATZUEA72YG2S4BTGEQ4ETUWVKMO3OCURBNLFAEGCSB5MDUKUQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.708955535 (45h4m58.389151114s) [noise=true , address=45.91.116.14:4195 , piece_id=UTIYQKVEKCDYGFQ6LX7PBJCGTA2QBMEN5Y7L5REIX4PUJ7WQSZ6Q, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709102236 (45h4m58.389297805s) [noise=true , address=104.36.82.15:4288 , piece_id=RHCPDOB7TEL65DYGJLJRJWC2SUHOV5FT5IZRERXUKHWZQVPGBHTA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709344399 (45h4m58.389539968s) [noise=true , address=64.49.13.155:4917 , piece_id=GSN5BNXY6VQJ63KASNN3MONOM6SV4BRM6WVIYLHGCGZNVK53HWXA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709551927 (45h4m58.389747506s) [noise=true , address=45.91.116.7:4034 , piece_id=LT7WEH3NX6T43P6WZFPREGKZ35R3UMEQYJBHAS4SW7N6CXHTUBOA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709590730 (45h4m58.3897863s) [noise=true , address=104.36.82.41:4775 , piece_id=7ESRGGJBNYHH4GH3PAACKOTPDKWV7ZRGQXYOUGVQJMYK2FQSNK4Q, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709842191 (45h4m58.390037771s) [noise=true , address=104.36.82.5:4853 , piece_id=O7HRHC2V53F22YV4FRE3F6U64PBVZK2AV2KYC4GNFEWHYZRJEOXA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710024290 (45h4m58.390219859s) [noise=true , address=77.90.31.21:4903 , piece_id=64466RMNHODOUS4YMYJBS46QNXS37PN3ZCMX56J6AWPF76BDJIFA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710071431 (45h4m58.390267s) [noise=true , address=104.36.82.48:4592 , piece_id=PACCJAF3QJXJSEUEJL7MRRLVR6ZRR4NLGDU42EAYK2VRTOBLAWGQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710298846 (45h4m58.390494415s) [noise=true , address=104.36.82.60:4360 , piece_id=JHBHFUQNTTMN6IVKTAVL4SUG27G2HHQOVY3VTFJDH4CZF7AEF56Q, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710486405 (45h4m58.390681984s) [noise=true , address=77.90.31.15:4714 , piece_id=EQ5HVZ67YWZTSI6K5FPNOAIIDBPV32KSCEZFP2MY45WALWMQNPDA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710556819 (45h4m58.390752388s) [noise=true , address=77.90.31.10:4544 , piece_id=YKJJXXMH3K2IJ2VGMRNCEEHUMOKMX3F4ZD72HPRQ6G7XNI5MPICA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710813581 (45h4m58.39100915s) [noise=true , address=77.90.31.11:4566 , piece_id=L5AZKS66QFUKXBCVO5NFR5MEDYTGIIHODHNBYXAFIH2YSE2TZR2A, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710945823 (45h4m58.391141402s) [noise=true , address=64.49.13.140:4508 , piece_id=O52JQJINRPKWLZI6NNPFJPZQYGDWHOMV3OHH6WYR2GFBKYRT7N3A, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.711040525 (45h4m58.391236094s) [noise=true , address=79.127.205.246:4263 , piece_id=2KPRXAVRMFEEMS32L3W2MSG7QJD5NLL2XVH5GOJIBDCVHUECVAEQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.711384572 (45h4m58.391580151s) [noise=true , address=104.36.82.53:4138 , piece_id=MFMGL7KSLNHYC4IQWD63O5KNIUOCDGYDKZUGGRTKAWMFTKZNFULQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.711796601 (45h4m58.39199218s) [noise=true , address=79.127.205.245:4251 , piece_id=G7VYPKSXFPKHVBAQDRKC7YCWWHZEQJUKWK4I3CAU4XMM2RRKM2YQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:02.809033683 (45h4m59.489229262s) [upload=39627]: Next returned nil segment Aug 31 11:13:02.809052139 (45h4m59.489247708s) [upload=39627]: Waiting for error group managing segments... Aug 31 11:13:03.110429755 (45h4m59.790625324s) [noise=true , address=79.127.205.245:4251 , piece_id=G7VYPKSXFPKHVBAQDRKC7YCWWHZEQJUKWK4I3CAU4XMM2RRKM2YQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.112669791 (45h4m59.79286538s) [noise=true , address=64.49.13.140:4508 , piece_id=O52JQJINRPKWLZI6NNPFJPZQYGDWHOMV3OHH6WYR2GFBKYRT7N3A, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.128781550 (45h4m59.808977119s) [noise=true , address=79.127.205.246:4263 , piece_id=2KPRXAVRMFEEMS32L3W2MSG7QJD5NLL2XVH5GOJIBDCVHUECVAEQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.142878824 (45h4m59.823074393s) [noise=true , address=64.49.13.155:4917 , piece_id=GSN5BNXY6VQJ63KASNN3MONOM6SV4BRM6WVIYLHGCGZNVK53HWXA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.202555682 (45h4m59.882751251s) [noise=true , address=64.49.13.169:4709 , piece_id=5FUJXDUJJLTSAGJROSEZIBYUDPBF55XTNQLOD5WJHSJCVTRSO4UA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.647619373 (45h5m0.327814942s) [noise=true , address=45.91.116.14:4195 , piece_id=UTIYQKVEKCDYGFQ6LX7PBJCGTA2QBMEN5Y7L5REIX4PUJ7WQSZ6Q, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.680334441 (45h5m0.36053001s) [noise=true , address=104.36.82.35:4593 , piece_id=PRCATZUEA72YG2S4BTGEQ4ETUWVKMO3OCURBNLFAEGCSB5MDUKUQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.737634971 (45h5m0.41783054s) [noise=true , address=45.91.116.7:4034 , piece_id=LT7WEH3NX6T43P6WZFPREGKZ35R3UMEQYJBHAS4SW7N6CXHTUBOA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.749306554 (45h5m0.429502124s) [noise=true , address=104.36.82.48:4592 , piece_id=PACCJAF3QJXJSEUEJL7MRRLVR6ZRR4NLGDU42EAYK2VRTOBLAWGQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.750058222 (45h5m0.430253791s) [noise=true , address=104.36.82.5:4853 , piece_id=O7HRHC2V53F22YV4FRE3F6U64PBVZK2AV2KYC4GNFEWHYZRJEOXA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.752613201 (45h5m0.43280877s) [noise=true , address=104.36.82.15:4288 , piece_id=RHCPDOB7TEL65DYGJLJRJWC2SUHOV5FT5IZRERXUKHWZQVPGBHTA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.783046874 (45h5m0.463242443s) [noise=true , address=77.90.31.11:4566 , piece_id=L5AZKS66QFUKXBCVO5NFR5MEDYTGIIHODHNBYXAFIH2YSE2TZR2A, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.783337791 (45h5m0.46353336s) [noise=true , address=77.90.31.15:4714 , piece_id=EQ5HVZ67YWZTSI6K5FPNOAIIDBPV32KSCEZFP2MY45WALWMQNPDA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.814218168 (45h5m0.494413727s) [noise=true , address=77.90.31.10:4544 , piece_id=YKJJXXMH3K2IJ2VGMRNCEEHUMOKMX3F4ZD72HPRQ6G7XNI5MPICA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.814246252 (45h5m0.494441811s) [seg_pos={0 0}, upload=39627]: Segment reached optimal threshold of 14 pieces. Aug 31 11:13:03.814359448 (45h5m0.494555017s) [noise=true , address=104.36.82.60:4360 , piece_id=JHBHFUQNTTMN6IVKTAVL4SUG27G2HHQOVY3VTFJDH4CZF7AEF56Q, seg_pos={0 0}, upload=39627]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T24rtYBJ47E6Ef1ZZKMWcpBrWBpCg5QV2ZHniCZZkzJF2yUNk): protocol: expected piece hash; context canceled; EOF Aug 31 11:13:03.814418081 (45h5m0.49461364s) [noise=true , address=104.36.82.53:4138 , piece_id=MFMGL7KSLNHYC4IQWD63O5KNIUOCDGYDKZUGGRTKAWMFTKZNFULQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YUGGJg6mWeQMmzSNWtLFWAaWwaKWfEf8wxXs1jwiZaA9nhsr3): protocol: expected piece hash; context canceled; EOF Aug 31 11:13:03.814483546 (45h5m0.494679115s) [noise=true , address=104.36.82.41:4775 , piece_id=7ESRGGJBNYHH4GH3PAACKOTPDKWV7ZRGQXYOUGVQJMYK2FQSNK4Q, seg_pos={0 0}, upload=39627]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:166yRbNnnDeZRifM5q7vUVLx7iV5cZ9GqQnmvD9AbUUJsaCjmj): protocol: expected piece hash; context canceled; EOF Aug 31 11:13:03.814510187 (45h5m0.494705746s) [noise=true , address=77.90.31.21:4903 , piece_id=64466RMNHODOUS4YMYJBS46QNXS37PN3ZCMX56J6AWPF76BDJIFA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZYWQ1a2sTKnFpF28iQVrem2s8nSpXkeJzZDaS7jvTZNANdfp): protocol: expected piece hash; context canceled; EOF Aug 31 11:13:03.814533913 (45h5m0.494729482s) [seg_pos={0 0}, upload=39627]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 31 11:13:03.814608635 (45h5m0.494804204s) [upload=39627]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 31 11:13:03.814612623 (45h5m0.494808193s) [upload=39627]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 31 11:13:06.785691131 (45h5m3.4658867s) [upload=39627]: Done uploading segments... Aug 31 11:13:06.785708434 (45h5m3.465904004s) [upload=39627]: Upload finished. err: <nil> Duration: 9.367521015s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 2 out of 60 is failed (threshold=3) [..............X....X........................................] duration: 2.170268711s FAIL (2025-08-31 11:44:13 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 31 11:13:44.970873573 (45h5m41.651069142s) [upload=39634]: Starting upload Aug 31 11:13:44.970949158 (45h5m41.651144727s) [upload=39634]: Done starting upload Aug 31 11:13:44.971018871 (45h5m41.65121444s) [upload=39634]: Uploading segments... Aug 31 11:13:44.971078174 (45h5m41.651273743s) [upload=39634]: Got next segment. Inline: true Aug 31 11:13:44.971082704 (45h5m41.651278273s) [upload=39634]: Waiting for error group managing segments... Aug 31 11:13:44.971114825 (45h5m41.651310394s) [upload=39634]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 11:13:44.971118532 (45h5m41.651314101s) [upload=39634]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 31 11:13:44.971121528 (45h5m41.651317097s) [upload=39634]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 31 11:13:50.376332558 (45h5m47.056528127s) [upload=39634]: Done uploading segments... Aug 31 11:13:50.376399666 (45h5m47.056595235s) [upload=39634]: Upload finished. err: <nil> Duration:* 2.170298078s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 2.176940949s FAIL (2025-08-31 11:44:04 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.176970706s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 6.550188432s FAIL (2025-08-31 11:43:58 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.550207348s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 3.914812088s target: https://us1.storj.io/login FAIL (2025-08-31 11:43:53 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout Duration: 3.914839079s core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 2.155521836s FAIL (2025-08-31 11:43:43 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.155552795s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 2 out of 60 is failed (threshold=3) [...............X....X.......................................] duration: 1.983676259s FAIL (2025-08-31 11:43:35 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 31 11:13:44.970873573 (45h5m41.651069142s) [upload=39634]: Starting upload Aug 31 11:13:44.970949158 (45h5m41.651144727s) [upload=39634]: Done starting upload Aug 31 11:13:44.971018871 (45h5m41.65121444s) [upload=39634]: Uploading segments... Aug 31 11:13:44.971078174 (45h5m41.651273743s) [upload=39634]: Got next segment. Inline: true Aug 31 11:13:44.971082704 (45h5m41.651278273s) [upload=39634]: Waiting for error group managing segments... Aug 31 11:13:44.971114825 (45h5m41.651310394s) [upload=39634]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 11:13:44.971118532 (45h5m41.651314101s) [upload=39634]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 31 11:13:44.971121528 (45h5m41.651317097s) [upload=39634]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 31 11:13:50.376332558 (45h5m47.056528127s) [upload=39634]: Done uploading segments... Aug 31 11:13:50.376399666 (45h5m47.056595235s) [upload=39634]: Upload finished. err: <nil> Duration:* 1.983707741s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [......................XX....................................] duration: 13.625711097s FAIL (2025-08-31 11:43:33 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 13.625736967s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.............XX.............................................] duration: 14.945335688s FAIL (2025-08-31 11:43:30 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Aug 31 11:11:03.184991323 (45h2m59.865186892s) [upload=39597]: Starting upload Aug 31 11:11:03.185066988 (45h2m59.865262567s) [upload=39597]: Done starting upload Aug 31 11:11:03.185180816 (45h2m59.865376395s) [upload=39597]: Uploading segments... Aug 31 11:11:03.185275988 (45h2m59.865471557s) [upload=39597]: Got next segment. Inline: false Aug 31 11:11:03.185312367 (45h2m59.865507936s) [upload=39597]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 11:11:03.185316826 (45h2m59.865512395s) [upload=39597]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 31 11:11:31.966176185 (45h3m28.646371754s) [upload=39597]: Next segment err: context deadline exceeded Aug 31 11:11:31.966314379 (45h3m28.646509938s) [upload=39597]: Done uploading segments... Aug 31 11:11:31.966328927 (45h3m28.646524497s) [upload=39597]: Upload finished. err: context deadline exceeded Duration: 14.945355938s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 2.55620491s FAIL (2025-08-31 11:43:16 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.556237241s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 5.794641489s FAIL (2025-08-31 11:43:12 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Aug 31 11:13:00.825343942 (45h4m57.505539511s) [upload=39627]: Starting upload Aug 31 11:13:00.825384589 (45h4m57.505580149s) [upload=39627]: Done starting upload Aug 31 11:13:00.825541009 (45h4m57.505736568s) [upload=39627]: Uploading segments... Aug 31 11:13:00.825579793 (45h4m57.505775362s) [upload=39627]: Got next segment. Inline: false Aug 31 11:13:00.825600693 (45h4m57.505796252s) [upload=39627]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 11:13:00.825604560 (45h4m57.505800129s) [upload=39627]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 31 11:13:01.708167688 (45h4m58.388363257s) [seg_pos={0 0}, upload=39627]: Begin upload segment... Aug 31 11:13:01.708224125 (45h4m58.388419695s) [seg_pos={0 0}, upload=39627]: Done begin upload segment. Aug 31 11:13:01.708248382 (45h4m58.388443961s) [noise=true , address=64.49.13.169:4709 , piece_id=5FUJXDUJJLTSAGJROSEZIBYUDPBF55XTNQLOD5WJHSJCVTRSO4UA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.708346640 (45h4m58.388542209s) [noise=true , address=104.36.82.35:4593 , piece_id=PRCATZUEA72YG2S4BTGEQ4ETUWVKMO3OCURBNLFAEGCSB5MDUKUQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.708955535 (45h4m58.389151114s) [noise=true , address=45.91.116.14:4195 , piece_id=UTIYQKVEKCDYGFQ6LX7PBJCGTA2QBMEN5Y7L5REIX4PUJ7WQSZ6Q, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709102236 (45h4m58.389297805s) [noise=true , address=104.36.82.15:4288 , piece_id=RHCPDOB7TEL65DYGJLJRJWC2SUHOV5FT5IZRERXUKHWZQVPGBHTA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709344399 (45h4m58.389539968s) [noise=true , address=64.49.13.155:4917 , piece_id=GSN5BNXY6VQJ63KASNN3MONOM6SV4BRM6WVIYLHGCGZNVK53HWXA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709551927 (45h4m58.389747506s) [noise=true , address=45.91.116.7:4034 , piece_id=LT7WEH3NX6T43P6WZFPREGKZ35R3UMEQYJBHAS4SW7N6CXHTUBOA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709590730 (45h4m58.3897863s) [noise=true , address=104.36.82.41:4775 , piece_id=7ESRGGJBNYHH4GH3PAACKOTPDKWV7ZRGQXYOUGVQJMYK2FQSNK4Q, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709842191 (45h4m58.390037771s) [noise=true , address=104.36.82.5:4853 , piece_id=O7HRHC2V53F22YV4FRE3F6U64PBVZK2AV2KYC4GNFEWHYZRJEOXA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710024290 (45h4m58.390219859s) [noise=true , address=77.90.31.21:4903 , piece_id=64466RMNHODOUS4YMYJBS46QNXS37PN3ZCMX56J6AWPF76BDJIFA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710071431 (45h4m58.390267s) [noise=true , address=104.36.82.48:4592 , piece_id=PACCJAF3QJXJSEUEJL7MRRLVR6ZRR4NLGDU42EAYK2VRTOBLAWGQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710298846 (45h4m58.390494415s) [noise=true , address=104.36.82.60:4360 , piece_id=JHBHFUQNTTMN6IVKTAVL4SUG27G2HHQOVY3VTFJDH4CZF7AEF56Q, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710486405 (45h4m58.390681984s) [noise=true , address=77.90.31.15:4714 , piece_id=EQ5HVZ67YWZTSI6K5FPNOAIIDBPV32KSCEZFP2MY45WALWMQNPDA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710556819 (45h4m58.390752388s) [noise=true , address=77.90.31.10:4544 , piece_id=YKJJXXMH3K2IJ2VGMRNCEEHUMOKMX3F4ZD72HPRQ6G7XNI5MPICA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710813581 (45h4m58.39100915s) [noise=true , address=77.90.31.11:4566 , piece_id=L5AZKS66QFUKXBCVO5NFR5MEDYTGIIHODHNBYXAFIH2YSE2TZR2A, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710945823 (45h4m58.391141402s) [noise=true , address=64.49.13.140:4508 , piece_id=O52JQJINRPKWLZI6NNPFJPZQYGDWHOMV3OHH6WYR2GFBKYRT7N3A, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.711040525 (45h4m58.391236094s) [noise=true , address=79.127.205.246:4263 , piece_id=2KPRXAVRMFEEMS32L3W2MSG7QJD5NLL2XVH5GOJIBDCVHUECVAEQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.711384572 (45h4m58.391580151s) [noise=true , address=104.36.82.53:4138 , piece_id=MFMGL7KSLNHYC4IQWD63O5KNIUOCDGYDKZUGGRTKAWMFTKZNFULQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.711796601 (45h4m58.39199218s) [noise=true , address=79.127.205.245:4251 , piece_id=G7VYPKSXFPKHVBAQDRKC7YCWWHZEQJUKWK4I3CAU4XMM2RRKM2YQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:02.809033683 (45h4m59.489229262s) [upload=39627]: Next returned nil segment Aug 31 11:13:02.809052139 (45h4m59.489247708s) [upload=39627]: Waiting for error group managing segments... Aug 31 11:13:03.110429755 (45h4m59.790625324s) [noise=true , address=79.127.205.245:4251 , piece_id=G7VYPKSXFPKHVBAQDRKC7YCWWHZEQJUKWK4I3CAU4XMM2RRKM2YQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.112669791 (45h4m59.79286538s) [noise=true , address=64.49.13.140:4508 , piece_id=O52JQJINRPKWLZI6NNPFJPZQYGDWHOMV3OHH6WYR2GFBKYRT7N3A, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.128781550 (45h4m59.808977119s) [noise=true , address=79.127.205.246:4263 , piece_id=2KPRXAVRMFEEMS32L3W2MSG7QJD5NLL2XVH5GOJIBDCVHUECVAEQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.142878824 (45h4m59.823074393s) [noise=true , address=64.49.13.155:4917 , piece_id=GSN5BNXY6VQJ63KASNN3MONOM6SV4BRM6WVIYLHGCGZNVK53HWXA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.202555682 (45h4m59.882751251s) [noise=true , address=64.49.13.169:4709 , piece_id=5FUJXDUJJLTSAGJROSEZIBYUDPBF55XTNQLOD5WJHSJCVTRSO4UA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.647619373 (45h5m0.327814942s) [noise=true , address=45.91.116.14:4195 , piece_id=UTIYQKVEKCDYGFQ6LX7PBJCGTA2QBMEN5Y7L5REIX4PUJ7WQSZ6Q, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.680334441 (45h5m0.36053001s) [noise=true , address=104.36.82.35:4593 , piece_id=PRCATZUEA72YG2S4BTGEQ4ETUWVKMO3OCURBNLFAEGCSB5MDUKUQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.737634971 (45h5m0.41783054s) [noise=true , address=45.91.116.7:4034 , piece_id=LT7WEH3NX6T43P6WZFPREGKZ35R3UMEQYJBHAS4SW7N6CXHTUBOA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.749306554 (45h5m0.429502124s) [noise=true , address=104.36.82.48:4592 , piece_id=PACCJAF3QJXJSEUEJL7MRRLVR6ZRR4NLGDU42EAYK2VRTOBLAWGQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.750058222 (45h5m0.430253791s) [noise=true , address=104.36.82.5:4853 , piece_id=O7HRHC2V53F22YV4FRE3F6U64PBVZK2AV2KYC4GNFEWHYZRJEOXA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.752613201 (45h5m0.43280877s) [noise=true , address=104.36.82.15:4288 , piece_id=RHCPDOB7TEL65DYGJLJRJWC2SUHOV5FT5IZRERXUKHWZQVPGBHTA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.783046874 (45h5m0.463242443s) [noise=true , address=77.90.31.11:4566 , piece_id=L5AZKS66QFUKXBCVO5NFR5MEDYTGIIHODHNBYXAFIH2YSE2TZR2A, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.783337791 (45h5m0.46353336s) [noise=true , address=77.90.31.15:4714 , piece_id=EQ5HVZ67YWZTSI6K5FPNOAIIDBPV32KSCEZFP2MY45WALWMQNPDA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.814218168 (45h5m0.494413727s) [noise=true , address=77.90.31.10:4544 , piece_id=YKJJXXMH3K2IJ2VGMRNCEEHUMOKMX3F4ZD72HPRQ6G7XNI5MPICA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.814246252 (45h5m0.494441811s) [seg_pos={0 0}, upload=39627]: Segment reached optimal threshold of 14 pieces. Aug 31 11:13:03.814359448 (45h5m0.494555017s) [noise=true , address=104.36.82.60:4360 , piece_id=JHBHFUQNTTMN6IVKTAVL4SUG27G2HHQOVY3VTFJDH4CZF7AEF56Q, seg_pos={0 0}, upload=39627]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T24rtYBJ47E6Ef1ZZKMWcpBrWBpCg5QV2ZHniCZZkzJF2yUNk): protocol: expected piece hash; context canceled; EOF Aug 31 11:13:03.814418081 (45h5m0.49461364s) [noise=true , address=104.36.82.53:4138 , piece_id=MFMGL7KSLNHYC4IQWD63O5KNIUOCDGYDKZUGGRTKAWMFTKZNFULQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YUGGJg6mWeQMmzSNWtLFWAaWwaKWfEf8wxXs1jwiZaA9nhsr3): protocol: expected piece hash; context canceled; EOF Aug 31 11:13:03.814483546 (45h5m0.494679115s) [noise=true , address=104.36.82.41:4775 , piece_id=7ESRGGJBNYHH4GH3PAACKOTPDKWV7ZRGQXYOUGVQJMYK2FQSNK4Q, seg_pos={0 0}, upload=39627]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:166yRbNnnDeZRifM5q7vUVLx7iV5cZ9GqQnmvD9AbUUJsaCjmj): protocol: expected piece hash; context canceled; EOF Aug 31 11:13:03.814510187 (45h5m0.494705746s) [noise=true , address=77.90.31.21:4903 , piece_id=64466RMNHODOUS4YMYJBS46QNXS37PN3ZCMX56J6AWPF76BDJIFA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZYWQ1a2sTKnFpF28iQVrem2s8nSpXkeJzZDaS7jvTZNANdfp): protocol: expected piece hash; context canceled; EOF Aug 31 11:13:03.814533913 (45h5m0.494729482s) [seg_pos={0 0}, upload=39627]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 31 11:13:03.814608635 (45h5m0.494804204s) [upload=39627]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 31 11:13:03.814612623 (45h5m0.494808193s) [upload=39627]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 31 11:13:06.785691131 (45h5m3.4658867s) [upload=39627]: Done uploading segments... Aug 31 11:13:06.785708434 (45h5m3.465904004s) [upload=39627]: Upload finished. err: <nil> Duration: 5.794664332s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 5.47509876s FAIL (2025-08-31 11:42:57 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 5.475126823s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 1.743063124s target: https://us1.storj.io/login FAIL (2025-08-31 11:42:55 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout Duration: 1.743093593s core satellite us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 8.416688982s FAIL (2025-08-31 11:42:54 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 8.416707026s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 2.614167562s FAIL (2025-08-31 11:42:49 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.61419778s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 2 out of 60 is failed (threshold=3) [................X....X......................................] duration: 2.050630443s FAIL (2025-08-31 11:42:40 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 31 11:13:44.970873573 (45h5m41.651069142s) [upload=39634]: Starting upload Aug 31 11:13:44.970949158 (45h5m41.651144727s) [upload=39634]: Done starting upload Aug 31 11:13:44.971018871 (45h5m41.65121444s) [upload=39634]: Uploading segments... Aug 31 11:13:44.971078174 (45h5m41.651273743s) [upload=39634]: Got next segment. Inline: true Aug 31 11:13:44.971082704 (45h5m41.651278273s) [upload=39634]: Waiting for error group managing segments... Aug 31 11:13:44.971114825 (45h5m41.651310394s) [upload=39634]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 11:13:44.971118532 (45h5m41.651314101s) [upload=39634]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 31 11:13:44.971121528 (45h5m41.651317097s) [upload=39634]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 31 11:13:50.376332558 (45h5m47.056528127s) [upload=39634]: Done uploading segments... Aug 31 11:13:50.376399666 (45h5m47.056595235s) [upload=39634]: Upload finished. err: <nil> Duration:* 2.050669558s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 6.313690107s FAIL (2025-08-31 11:42:31 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Aug 31 11:13:00.825343942 (45h4m57.505539511s) [upload=39627]: Starting upload Aug 31 11:13:00.825384589 (45h4m57.505580149s) [upload=39627]: Done starting upload Aug 31 11:13:00.825541009 (45h4m57.505736568s) [upload=39627]: Uploading segments... Aug 31 11:13:00.825579793 (45h4m57.505775362s) [upload=39627]: Got next segment. Inline: false Aug 31 11:13:00.825600693 (45h4m57.505796252s) [upload=39627]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 11:13:00.825604560 (45h4m57.505800129s) [upload=39627]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 31 11:13:01.708167688 (45h4m58.388363257s) [seg_pos={0 0}, upload=39627]: Begin upload segment... Aug 31 11:13:01.708224125 (45h4m58.388419695s) [seg_pos={0 0}, upload=39627]: Done begin upload segment. Aug 31 11:13:01.708248382 (45h4m58.388443961s) [noise=true , address=64.49.13.169:4709 , piece_id=5FUJXDUJJLTSAGJROSEZIBYUDPBF55XTNQLOD5WJHSJCVTRSO4UA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.708346640 (45h4m58.388542209s) [noise=true , address=104.36.82.35:4593 , piece_id=PRCATZUEA72YG2S4BTGEQ4ETUWVKMO3OCURBNLFAEGCSB5MDUKUQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.708955535 (45h4m58.389151114s) [noise=true , address=45.91.116.14:4195 , piece_id=UTIYQKVEKCDYGFQ6LX7PBJCGTA2QBMEN5Y7L5REIX4PUJ7WQSZ6Q, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709102236 (45h4m58.389297805s) [noise=true , address=104.36.82.15:4288 , piece_id=RHCPDOB7TEL65DYGJLJRJWC2SUHOV5FT5IZRERXUKHWZQVPGBHTA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709344399 (45h4m58.389539968s) [noise=true , address=64.49.13.155:4917 , piece_id=GSN5BNXY6VQJ63KASNN3MONOM6SV4BRM6WVIYLHGCGZNVK53HWXA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709551927 (45h4m58.389747506s) [noise=true , address=45.91.116.7:4034 , piece_id=LT7WEH3NX6T43P6WZFPREGKZ35R3UMEQYJBHAS4SW7N6CXHTUBOA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709590730 (45h4m58.3897863s) [noise=true , address=104.36.82.41:4775 , piece_id=7ESRGGJBNYHH4GH3PAACKOTPDKWV7ZRGQXYOUGVQJMYK2FQSNK4Q, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709842191 (45h4m58.390037771s) [noise=true , address=104.36.82.5:4853 , piece_id=O7HRHC2V53F22YV4FRE3F6U64PBVZK2AV2KYC4GNFEWHYZRJEOXA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710024290 (45h4m58.390219859s) [noise=true , address=77.90.31.21:4903 , piece_id=64466RMNHODOUS4YMYJBS46QNXS37PN3ZCMX56J6AWPF76BDJIFA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710071431 (45h4m58.390267s) [noise=true , address=104.36.82.48:4592 , piece_id=PACCJAF3QJXJSEUEJL7MRRLVR6ZRR4NLGDU42EAYK2VRTOBLAWGQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710298846 (45h4m58.390494415s) [noise=true , address=104.36.82.60:4360 , piece_id=JHBHFUQNTTMN6IVKTAVL4SUG27G2HHQOVY3VTFJDH4CZF7AEF56Q, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710486405 (45h4m58.390681984s) [noise=true , address=77.90.31.15:4714 , piece_id=EQ5HVZ67YWZTSI6K5FPNOAIIDBPV32KSCEZFP2MY45WALWMQNPDA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710556819 (45h4m58.390752388s) [noise=true , address=77.90.31.10:4544 , piece_id=YKJJXXMH3K2IJ2VGMRNCEEHUMOKMX3F4ZD72HPRQ6G7XNI5MPICA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710813581 (45h4m58.39100915s) [noise=true , address=77.90.31.11:4566 , piece_id=L5AZKS66QFUKXBCVO5NFR5MEDYTGIIHODHNBYXAFIH2YSE2TZR2A, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710945823 (45h4m58.391141402s) [noise=true , address=64.49.13.140:4508 , piece_id=O52JQJINRPKWLZI6NNPFJPZQYGDWHOMV3OHH6WYR2GFBKYRT7N3A, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.711040525 (45h4m58.391236094s) [noise=true , address=79.127.205.246:4263 , piece_id=2KPRXAVRMFEEMS32L3W2MSG7QJD5NLL2XVH5GOJIBDCVHUECVAEQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.711384572 (45h4m58.391580151s) [noise=true , address=104.36.82.53:4138 , piece_id=MFMGL7KSLNHYC4IQWD63O5KNIUOCDGYDKZUGGRTKAWMFTKZNFULQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.711796601 (45h4m58.39199218s) [noise=true , address=79.127.205.245:4251 , piece_id=G7VYPKSXFPKHVBAQDRKC7YCWWHZEQJUKWK4I3CAU4XMM2RRKM2YQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:02.809033683 (45h4m59.489229262s) [upload=39627]: Next returned nil segment Aug 31 11:13:02.809052139 (45h4m59.489247708s) [upload=39627]: Waiting for error group managing segments... Aug 31 11:13:03.110429755 (45h4m59.790625324s) [noise=true , address=79.127.205.245:4251 , piece_id=G7VYPKSXFPKHVBAQDRKC7YCWWHZEQJUKWK4I3CAU4XMM2RRKM2YQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.112669791 (45h4m59.79286538s) [noise=true , address=64.49.13.140:4508 , piece_id=O52JQJINRPKWLZI6NNPFJPZQYGDWHOMV3OHH6WYR2GFBKYRT7N3A, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.128781550 (45h4m59.808977119s) [noise=true , address=79.127.205.246:4263 , piece_id=2KPRXAVRMFEEMS32L3W2MSG7QJD5NLL2XVH5GOJIBDCVHUECVAEQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.142878824 (45h4m59.823074393s) [noise=true , address=64.49.13.155:4917 , piece_id=GSN5BNXY6VQJ63KASNN3MONOM6SV4BRM6WVIYLHGCGZNVK53HWXA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.202555682 (45h4m59.882751251s) [noise=true , address=64.49.13.169:4709 , piece_id=5FUJXDUJJLTSAGJROSEZIBYUDPBF55XTNQLOD5WJHSJCVTRSO4UA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.647619373 (45h5m0.327814942s) [noise=true , address=45.91.116.14:4195 , piece_id=UTIYQKVEKCDYGFQ6LX7PBJCGTA2QBMEN5Y7L5REIX4PUJ7WQSZ6Q, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.680334441 (45h5m0.36053001s) [noise=true , address=104.36.82.35:4593 , piece_id=PRCATZUEA72YG2S4BTGEQ4ETUWVKMO3OCURBNLFAEGCSB5MDUKUQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.737634971 (45h5m0.41783054s) [noise=true , address=45.91.116.7:4034 , piece_id=LT7WEH3NX6T43P6WZFPREGKZ35R3UMEQYJBHAS4SW7N6CXHTUBOA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.749306554 (45h5m0.429502124s) [noise=true , address=104.36.82.48:4592 , piece_id=PACCJAF3QJXJSEUEJL7MRRLVR6ZRR4NLGDU42EAYK2VRTOBLAWGQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.750058222 (45h5m0.430253791s) [noise=true , address=104.36.82.5:4853 , piece_id=O7HRHC2V53F22YV4FRE3F6U64PBVZK2AV2KYC4GNFEWHYZRJEOXA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.752613201 (45h5m0.43280877s) [noise=true , address=104.36.82.15:4288 , piece_id=RHCPDOB7TEL65DYGJLJRJWC2SUHOV5FT5IZRERXUKHWZQVPGBHTA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.783046874 (45h5m0.463242443s) [noise=true , address=77.90.31.11:4566 , piece_id=L5AZKS66QFUKXBCVO5NFR5MEDYTGIIHODHNBYXAFIH2YSE2TZR2A, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.783337791 (45h5m0.46353336s) [noise=true , address=77.90.31.15:4714 , piece_id=EQ5HVZ67YWZTSI6K5FPNOAIIDBPV32KSCEZFP2MY45WALWMQNPDA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.814218168 (45h5m0.494413727s) [noise=true , address=77.90.31.10:4544 , piece_id=YKJJXXMH3K2IJ2VGMRNCEEHUMOKMX3F4ZD72HPRQ6G7XNI5MPICA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.814246252 (45h5m0.494441811s) [seg_pos={0 0}, upload=39627]: Segment reached optimal threshold of 14 pieces. Aug 31 11:13:03.814359448 (45h5m0.494555017s) [noise=true , address=104.36.82.60:4360 , piece_id=JHBHFUQNTTMN6IVKTAVL4SUG27G2HHQOVY3VTFJDH4CZF7AEF56Q, seg_pos={0 0}, upload=39627]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T24rtYBJ47E6Ef1ZZKMWcpBrWBpCg5QV2ZHniCZZkzJF2yUNk): protocol: expected piece hash; context canceled; EOF Aug 31 11:13:03.814418081 (45h5m0.49461364s) [noise=true , address=104.36.82.53:4138 , piece_id=MFMGL7KSLNHYC4IQWD63O5KNIUOCDGYDKZUGGRTKAWMFTKZNFULQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YUGGJg6mWeQMmzSNWtLFWAaWwaKWfEf8wxXs1jwiZaA9nhsr3): protocol: expected piece hash; context canceled; EOF Aug 31 11:13:03.814483546 (45h5m0.494679115s) [noise=true , address=104.36.82.41:4775 , piece_id=7ESRGGJBNYHH4GH3PAACKOTPDKWV7ZRGQXYOUGVQJMYK2FQSNK4Q, seg_pos={0 0}, upload=39627]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:166yRbNnnDeZRifM5q7vUVLx7iV5cZ9GqQnmvD9AbUUJsaCjmj): protocol: expected piece hash; context canceled; EOF Aug 31 11:13:03.814510187 (45h5m0.494705746s) [noise=true , address=77.90.31.21:4903 , piece_id=64466RMNHODOUS4YMYJBS46QNXS37PN3ZCMX56J6AWPF76BDJIFA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZYWQ1a2sTKnFpF28iQVrem2s8nSpXkeJzZDaS7jvTZNANdfp): protocol: expected piece hash; context canceled; EOF Aug 31 11:13:03.814533913 (45h5m0.494729482s) [seg_pos={0 0}, upload=39627]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 31 11:13:03.814608635 (45h5m0.494804204s) [upload=39627]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 31 11:13:03.814612623 (45h5m0.494808193s) [upload=39627]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 31 11:13:06.785691131 (45h5m3.4658867s) [upload=39627]: Done uploading segments... Aug 31 11:13:06.785708434 (45h5m3.465904004s) [upload=39627]: Upload finished. err: <nil> Duration: 6.313714554s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 4.938773708s FAIL (2025-08-31 11:42:23 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 4.938805789s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..............XX............................................] duration: 6.895046304s FAIL (2025-08-31 11:42:17 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Aug 31 11:11:03.184991323 (45h2m59.865186892s) [upload=39597]: Starting upload Aug 31 11:11:03.185066988 (45h2m59.865262567s) [upload=39597]: Done starting upload Aug 31 11:11:03.185180816 (45h2m59.865376395s) [upload=39597]: Uploading segments... Aug 31 11:11:03.185275988 (45h2m59.865471557s) [upload=39597]: Got next segment. Inline: false Aug 31 11:11:03.185312367 (45h2m59.865507936s) [upload=39597]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 11:11:03.185316826 (45h2m59.865512395s) [upload=39597]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 31 11:11:31.966176185 (45h3m28.646371754s) [upload=39597]: Next segment err: context deadline exceeded Aug 31 11:11:31.966314379 (45h3m28.646509938s) [upload=39597]: Done uploading segments... Aug 31 11:11:31.966328927 (45h3m28.646524497s) [upload=39597]: Upload finished. err: context deadline exceeded Duration: 6.895077253s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......................XX...................................] duration: 6.586814773s FAIL (2025-08-31 11:42:17 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 6.586842967s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 1.953923942s FAIL (2025-08-31 11:42:11 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1.953952877s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 6.492972164s FAIL (2025-08-31 11:42:10 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Aug 31 11:13:00.825343942 (45h4m57.505539511s) [upload=39627]: Starting upload Aug 31 11:13:00.825384589 (45h4m57.505580149s) [upload=39627]: Done starting upload Aug 31 11:13:00.825541009 (45h4m57.505736568s) [upload=39627]: Uploading segments... Aug 31 11:13:00.825579793 (45h4m57.505775362s) [upload=39627]: Got next segment. Inline: false Aug 31 11:13:00.825600693 (45h4m57.505796252s) [upload=39627]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 11:13:00.825604560 (45h4m57.505800129s) [upload=39627]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 31 11:13:01.708167688 (45h4m58.388363257s) [seg_pos={0 0}, upload=39627]: Begin upload segment... Aug 31 11:13:01.708224125 (45h4m58.388419695s) [seg_pos={0 0}, upload=39627]: Done begin upload segment. Aug 31 11:13:01.708248382 (45h4m58.388443961s) [noise=true , address=64.49.13.169:4709 , piece_id=5FUJXDUJJLTSAGJROSEZIBYUDPBF55XTNQLOD5WJHSJCVTRSO4UA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.708346640 (45h4m58.388542209s) [noise=true , address=104.36.82.35:4593 , piece_id=PRCATZUEA72YG2S4BTGEQ4ETUWVKMO3OCURBNLFAEGCSB5MDUKUQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.708955535 (45h4m58.389151114s) [noise=true , address=45.91.116.14:4195 , piece_id=UTIYQKVEKCDYGFQ6LX7PBJCGTA2QBMEN5Y7L5REIX4PUJ7WQSZ6Q, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709102236 (45h4m58.389297805s) [noise=true , address=104.36.82.15:4288 , piece_id=RHCPDOB7TEL65DYGJLJRJWC2SUHOV5FT5IZRERXUKHWZQVPGBHTA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709344399 (45h4m58.389539968s) [noise=true , address=64.49.13.155:4917 , piece_id=GSN5BNXY6VQJ63KASNN3MONOM6SV4BRM6WVIYLHGCGZNVK53HWXA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709551927 (45h4m58.389747506s) [noise=true , address=45.91.116.7:4034 , piece_id=LT7WEH3NX6T43P6WZFPREGKZ35R3UMEQYJBHAS4SW7N6CXHTUBOA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709590730 (45h4m58.3897863s) [noise=true , address=104.36.82.41:4775 , piece_id=7ESRGGJBNYHH4GH3PAACKOTPDKWV7ZRGQXYOUGVQJMYK2FQSNK4Q, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709842191 (45h4m58.390037771s) [noise=true , address=104.36.82.5:4853 , piece_id=O7HRHC2V53F22YV4FRE3F6U64PBVZK2AV2KYC4GNFEWHYZRJEOXA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710024290 (45h4m58.390219859s) [noise=true , address=77.90.31.21:4903 , piece_id=64466RMNHODOUS4YMYJBS46QNXS37PN3ZCMX56J6AWPF76BDJIFA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710071431 (45h4m58.390267s) [noise=true , address=104.36.82.48:4592 , piece_id=PACCJAF3QJXJSEUEJL7MRRLVR6ZRR4NLGDU42EAYK2VRTOBLAWGQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710298846 (45h4m58.390494415s) [noise=true , address=104.36.82.60:4360 , piece_id=JHBHFUQNTTMN6IVKTAVL4SUG27G2HHQOVY3VTFJDH4CZF7AEF56Q, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710486405 (45h4m58.390681984s) [noise=true , address=77.90.31.15:4714 , piece_id=EQ5HVZ67YWZTSI6K5FPNOAIIDBPV32KSCEZFP2MY45WALWMQNPDA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710556819 (45h4m58.390752388s) [noise=true , address=77.90.31.10:4544 , piece_id=YKJJXXMH3K2IJ2VGMRNCEEHUMOKMX3F4ZD72HPRQ6G7XNI5MPICA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710813581 (45h4m58.39100915s) [noise=true , address=77.90.31.11:4566 , piece_id=L5AZKS66QFUKXBCVO5NFR5MEDYTGIIHODHNBYXAFIH2YSE2TZR2A, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710945823 (45h4m58.391141402s) [noise=true , address=64.49.13.140:4508 , piece_id=O52JQJINRPKWLZI6NNPFJPZQYGDWHOMV3OHH6WYR2GFBKYRT7N3A, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.711040525 (45h4m58.391236094s) [noise=true , address=79.127.205.246:4263 , piece_id=2KPRXAVRMFEEMS32L3W2MSG7QJD5NLL2XVH5GOJIBDCVHUECVAEQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.711384572 (45h4m58.391580151s) [noise=true , address=104.36.82.53:4138 , piece_id=MFMGL7KSLNHYC4IQWD63O5KNIUOCDGYDKZUGGRTKAWMFTKZNFULQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.711796601 (45h4m58.39199218s) [noise=true , address=79.127.205.245:4251 , piece_id=G7VYPKSXFPKHVBAQDRKC7YCWWHZEQJUKWK4I3CAU4XMM2RRKM2YQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:02.809033683 (45h4m59.489229262s) [upload=39627]: Next returned nil segment Aug 31 11:13:02.809052139 (45h4m59.489247708s) [upload=39627]: Waiting for error group managing segments... Aug 31 11:13:03.110429755 (45h4m59.790625324s) [noise=true , address=79.127.205.245:4251 , piece_id=G7VYPKSXFPKHVBAQDRKC7YCWWHZEQJUKWK4I3CAU4XMM2RRKM2YQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.112669791 (45h4m59.79286538s) [noise=true , address=64.49.13.140:4508 , piece_id=O52JQJINRPKWLZI6NNPFJPZQYGDWHOMV3OHH6WYR2GFBKYRT7N3A, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.128781550 (45h4m59.808977119s) [noise=true , address=79.127.205.246:4263 , piece_id=2KPRXAVRMFEEMS32L3W2MSG7QJD5NLL2XVH5GOJIBDCVHUECVAEQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.142878824 (45h4m59.823074393s) [noise=true , address=64.49.13.155:4917 , piece_id=GSN5BNXY6VQJ63KASNN3MONOM6SV4BRM6WVIYLHGCGZNVK53HWXA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.202555682 (45h4m59.882751251s) [noise=true , address=64.49.13.169:4709 , piece_id=5FUJXDUJJLTSAGJROSEZIBYUDPBF55XTNQLOD5WJHSJCVTRSO4UA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.647619373 (45h5m0.327814942s) [noise=true , address=45.91.116.14:4195 , piece_id=UTIYQKVEKCDYGFQ6LX7PBJCGTA2QBMEN5Y7L5REIX4PUJ7WQSZ6Q, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.680334441 (45h5m0.36053001s) [noise=true , address=104.36.82.35:4593 , piece_id=PRCATZUEA72YG2S4BTGEQ4ETUWVKMO3OCURBNLFAEGCSB5MDUKUQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.737634971 (45h5m0.41783054s) [noise=true , address=45.91.116.7:4034 , piece_id=LT7WEH3NX6T43P6WZFPREGKZ35R3UMEQYJBHAS4SW7N6CXHTUBOA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.749306554 (45h5m0.429502124s) [noise=true , address=104.36.82.48:4592 , piece_id=PACCJAF3QJXJSEUEJL7MRRLVR6ZRR4NLGDU42EAYK2VRTOBLAWGQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.750058222 (45h5m0.430253791s) [noise=true , address=104.36.82.5:4853 , piece_id=O7HRHC2V53F22YV4FRE3F6U64PBVZK2AV2KYC4GNFEWHYZRJEOXA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.752613201 (45h5m0.43280877s) [noise=true , address=104.36.82.15:4288 , piece_id=RHCPDOB7TEL65DYGJLJRJWC2SUHOV5FT5IZRERXUKHWZQVPGBHTA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.783046874 (45h5m0.463242443s) [noise=true , address=77.90.31.11:4566 , piece_id=L5AZKS66QFUKXBCVO5NFR5MEDYTGIIHODHNBYXAFIH2YSE2TZR2A, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.783337791 (45h5m0.46353336s) [noise=true , address=77.90.31.15:4714 , piece_id=EQ5HVZ67YWZTSI6K5FPNOAIIDBPV32KSCEZFP2MY45WALWMQNPDA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.814218168 (45h5m0.494413727s) [noise=true , address=77.90.31.10:4544 , piece_id=YKJJXXMH3K2IJ2VGMRNCEEHUMOKMX3F4ZD72HPRQ6G7XNI5MPICA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.814246252 (45h5m0.494441811s) [seg_pos={0 0}, upload=39627]: Segment reached optimal threshold of 14 pieces. Aug 31 11:13:03.814359448 (45h5m0.494555017s) [noise=true , address=104.36.82.60:4360 , piece_id=JHBHFUQNTTMN6IVKTAVL4SUG27G2HHQOVY3VTFJDH4CZF7AEF56Q, seg_pos={0 0}, upload=39627]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T24rtYBJ47E6Ef1ZZKMWcpBrWBpCg5QV2ZHniCZZkzJF2yUNk): protocol: expected piece hash; context canceled; EOF Aug 31 11:13:03.814418081 (45h5m0.49461364s) [noise=true , address=104.36.82.53:4138 , piece_id=MFMGL7KSLNHYC4IQWD63O5KNIUOCDGYDKZUGGRTKAWMFTKZNFULQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YUGGJg6mWeQMmzSNWtLFWAaWwaKWfEf8wxXs1jwiZaA9nhsr3): protocol: expected piece hash; context canceled; EOF Aug 31 11:13:03.814483546 (45h5m0.494679115s) [noise=true , address=104.36.82.41:4775 , piece_id=7ESRGGJBNYHH4GH3PAACKOTPDKWV7ZRGQXYOUGVQJMYK2FQSNK4Q, seg_pos={0 0}, upload=39627]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:166yRbNnnDeZRifM5q7vUVLx7iV5cZ9GqQnmvD9AbUUJsaCjmj): protocol: expected piece hash; context canceled; EOF Aug 31 11:13:03.814510187 (45h5m0.494705746s) [noise=true , address=77.90.31.21:4903 , piece_id=64466RMNHODOUS4YMYJBS46QNXS37PN3ZCMX56J6AWPF76BDJIFA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZYWQ1a2sTKnFpF28iQVrem2s8nSpXkeJzZDaS7jvTZNANdfp): protocol: expected piece hash; context canceled; EOF Aug 31 11:13:03.814533913 (45h5m0.494729482s) [seg_pos={0 0}, upload=39627]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 31 11:13:03.814608635 (45h5m0.494804204s) [upload=39627]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 31 11:13:03.814612623 (45h5m0.494808193s) [upload=39627]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 31 11:13:06.785691131 (45h5m3.4658867s) [upload=39627]: Done uploading segments... Aug 31 11:13:06.785708434 (45h5m3.465904004s) [upload=39627]: Upload finished. err: <nil> Duration: 6.493001782s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.................X....X.....................................] duration: 6.675064947s FAIL (2025-08-31 11:41:57 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 31 11:13:44.970873573 (45h5m41.651069142s) [upload=39634]: Starting upload Aug 31 11:13:44.970949158 (45h5m41.651144727s) [upload=39634]: Done starting upload Aug 31 11:13:44.971018871 (45h5m41.65121444s) [upload=39634]: Uploading segments... Aug 31 11:13:44.971078174 (45h5m41.651273743s) [upload=39634]: Got next segment. Inline: true Aug 31 11:13:44.971082704 (45h5m41.651278273s) [upload=39634]: Waiting for error group managing segments... Aug 31 11:13:44.971114825 (45h5m41.651310394s) [upload=39634]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 11:13:44.971118532 (45h5m41.651314101s) [upload=39634]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 31 11:13:44.971121528 (45h5m41.651317097s) [upload=39634]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 31 11:13:50.376332558 (45h5m47.056528127s) [upload=39634]: Done uploading segments... Aug 31 11:13:50.376399666 (45h5m47.056595235s) [upload=39634]: Upload finished. err: <nil> Duration:* 6.675088232s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...............XX...........................................] duration: 10.604628474s FAIL (2025-08-31 11:41:56 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Aug 31 11:11:03.184991323 (45h2m59.865186892s) [upload=39597]: Starting upload Aug 31 11:11:03.185066988 (45h2m59.865262567s) [upload=39597]: Done starting upload Aug 31 11:11:03.185180816 (45h2m59.865376395s) [upload=39597]: Uploading segments... Aug 31 11:11:03.185275988 (45h2m59.865471557s) [upload=39597]: Got next segment. Inline: false Aug 31 11:11:03.185312367 (45h2m59.865507936s) [upload=39597]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 11:11:03.185316826 (45h2m59.865512395s) [upload=39597]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 31 11:11:31.966176185 (45h3m28.646371754s) [upload=39597]: Next segment err: context deadline exceeded Aug 31 11:11:31.966314379 (45h3m28.646509938s) [upload=39597]: Done uploading segments... Aug 31 11:11:31.966328927 (45h3m28.646524497s) [upload=39597]: Upload finished. err: context deadline exceeded Duration: 10.604654834s core uplink us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 1.751969417s target: https://us1.storj.io/login FAIL (2025-08-31 11:41:51 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout Duration: 1.751990509s core satellite us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 9.233420429s FAIL (2025-08-31 11:41:45 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 9.233440808s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 13.056676988s FAIL (2025-08-31 11:41:44 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Aug 31 11:13:00.825343942 (45h4m57.505539511s) [upload=39627]: Starting upload Aug 31 11:13:00.825384589 (45h4m57.505580149s) [upload=39627]: Done starting upload Aug 31 11:13:00.825541009 (45h4m57.505736568s) [upload=39627]: Uploading segments... Aug 31 11:13:00.825579793 (45h4m57.505775362s) [upload=39627]: Got next segment. Inline: false Aug 31 11:13:00.825600693 (45h4m57.505796252s) [upload=39627]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 11:13:00.825604560 (45h4m57.505800129s) [upload=39627]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 31 11:13:01.708167688 (45h4m58.388363257s) [seg_pos={0 0}, upload=39627]: Begin upload segment... Aug 31 11:13:01.708224125 (45h4m58.388419695s) [seg_pos={0 0}, upload=39627]: Done begin upload segment. Aug 31 11:13:01.708248382 (45h4m58.388443961s) [noise=true , address=64.49.13.169:4709 , piece_id=5FUJXDUJJLTSAGJROSEZIBYUDPBF55XTNQLOD5WJHSJCVTRSO4UA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.708346640 (45h4m58.388542209s) [noise=true , address=104.36.82.35:4593 , piece_id=PRCATZUEA72YG2S4BTGEQ4ETUWVKMO3OCURBNLFAEGCSB5MDUKUQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.708955535 (45h4m58.389151114s) [noise=true , address=45.91.116.14:4195 , piece_id=UTIYQKVEKCDYGFQ6LX7PBJCGTA2QBMEN5Y7L5REIX4PUJ7WQSZ6Q, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709102236 (45h4m58.389297805s) [noise=true , address=104.36.82.15:4288 , piece_id=RHCPDOB7TEL65DYGJLJRJWC2SUHOV5FT5IZRERXUKHWZQVPGBHTA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709344399 (45h4m58.389539968s) [noise=true , address=64.49.13.155:4917 , piece_id=GSN5BNXY6VQJ63KASNN3MONOM6SV4BRM6WVIYLHGCGZNVK53HWXA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709551927 (45h4m58.389747506s) [noise=true , address=45.91.116.7:4034 , piece_id=LT7WEH3NX6T43P6WZFPREGKZ35R3UMEQYJBHAS4SW7N6CXHTUBOA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709590730 (45h4m58.3897863s) [noise=true , address=104.36.82.41:4775 , piece_id=7ESRGGJBNYHH4GH3PAACKOTPDKWV7ZRGQXYOUGVQJMYK2FQSNK4Q, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.709842191 (45h4m58.390037771s) [noise=true , address=104.36.82.5:4853 , piece_id=O7HRHC2V53F22YV4FRE3F6U64PBVZK2AV2KYC4GNFEWHYZRJEOXA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710024290 (45h4m58.390219859s) [noise=true , address=77.90.31.21:4903 , piece_id=64466RMNHODOUS4YMYJBS46QNXS37PN3ZCMX56J6AWPF76BDJIFA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710071431 (45h4m58.390267s) [noise=true , address=104.36.82.48:4592 , piece_id=PACCJAF3QJXJSEUEJL7MRRLVR6ZRR4NLGDU42EAYK2VRTOBLAWGQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710298846 (45h4m58.390494415s) [noise=true , address=104.36.82.60:4360 , piece_id=JHBHFUQNTTMN6IVKTAVL4SUG27G2HHQOVY3VTFJDH4CZF7AEF56Q, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710486405 (45h4m58.390681984s) [noise=true , address=77.90.31.15:4714 , piece_id=EQ5HVZ67YWZTSI6K5FPNOAIIDBPV32KSCEZFP2MY45WALWMQNPDA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710556819 (45h4m58.390752388s) [noise=true , address=77.90.31.10:4544 , piece_id=YKJJXXMH3K2IJ2VGMRNCEEHUMOKMX3F4ZD72HPRQ6G7XNI5MPICA, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710813581 (45h4m58.39100915s) [noise=true , address=77.90.31.11:4566 , piece_id=L5AZKS66QFUKXBCVO5NFR5MEDYTGIIHODHNBYXAFIH2YSE2TZR2A, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.710945823 (45h4m58.391141402s) [noise=true , address=64.49.13.140:4508 , piece_id=O52JQJINRPKWLZI6NNPFJPZQYGDWHOMV3OHH6WYR2GFBKYRT7N3A, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.711040525 (45h4m58.391236094s) [noise=true , address=79.127.205.246:4263 , piece_id=2KPRXAVRMFEEMS32L3W2MSG7QJD5NLL2XVH5GOJIBDCVHUECVAEQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.711384572 (45h4m58.391580151s) [noise=true , address=104.36.82.53:4138 , piece_id=MFMGL7KSLNHYC4IQWD63O5KNIUOCDGYDKZUGGRTKAWMFTKZNFULQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:01.711796601 (45h4m58.39199218s) [noise=true , address=79.127.205.245:4251 , piece_id=G7VYPKSXFPKHVBAQDRKC7YCWWHZEQJUKWK4I3CAU4XMM2RRKM2YQ, seg_pos={0 0}, upload=39627]: Uploading piece... Aug 31 11:13:02.809033683 (45h4m59.489229262s) [upload=39627]: Next returned nil segment Aug 31 11:13:02.809052139 (45h4m59.489247708s) [upload=39627]: Waiting for error group managing segments... Aug 31 11:13:03.110429755 (45h4m59.790625324s) [noise=true , address=79.127.205.245:4251 , piece_id=G7VYPKSXFPKHVBAQDRKC7YCWWHZEQJUKWK4I3CAU4XMM2RRKM2YQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.112669791 (45h4m59.79286538s) [noise=true , address=64.49.13.140:4508 , piece_id=O52JQJINRPKWLZI6NNPFJPZQYGDWHOMV3OHH6WYR2GFBKYRT7N3A, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.128781550 (45h4m59.808977119s) [noise=true , address=79.127.205.246:4263 , piece_id=2KPRXAVRMFEEMS32L3W2MSG7QJD5NLL2XVH5GOJIBDCVHUECVAEQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.142878824 (45h4m59.823074393s) [noise=true , address=64.49.13.155:4917 , piece_id=GSN5BNXY6VQJ63KASNN3MONOM6SV4BRM6WVIYLHGCGZNVK53HWXA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.202555682 (45h4m59.882751251s) [noise=true , address=64.49.13.169:4709 , piece_id=5FUJXDUJJLTSAGJROSEZIBYUDPBF55XTNQLOD5WJHSJCVTRSO4UA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.647619373 (45h5m0.327814942s) [noise=true , address=45.91.116.14:4195 , piece_id=UTIYQKVEKCDYGFQ6LX7PBJCGTA2QBMEN5Y7L5REIX4PUJ7WQSZ6Q, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.680334441 (45h5m0.36053001s) [noise=true , address=104.36.82.35:4593 , piece_id=PRCATZUEA72YG2S4BTGEQ4ETUWVKMO3OCURBNLFAEGCSB5MDUKUQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.737634971 (45h5m0.41783054s) [noise=true , address=45.91.116.7:4034 , piece_id=LT7WEH3NX6T43P6WZFPREGKZ35R3UMEQYJBHAS4SW7N6CXHTUBOA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.749306554 (45h5m0.429502124s) [noise=true , address=104.36.82.48:4592 , piece_id=PACCJAF3QJXJSEUEJL7MRRLVR6ZRR4NLGDU42EAYK2VRTOBLAWGQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.750058222 (45h5m0.430253791s) [noise=true , address=104.36.82.5:4853 , piece_id=O7HRHC2V53F22YV4FRE3F6U64PBVZK2AV2KYC4GNFEWHYZRJEOXA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.752613201 (45h5m0.43280877s) [noise=true , address=104.36.82.15:4288 , piece_id=RHCPDOB7TEL65DYGJLJRJWC2SUHOV5FT5IZRERXUKHWZQVPGBHTA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.783046874 (45h5m0.463242443s) [noise=true , address=77.90.31.11:4566 , piece_id=L5AZKS66QFUKXBCVO5NFR5MEDYTGIIHODHNBYXAFIH2YSE2TZR2A, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.783337791 (45h5m0.46353336s) [noise=true , address=77.90.31.15:4714 , piece_id=EQ5HVZ67YWZTSI6K5FPNOAIIDBPV32KSCEZFP2MY45WALWMQNPDA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.814218168 (45h5m0.494413727s) [noise=true , address=77.90.31.10:4544 , piece_id=YKJJXXMH3K2IJ2VGMRNCEEHUMOKMX3F4ZD72HPRQ6G7XNI5MPICA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: <nil> Aug 31 11:13:03.814246252 (45h5m0.494441811s) [seg_pos={0 0}, upload=39627]: Segment reached optimal threshold of 14 pieces. Aug 31 11:13:03.814359448 (45h5m0.494555017s) [noise=true , address=104.36.82.60:4360 , piece_id=JHBHFUQNTTMN6IVKTAVL4SUG27G2HHQOVY3VTFJDH4CZF7AEF56Q, seg_pos={0 0}, upload=39627]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T24rtYBJ47E6Ef1ZZKMWcpBrWBpCg5QV2ZHniCZZkzJF2yUNk): protocol: expected piece hash; context canceled; EOF Aug 31 11:13:03.814418081 (45h5m0.49461364s) [noise=true , address=104.36.82.53:4138 , piece_id=MFMGL7KSLNHYC4IQWD63O5KNIUOCDGYDKZUGGRTKAWMFTKZNFULQ, seg_pos={0 0}, upload=39627]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YUGGJg6mWeQMmzSNWtLFWAaWwaKWfEf8wxXs1jwiZaA9nhsr3): protocol: expected piece hash; context canceled; EOF Aug 31 11:13:03.814483546 (45h5m0.494679115s) [noise=true , address=104.36.82.41:4775 , piece_id=7ESRGGJBNYHH4GH3PAACKOTPDKWV7ZRGQXYOUGVQJMYK2FQSNK4Q, seg_pos={0 0}, upload=39627]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:166yRbNnnDeZRifM5q7vUVLx7iV5cZ9GqQnmvD9AbUUJsaCjmj): protocol: expected piece hash; context canceled; EOF Aug 31 11:13:03.814510187 (45h5m0.494705746s) [noise=true , address=77.90.31.21:4903 , piece_id=64466RMNHODOUS4YMYJBS46QNXS37PN3ZCMX56J6AWPF76BDJIFA, seg_pos={0 0}, upload=39627]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZYWQ1a2sTKnFpF28iQVrem2s8nSpXkeJzZDaS7jvTZNANdfp): protocol: expected piece hash; context canceled; EOF Aug 31 11:13:03.814533913 (45h5m0.494729482s) [seg_pos={0 0}, upload=39627]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 31 11:13:03.814608635 (45h5m0.494804204s) [upload=39627]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 31 11:13:03.814612623 (45h5m0.494808193s) [upload=39627]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 31 11:13:06.785691131 (45h5m3.4658867s) [upload=39627]: Done uploading segments... Aug 31 11:13:06.785708434 (45h5m3.465904004s) [upload=39627]: Upload finished. err: <nil> Duration: 13.056699811s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 1.988785897s FAIL (2025-08-31 11:41:21 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1.988826445s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 1.903282873s FAIL (2025-08-31 11:41:19 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 1.903310245s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [........................XX..................................] duration: 5.659872271s FAIL (2025-08-31 11:41:04 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 5.659896217s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 2 out of 60 is failed (threshold=3) [..................X....X....................................] duration: 1.925268912s FAIL (2025-08-31 11:40:58 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 31 11:13:44.970873573 (45h5m41.651069142s) [upload=39634]: Starting upload Aug 31 11:13:44.970949158 (45h5m41.651144727s) [upload=39634]: Done starting upload Aug 31 11:13:44.971018871 (45h5m41.65121444s) [upload=39634]: Uploading segments... Aug 31 11:13:44.971078174 (45h5m41.651273743s) [upload=39634]: Got next segment. Inline: true Aug 31 11:13:44.971082704 (45h5m41.651278273s) [upload=39634]: Waiting for error group managing segments... Aug 31 11:13:44.971114825 (45h5m41.651310394s) [upload=39634]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 11:13:44.971118532 (45h5m41.651314101s) [upload=39634]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 31 11:13:44.971121528 (45h5m41.651317097s) [upload=39634]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 31 11:13:50.376332558 (45h5m47.056528127s) [upload=39634]: Done uploading segments... Aug 31 11:13:50.376399666 (45h5m47.056595235s) [upload=39634]: Upload finished. err: <nil> Duration:* 1.925295022s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 12.238596323s FAIL (2025-08-31 11:40:55 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 12.238625939s core uplink us1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)