Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
6.928237498s
FAIL (2025-07-07 16:15:21 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed piece hash; context canceled; EOF
Jul 7 16:10:35.615412114 (343h0m10.386053449s) [noise=true , address=45.91.116.9:4262 , piece_id=OUDXQP247Y6NARLWHRRENVSU2IJSGEUF4XGPU4S2MTUVDE7ZLGKA, seg_pos={0 0}, upload=274352]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto): protocol: expected piece hash; context canceled; EOF
Jul 7 16:10:35.615420931 (343h0m10.386062266s) [seg_pos={0 0}, upload=274352]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 16:10:35.615484472 (343h0m10.386125807s) [upload=274352]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 16:10:35.615488280 (343h0m10.386129615s) [upload=274352]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 16:10:35.906954897 (343h0m10.677596232s) [upload=274352]: Done uploading segments...
Jul 7 16:10:35.906972671 (343h0m10.677614006s) [upload=274352]: Upload finished. err: <nil>
Jul 7 16:11:45.999839306 (343h1m20.770480631s) [upload=274371]: Starting upload
Jul 7 16:11:45.999947764 (343h1m20.770589109s) [upload=274371]: Done starting upload
Jul 7 16:11:46.000045640 (343h1m20.770686985s) [upload=274371]: Uploading segments...
Jul 7 16:11:46.000313703 (343h1m20.770955049s) [upload=274371]: Got next segment. Inline: false
Jul 7 16:11:46.000362497 (343h1m20.771003902s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 16:11:46.000370652 (343h1m20.771012038s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 16:11:46.233304657 (343h1m21.003945992s) [seg_pos={0 0}, upload=274371]: Begin upload segment...
Jul 7 16:11:46.233346277 (343h1m21.003987612s) [seg_pos={0 0}, upload=274371]: Done begin upload segment.
Jul 7 16:11:46.233366465 (343h1m21.0040078s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.233486575 (343h1m21.00412795s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.233717486 (343h1m21.004358821s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234000157 (343h1m21.004641482s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234236590 (343h1m21.004877925s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234257029 (343h1m21.004898364s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234522136 (343h1m21.005163471s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234551382 (343h1m21.005192717s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234845234 (343h1m21.005486569s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235011733 (343h1m21.005653058s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235220432 (343h1m21.005861767s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235283693 (343h1m21.005925028s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235499466 (343h1m21.006140801s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235689650 (343h1m21.006330995s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235705780 (343h1m21.006347105s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.236133539 (343h1m21.006774874s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:47.936497427 (343h1m22.707138762s) [upload=274371]: Next returned nil segment
Jul 7 16:11:47.936516484 (343h1m22.707157819s) [upload=274371]: Waiting for error group managing segments...
Jul 7 16:11:48.211479176 (343h1m22.982120511s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.211715508 (343h1m22.982356853s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.218504867 (343h1m22.989146203s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.230271649 (343h1m23.000912984s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.256583018 (343h1m23.027224353s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.257289389 (343h1m23.027930734s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.259657138 (343h1m23.030298474s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.259781777 (343h1m23.030423112s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.260572691 (343h1m23.031214026s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.265855147 (343h1m23.036496482s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.266546209 (343h1m23.037187544s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277352043 (343h1m23.047993388s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277897627 (343h1m23.048538962s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277914017 (343h1m23.048555352s) [seg_pos={0 0}, upload=274371]: Segment reached optimal threshold of 13 pieces.
Jul 7 16:11:48.278072831 (343h1m23.048714166s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278154107 (343h1m23.048795442s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278295267 (343h1m23.048936602s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278307922 (343h1m23.048949257s) [seg_pos={0 0}, upload=274371]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 16:11:48.278410327 (343h1m23.049051662s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 16:11:48.278415868 (343h1m23.049057203s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 16:11:48.561077279 (343h1m23.331718614s) [upload=274371]: Done uploading segments...
Jul 7 16:11:48.561099671 (343h1m23.331741007s) [upload=274371]: Upload finished. err: <nil>
Duration: 6.928259991s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
1.440647273s
FAIL (2025-07-07 16:15:20 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.440672773s
core
uplink
eu1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
14.426631ms target:
https://ap1.storj.io/login
FAIL (2025-07-07 16:14:51 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused
Duration: 14.454635ms
core
satellite
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
6.084900517s
FAIL (2025-07-07 16:14:39 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed piece hash; context canceled; EOF
Jul 7 16:10:35.615412114 (343h0m10.386053449s) [noise=true , address=45.91.116.9:4262 , piece_id=OUDXQP247Y6NARLWHRRENVSU2IJSGEUF4XGPU4S2MTUVDE7ZLGKA, seg_pos={0 0}, upload=274352]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto): protocol: expected piece hash; context canceled; EOF
Jul 7 16:10:35.615420931 (343h0m10.386062266s) [seg_pos={0 0}, upload=274352]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 16:10:35.615484472 (343h0m10.386125807s) [upload=274352]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 16:10:35.615488280 (343h0m10.386129615s) [upload=274352]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 16:10:35.906954897 (343h0m10.677596232s) [upload=274352]: Done uploading segments...
Jul 7 16:10:35.906972671 (343h0m10.677614006s) [upload=274352]: Upload finished. err: <nil>
Jul 7 16:11:45.999839306 (343h1m20.770480631s) [upload=274371]: Starting upload
Jul 7 16:11:45.999947764 (343h1m20.770589109s) [upload=274371]: Done starting upload
Jul 7 16:11:46.000045640 (343h1m20.770686985s) [upload=274371]: Uploading segments...
Jul 7 16:11:46.000313703 (343h1m20.770955049s) [upload=274371]: Got next segment. Inline: false
Jul 7 16:11:46.000362497 (343h1m20.771003902s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 16:11:46.000370652 (343h1m20.771012038s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 16:11:46.233304657 (343h1m21.003945992s) [seg_pos={0 0}, upload=274371]: Begin upload segment...
Jul 7 16:11:46.233346277 (343h1m21.003987612s) [seg_pos={0 0}, upload=274371]: Done begin upload segment.
Jul 7 16:11:46.233366465 (343h1m21.0040078s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.233486575 (343h1m21.00412795s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.233717486 (343h1m21.004358821s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234000157 (343h1m21.004641482s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234236590 (343h1m21.004877925s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234257029 (343h1m21.004898364s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234522136 (343h1m21.005163471s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234551382 (343h1m21.005192717s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234845234 (343h1m21.005486569s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235011733 (343h1m21.005653058s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235220432 (343h1m21.005861767s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235283693 (343h1m21.005925028s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235499466 (343h1m21.006140801s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235689650 (343h1m21.006330995s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235705780 (343h1m21.006347105s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.236133539 (343h1m21.006774874s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:47.936497427 (343h1m22.707138762s) [upload=274371]: Next returned nil segment
Jul 7 16:11:47.936516484 (343h1m22.707157819s) [upload=274371]: Waiting for error group managing segments...
Jul 7 16:11:48.211479176 (343h1m22.982120511s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.211715508 (343h1m22.982356853s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.218504867 (343h1m22.989146203s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.230271649 (343h1m23.000912984s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.256583018 (343h1m23.027224353s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.257289389 (343h1m23.027930734s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.259657138 (343h1m23.030298474s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.259781777 (343h1m23.030423112s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.260572691 (343h1m23.031214026s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.265855147 (343h1m23.036496482s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.266546209 (343h1m23.037187544s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277352043 (343h1m23.047993388s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277897627 (343h1m23.048538962s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277914017 (343h1m23.048555352s) [seg_pos={0 0}, upload=274371]: Segment reached optimal threshold of 13 pieces.
Jul 7 16:11:48.278072831 (343h1m23.048714166s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278154107 (343h1m23.048795442s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278295267 (343h1m23.048936602s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278307922 (343h1m23.048949257s) [seg_pos={0 0}, upload=274371]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 16:11:48.278410327 (343h1m23.049051662s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 16:11:48.278415868 (343h1m23.049057203s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 16:11:48.561077279 (343h1m23.331718614s) [upload=274371]: Done uploading segments...
Jul 7 16:11:48.561099671 (343h1m23.331741007s) [upload=274371]: Upload finished. err: <nil>
Duration: 6.084964449s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........................................................XX.] duration:
1.855753256s
FAIL (2025-07-07 16:14:35 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.855780638s
core
uplink
us1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
13.6525ms target:
https://ap1.storj.io/login
FAIL (2025-07-07 16:14:27 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused
Duration: 13.682947ms
core
satellite
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
1.410994175s
FAIL (2025-07-07 16:14:07 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.411020885s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
5.612883946s
FAIL (2025-07-07 16:14:06 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed piece hash; context canceled; EOF
Jul 7 16:10:35.615412114 (343h0m10.386053449s) [noise=true , address=45.91.116.9:4262 , piece_id=OUDXQP247Y6NARLWHRRENVSU2IJSGEUF4XGPU4S2MTUVDE7ZLGKA, seg_pos={0 0}, upload=274352]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto): protocol: expected piece hash; context canceled; EOF
Jul 7 16:10:35.615420931 (343h0m10.386062266s) [seg_pos={0 0}, upload=274352]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 16:10:35.615484472 (343h0m10.386125807s) [upload=274352]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 16:10:35.615488280 (343h0m10.386129615s) [upload=274352]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 16:10:35.906954897 (343h0m10.677596232s) [upload=274352]: Done uploading segments...
Jul 7 16:10:35.906972671 (343h0m10.677614006s) [upload=274352]: Upload finished. err: <nil>
Jul 7 16:11:45.999839306 (343h1m20.770480631s) [upload=274371]: Starting upload
Jul 7 16:11:45.999947764 (343h1m20.770589109s) [upload=274371]: Done starting upload
Jul 7 16:11:46.000045640 (343h1m20.770686985s) [upload=274371]: Uploading segments...
Jul 7 16:11:46.000313703 (343h1m20.770955049s) [upload=274371]: Got next segment. Inline: false
Jul 7 16:11:46.000362497 (343h1m20.771003902s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 16:11:46.000370652 (343h1m20.771012038s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 16:11:46.233304657 (343h1m21.003945992s) [seg_pos={0 0}, upload=274371]: Begin upload segment...
Jul 7 16:11:46.233346277 (343h1m21.003987612s) [seg_pos={0 0}, upload=274371]: Done begin upload segment.
Jul 7 16:11:46.233366465 (343h1m21.0040078s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.233486575 (343h1m21.00412795s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.233717486 (343h1m21.004358821s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234000157 (343h1m21.004641482s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234236590 (343h1m21.004877925s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234257029 (343h1m21.004898364s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234522136 (343h1m21.005163471s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234551382 (343h1m21.005192717s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234845234 (343h1m21.005486569s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235011733 (343h1m21.005653058s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235220432 (343h1m21.005861767s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235283693 (343h1m21.005925028s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235499466 (343h1m21.006140801s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235689650 (343h1m21.006330995s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235705780 (343h1m21.006347105s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.236133539 (343h1m21.006774874s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:47.936497427 (343h1m22.707138762s) [upload=274371]: Next returned nil segment
Jul 7 16:11:47.936516484 (343h1m22.707157819s) [upload=274371]: Waiting for error group managing segments...
Jul 7 16:11:48.211479176 (343h1m22.982120511s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.211715508 (343h1m22.982356853s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.218504867 (343h1m22.989146203s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.230271649 (343h1m23.000912984s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.256583018 (343h1m23.027224353s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.257289389 (343h1m23.027930734s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.259657138 (343h1m23.030298474s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.259781777 (343h1m23.030423112s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.260572691 (343h1m23.031214026s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.265855147 (343h1m23.036496482s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.266546209 (343h1m23.037187544s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277352043 (343h1m23.047993388s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277897627 (343h1m23.048538962s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277914017 (343h1m23.048555352s) [seg_pos={0 0}, upload=274371]: Segment reached optimal threshold of 13 pieces.
Jul 7 16:11:48.278072831 (343h1m23.048714166s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278154107 (343h1m23.048795442s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278295267 (343h1m23.048936602s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278307922 (343h1m23.048949257s) [seg_pos={0 0}, upload=274371]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 16:11:48.278410327 (343h1m23.049051662s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 16:11:48.278415868 (343h1m23.049057203s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 16:11:48.561077279 (343h1m23.331718614s) [upload=274371]: Done uploading segments...
Jul 7 16:11:48.561099671 (343h1m23.331741007s) [upload=274371]: Upload finished. err: <nil>
Duration: 5.612935914s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........................................................XX] duration:
30.002034456s
FAIL (2025-07-07 16:13:49 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 30.002060043s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
5.63656474s
FAIL (2025-07-07 16:13:47 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed piece hash; context canceled; EOF
Jul 7 16:10:35.615412114 (343h0m10.386053449s) [noise=true , address=45.91.116.9:4262 , piece_id=OUDXQP247Y6NARLWHRRENVSU2IJSGEUF4XGPU4S2MTUVDE7ZLGKA, seg_pos={0 0}, upload=274352]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto): protocol: expected piece hash; context canceled; EOF
Jul 7 16:10:35.615420931 (343h0m10.386062266s) [seg_pos={0 0}, upload=274352]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 16:10:35.615484472 (343h0m10.386125807s) [upload=274352]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 16:10:35.615488280 (343h0m10.386129615s) [upload=274352]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 16:10:35.906954897 (343h0m10.677596232s) [upload=274352]: Done uploading segments...
Jul 7 16:10:35.906972671 (343h0m10.677614006s) [upload=274352]: Upload finished. err: <nil>
Jul 7 16:11:45.999839306 (343h1m20.770480631s) [upload=274371]: Starting upload
Jul 7 16:11:45.999947764 (343h1m20.770589109s) [upload=274371]: Done starting upload
Jul 7 16:11:46.000045640 (343h1m20.770686985s) [upload=274371]: Uploading segments...
Jul 7 16:11:46.000313703 (343h1m20.770955049s) [upload=274371]: Got next segment. Inline: false
Jul 7 16:11:46.000362497 (343h1m20.771003902s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 16:11:46.000370652 (343h1m20.771012038s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 16:11:46.233304657 (343h1m21.003945992s) [seg_pos={0 0}, upload=274371]: Begin upload segment...
Jul 7 16:11:46.233346277 (343h1m21.003987612s) [seg_pos={0 0}, upload=274371]: Done begin upload segment.
Jul 7 16:11:46.233366465 (343h1m21.0040078s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.233486575 (343h1m21.00412795s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.233717486 (343h1m21.004358821s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234000157 (343h1m21.004641482s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234236590 (343h1m21.004877925s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234257029 (343h1m21.004898364s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234522136 (343h1m21.005163471s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234551382 (343h1m21.005192717s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234845234 (343h1m21.005486569s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235011733 (343h1m21.005653058s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235220432 (343h1m21.005861767s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235283693 (343h1m21.005925028s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235499466 (343h1m21.006140801s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235689650 (343h1m21.006330995s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235705780 (343h1m21.006347105s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.236133539 (343h1m21.006774874s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:47.936497427 (343h1m22.707138762s) [upload=274371]: Next returned nil segment
Jul 7 16:11:47.936516484 (343h1m22.707157819s) [upload=274371]: Waiting for error group managing segments...
Jul 7 16:11:48.211479176 (343h1m22.982120511s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.211715508 (343h1m22.982356853s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.218504867 (343h1m22.989146203s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.230271649 (343h1m23.000912984s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.256583018 (343h1m23.027224353s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.257289389 (343h1m23.027930734s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.259657138 (343h1m23.030298474s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.259781777 (343h1m23.030423112s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.260572691 (343h1m23.031214026s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.265855147 (343h1m23.036496482s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.266546209 (343h1m23.037187544s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277352043 (343h1m23.047993388s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277897627 (343h1m23.048538962s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277914017 (343h1m23.048555352s) [seg_pos={0 0}, upload=274371]: Segment reached optimal threshold of 13 pieces.
Jul 7 16:11:48.278072831 (343h1m23.048714166s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278154107 (343h1m23.048795442s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278295267 (343h1m23.048936602s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278307922 (343h1m23.048949257s) [seg_pos={0 0}, upload=274371]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 16:11:48.278410327 (343h1m23.049051662s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 16:11:48.278415868 (343h1m23.049057203s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 16:11:48.561077279 (343h1m23.331718614s) [upload=274371]: Done uploading segments...
Jul 7 16:11:48.561099671 (343h1m23.331741007s) [upload=274371]: Upload finished. err: <nil>
Duration: 5.636607693s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
12.362012ms target:
https://ap1.storj.io/login
FAIL (2025-07-07 16:13:29 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused
Duration: 12.385716ms
core
satellite
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
5.645002354s
FAIL (2025-07-07 16:13:21 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed piece hash; context canceled; EOF
Jul 7 16:10:35.615412114 (343h0m10.386053449s) [noise=true , address=45.91.116.9:4262 , piece_id=OUDXQP247Y6NARLWHRRENVSU2IJSGEUF4XGPU4S2MTUVDE7ZLGKA, seg_pos={0 0}, upload=274352]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto): protocol: expected piece hash; context canceled; EOF
Jul 7 16:10:35.615420931 (343h0m10.386062266s) [seg_pos={0 0}, upload=274352]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 16:10:35.615484472 (343h0m10.386125807s) [upload=274352]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 16:10:35.615488280 (343h0m10.386129615s) [upload=274352]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 16:10:35.906954897 (343h0m10.677596232s) [upload=274352]: Done uploading segments...
Jul 7 16:10:35.906972671 (343h0m10.677614006s) [upload=274352]: Upload finished. err: <nil>
Jul 7 16:11:45.999839306 (343h1m20.770480631s) [upload=274371]: Starting upload
Jul 7 16:11:45.999947764 (343h1m20.770589109s) [upload=274371]: Done starting upload
Jul 7 16:11:46.000045640 (343h1m20.770686985s) [upload=274371]: Uploading segments...
Jul 7 16:11:46.000313703 (343h1m20.770955049s) [upload=274371]: Got next segment. Inline: false
Jul 7 16:11:46.000362497 (343h1m20.771003902s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 16:11:46.000370652 (343h1m20.771012038s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 16:11:46.233304657 (343h1m21.003945992s) [seg_pos={0 0}, upload=274371]: Begin upload segment...
Jul 7 16:11:46.233346277 (343h1m21.003987612s) [seg_pos={0 0}, upload=274371]: Done begin upload segment.
Jul 7 16:11:46.233366465 (343h1m21.0040078s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.233486575 (343h1m21.00412795s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.233717486 (343h1m21.004358821s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234000157 (343h1m21.004641482s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234236590 (343h1m21.004877925s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234257029 (343h1m21.004898364s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234522136 (343h1m21.005163471s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234551382 (343h1m21.005192717s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234845234 (343h1m21.005486569s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235011733 (343h1m21.005653058s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235220432 (343h1m21.005861767s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235283693 (343h1m21.005925028s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235499466 (343h1m21.006140801s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235689650 (343h1m21.006330995s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235705780 (343h1m21.006347105s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.236133539 (343h1m21.006774874s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:47.936497427 (343h1m22.707138762s) [upload=274371]: Next returned nil segment
Jul 7 16:11:47.936516484 (343h1m22.707157819s) [upload=274371]: Waiting for error group managing segments...
Jul 7 16:11:48.211479176 (343h1m22.982120511s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.211715508 (343h1m22.982356853s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.218504867 (343h1m22.989146203s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.230271649 (343h1m23.000912984s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.256583018 (343h1m23.027224353s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.257289389 (343h1m23.027930734s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.259657138 (343h1m23.030298474s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.259781777 (343h1m23.030423112s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.260572691 (343h1m23.031214026s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.265855147 (343h1m23.036496482s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.266546209 (343h1m23.037187544s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277352043 (343h1m23.047993388s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277897627 (343h1m23.048538962s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277914017 (343h1m23.048555352s) [seg_pos={0 0}, upload=274371]: Segment reached optimal threshold of 13 pieces.
Jul 7 16:11:48.278072831 (343h1m23.048714166s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278154107 (343h1m23.048795442s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278295267 (343h1m23.048936602s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278307922 (343h1m23.048949257s) [seg_pos={0 0}, upload=274371]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 16:11:48.278410327 (343h1m23.049051662s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 16:11:48.278415868 (343h1m23.049057203s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 16:11:48.561077279 (343h1m23.331718614s) [upload=274371]: Done uploading segments...
Jul 7 16:11:48.561099671 (343h1m23.331741007s) [upload=274371]: Upload finished. err: <nil>
Duration: 5.645037462s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
1.452686728s
FAIL (2025-07-07 16:13:17 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.452731814s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.001343868s
FAIL (2025-07-07 16:12:59 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 30.001366432s
core
uplink
us1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
12.915569ms target:
https://ap1.storj.io/login
FAIL (2025-07-07 16:12:58 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused
Duration: 12.938524ms
core
satellite
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.000509664s
FAIL (2025-07-07 16:12:42 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed piece hash; context canceled; EOF
Jul 7 16:10:35.615412114 (343h0m10.386053449s) [noise=true , address=45.91.116.9:4262 , piece_id=OUDXQP247Y6NARLWHRRENVSU2IJSGEUF4XGPU4S2MTUVDE7ZLGKA, seg_pos={0 0}, upload=274352]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto): protocol: expected piece hash; context canceled; EOF
Jul 7 16:10:35.615420931 (343h0m10.386062266s) [seg_pos={0 0}, upload=274352]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 16:10:35.615484472 (343h0m10.386125807s) [upload=274352]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 16:10:35.615488280 (343h0m10.386129615s) [upload=274352]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 16:10:35.906954897 (343h0m10.677596232s) [upload=274352]: Done uploading segments...
Jul 7 16:10:35.906972671 (343h0m10.677614006s) [upload=274352]: Upload finished. err: <nil>
Jul 7 16:11:45.999839306 (343h1m20.770480631s) [upload=274371]: Starting upload
Jul 7 16:11:45.999947764 (343h1m20.770589109s) [upload=274371]: Done starting upload
Jul 7 16:11:46.000045640 (343h1m20.770686985s) [upload=274371]: Uploading segments...
Jul 7 16:11:46.000313703 (343h1m20.770955049s) [upload=274371]: Got next segment. Inline: false
Jul 7 16:11:46.000362497 (343h1m20.771003902s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 16:11:46.000370652 (343h1m20.771012038s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 16:11:46.233304657 (343h1m21.003945992s) [seg_pos={0 0}, upload=274371]: Begin upload segment...
Jul 7 16:11:46.233346277 (343h1m21.003987612s) [seg_pos={0 0}, upload=274371]: Done begin upload segment.
Jul 7 16:11:46.233366465 (343h1m21.0040078s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.233486575 (343h1m21.00412795s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.233717486 (343h1m21.004358821s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234000157 (343h1m21.004641482s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234236590 (343h1m21.004877925s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234257029 (343h1m21.004898364s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234522136 (343h1m21.005163471s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234551382 (343h1m21.005192717s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234845234 (343h1m21.005486569s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235011733 (343h1m21.005653058s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235220432 (343h1m21.005861767s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235283693 (343h1m21.005925028s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235499466 (343h1m21.006140801s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235689650 (343h1m21.006330995s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235705780 (343h1m21.006347105s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.236133539 (343h1m21.006774874s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:47.936497427 (343h1m22.707138762s) [upload=274371]: Next returned nil segment
Jul 7 16:11:47.936516484 (343h1m22.707157819s) [upload=274371]: Waiting for error group managing segments...
Jul 7 16:11:48.211479176 (343h1m22.982120511s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.211715508 (343h1m22.982356853s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.218504867 (343h1m22.989146203s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.230271649 (343h1m23.000912984s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.256583018 (343h1m23.027224353s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.257289389 (343h1m23.027930734s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.259657138 (343h1m23.030298474s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.259781777 (343h1m23.030423112s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.260572691 (343h1m23.031214026s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.265855147 (343h1m23.036496482s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.266546209 (343h1m23.037187544s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277352043 (343h1m23.047993388s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277897627 (343h1m23.048538962s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277914017 (343h1m23.048555352s) [seg_pos={0 0}, upload=274371]: Segment reached optimal threshold of 13 pieces.
Jul 7 16:11:48.278072831 (343h1m23.048714166s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278154107 (343h1m23.048795442s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278295267 (343h1m23.048936602s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278307922 (343h1m23.048949257s) [seg_pos={0 0}, upload=274371]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 16:11:48.278410327 (343h1m23.049051662s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 16:11:48.278415868 (343h1m23.049057203s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 16:11:48.561077279 (343h1m23.331718614s) [upload=274371]: Done uploading segments...
Jul 7 16:11:48.561099671 (343h1m23.331741007s) [upload=274371]: Upload finished. err: <nil>
Duration: 30.000531245s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
19.719018ms target:
https://ap1.storj.io/login
FAIL (2025-07-07 16:12:30 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused
Duration: 19.744525ms
core
satellite
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
1.426546288s
FAIL (2025-07-07 16:12:14 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.426573219s
core
uplink
eu1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
11.212892ms target:
https://ap1.storj.io/login
FAIL (2025-07-07 16:12:06 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused
Duration: 11.253891ms
core
satellite
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
1.411690073s
FAIL (2025-07-07 16:11:58 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.411712627s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
1.432864555s
FAIL (2025-07-07 16:11:39 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.432902378s
core
uplink
eu1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
13.082839ms target:
https://ap1.storj.io/login
FAIL (2025-07-07 16:11:31 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused
Duration: 13.103428ms
core
satellite
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
1.410189344s
FAIL (2025-07-07 16:11:21 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.410213991s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
1.418821969s
FAIL (2025-07-07 16:10:53 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.418852307s
core
uplink
eu1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
11.733117ms target:
https://ap1.storj.io/login
FAIL (2025-07-07 16:10:27 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused
Duration: 11.751924ms
core
satellite
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
1.464766068s
FAIL (2025-07-07 16:10:09 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.464793551s
core
uplink
eu1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
12.485678ms target:
https://ap1.storj.io/login
FAIL (2025-07-07 16:09:18 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused
Duration: 12.512308ms
core
satellite
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
1.908650109s
FAIL (2025-07-07 16:08:56 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.908680796s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
1.815212333s
FAIL (2025-07-07 16:08:34 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.815249555s
core
uplink
eu1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
11.841936ms target:
https://ap1.storj.io/login
FAIL (2025-07-07 16:08:07 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused
Duration: 11.862826ms
core
satellite
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
1.458141916s
FAIL (2025-07-07 16:07:26 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.458168296s
core
uplink
eu1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
13.795604ms target:
https://ap1.storj.io/login
FAIL (2025-07-07 16:07:12 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused
Duration: 13.822184ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
11.773896ms target:
https://ap1.storj.io/login
FAIL (2025-07-07 16:06:51 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused
Duration: 11.810035ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
12.606839ms target:
https://ap1.storj.io/login
FAIL (2025-07-07 16:06:33 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused
Duration: 12.633861ms
core
satellite
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
1.453875772s
FAIL (2025-07-07 16:06:28 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.453904517s
core
uplink
eu1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
11.405771ms target:
https://ap1.storj.io/login
FAIL (2025-07-07 16:05:46 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused
Duration: 11.429146ms
core
satellite
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
1.460986057s
FAIL (2025-07-07 16:05:43 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.461036173s
core
uplink
eu1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
10.588136ms target:
https://ap1.storj.io/login
FAIL (2025-07-07 16:05:15 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused
Duration: 10.625839ms
core
satellite
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
1.415357749s
FAIL (2025-07-07 16:04:47 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.415370464s
core
uplink
eu1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
13.290157ms target:
https://ap1.storj.io/login
FAIL (2025-07-07 16:04:22 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused
Duration: 13.312188ms
core
satellite
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
1.566594194s
FAIL (2025-07-07 16:04:21 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.566616876s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
1.484701108s
FAIL (2025-07-07 16:03:29 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.484731504s
core
uplink
eu1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
11.034782ms target:
https://ap1.storj.io/login
FAIL (2025-07-07 16:03:21 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused
Duration: 11.065711ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
11.647454ms target:
https://ap1.storj.io/login
FAIL (2025-07-07 16:02:59 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused
Duration: 11.705875ms
core
satellite
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
1.644610071s
FAIL (2025-07-07 16:02:41 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.644636372s
core
uplink
eu1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
13.889563ms target:
https://ap1.storj.io/login
FAIL (2025-07-07 16:01:56 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused
Duration: 13.907578ms
core
satellite
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
1.43127555s
FAIL (2025-07-07 16:01:28 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.431313663s
core
uplink
eu1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
18.247812ms target:
https://ap1.storj.io/login
FAIL (2025-07-07 16:01:11 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused
Duration: 18.274723ms
core
satellite
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
1.436137099s
FAIL (2025-07-07 16:00:45 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.436166445s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
1.524811432s
FAIL (2025-07-07 16:00:09 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.524843753s
core
uplink
eu1
|