Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
10.69918ms target:
https://ap1.storj.io/login
FAIL (2025-07-07 16:24:42 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused
Duration: 10.727694ms
core
satellite
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
5.817085875s
FAIL (2025-07-07 16:24:03 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed piece hash; context canceled; EOF
Jul 7 16:10:35.615412114 (343h0m10.386053449s) [noise=true , address=45.91.116.9:4262 , piece_id=OUDXQP247Y6NARLWHRRENVSU2IJSGEUF4XGPU4S2MTUVDE7ZLGKA, seg_pos={0 0}, upload=274352]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto): protocol: expected piece hash; context canceled; EOF
Jul 7 16:10:35.615420931 (343h0m10.386062266s) [seg_pos={0 0}, upload=274352]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 16:10:35.615484472 (343h0m10.386125807s) [upload=274352]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 16:10:35.615488280 (343h0m10.386129615s) [upload=274352]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 16:10:35.906954897 (343h0m10.677596232s) [upload=274352]: Done uploading segments...
Jul 7 16:10:35.906972671 (343h0m10.677614006s) [upload=274352]: Upload finished. err: <nil>
Jul 7 16:11:45.999839306 (343h1m20.770480631s) [upload=274371]: Starting upload
Jul 7 16:11:45.999947764 (343h1m20.770589109s) [upload=274371]: Done starting upload
Jul 7 16:11:46.000045640 (343h1m20.770686985s) [upload=274371]: Uploading segments...
Jul 7 16:11:46.000313703 (343h1m20.770955049s) [upload=274371]: Got next segment. Inline: false
Jul 7 16:11:46.000362497 (343h1m20.771003902s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 16:11:46.000370652 (343h1m20.771012038s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 16:11:46.233304657 (343h1m21.003945992s) [seg_pos={0 0}, upload=274371]: Begin upload segment...
Jul 7 16:11:46.233346277 (343h1m21.003987612s) [seg_pos={0 0}, upload=274371]: Done begin upload segment.
Jul 7 16:11:46.233366465 (343h1m21.0040078s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.233486575 (343h1m21.00412795s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.233717486 (343h1m21.004358821s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234000157 (343h1m21.004641482s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234236590 (343h1m21.004877925s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234257029 (343h1m21.004898364s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234522136 (343h1m21.005163471s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234551382 (343h1m21.005192717s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234845234 (343h1m21.005486569s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235011733 (343h1m21.005653058s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235220432 (343h1m21.005861767s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235283693 (343h1m21.005925028s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235499466 (343h1m21.006140801s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235689650 (343h1m21.006330995s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235705780 (343h1m21.006347105s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.236133539 (343h1m21.006774874s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:47.936497427 (343h1m22.707138762s) [upload=274371]: Next returned nil segment
Jul 7 16:11:47.936516484 (343h1m22.707157819s) [upload=274371]: Waiting for error group managing segments...
Jul 7 16:11:48.211479176 (343h1m22.982120511s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.211715508 (343h1m22.982356853s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.218504867 (343h1m22.989146203s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.230271649 (343h1m23.000912984s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.256583018 (343h1m23.027224353s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.257289389 (343h1m23.027930734s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.259657138 (343h1m23.030298474s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.259781777 (343h1m23.030423112s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.260572691 (343h1m23.031214026s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.265855147 (343h1m23.036496482s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.266546209 (343h1m23.037187544s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277352043 (343h1m23.047993388s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277897627 (343h1m23.048538962s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277914017 (343h1m23.048555352s) [seg_pos={0 0}, upload=274371]: Segment reached optimal threshold of 13 pieces.
Jul 7 16:11:48.278072831 (343h1m23.048714166s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278154107 (343h1m23.048795442s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278295267 (343h1m23.048936602s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278307922 (343h1m23.048949257s) [seg_pos={0 0}, upload=274371]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 16:11:48.278410327 (343h1m23.049051662s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 16:11:48.278415868 (343h1m23.049057203s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 16:11:48.561077279 (343h1m23.331718614s) [upload=274371]: Done uploading segments...
Jul 7 16:11:48.561099671 (343h1m23.331741007s) [upload=274371]: Upload finished. err: <nil>
Duration: 5.817165267s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [............................................XX..............] duration:
1.870909628s
FAIL (2025-07-07 16:24:03 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.870943043s
core
uplink
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
1.903611323s
FAIL (2025-07-07 16:24:01 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.903637312s
core
uplink
eu1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
11.952828ms target:
https://ap1.storj.io/login
FAIL (2025-07-07 16:23:59 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused
Duration: 11.980932ms
core
satellite
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
1.892176426s
FAIL (2025-07-07 16:23:42 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.892202225s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
5.77016049s
FAIL (2025-07-07 16:23:28 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed piece hash; context canceled; EOF
Jul 7 16:10:35.615412114 (343h0m10.386053449s) [noise=true , address=45.91.116.9:4262 , piece_id=OUDXQP247Y6NARLWHRRENVSU2IJSGEUF4XGPU4S2MTUVDE7ZLGKA, seg_pos={0 0}, upload=274352]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto): protocol: expected piece hash; context canceled; EOF
Jul 7 16:10:35.615420931 (343h0m10.386062266s) [seg_pos={0 0}, upload=274352]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 16:10:35.615484472 (343h0m10.386125807s) [upload=274352]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 16:10:35.615488280 (343h0m10.386129615s) [upload=274352]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 16:10:35.906954897 (343h0m10.677596232s) [upload=274352]: Done uploading segments...
Jul 7 16:10:35.906972671 (343h0m10.677614006s) [upload=274352]: Upload finished. err: <nil>
Jul 7 16:11:45.999839306 (343h1m20.770480631s) [upload=274371]: Starting upload
Jul 7 16:11:45.999947764 (343h1m20.770589109s) [upload=274371]: Done starting upload
Jul 7 16:11:46.000045640 (343h1m20.770686985s) [upload=274371]: Uploading segments...
Jul 7 16:11:46.000313703 (343h1m20.770955049s) [upload=274371]: Got next segment. Inline: false
Jul 7 16:11:46.000362497 (343h1m20.771003902s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 16:11:46.000370652 (343h1m20.771012038s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 16:11:46.233304657 (343h1m21.003945992s) [seg_pos={0 0}, upload=274371]: Begin upload segment...
Jul 7 16:11:46.233346277 (343h1m21.003987612s) [seg_pos={0 0}, upload=274371]: Done begin upload segment.
Jul 7 16:11:46.233366465 (343h1m21.0040078s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.233486575 (343h1m21.00412795s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.233717486 (343h1m21.004358821s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234000157 (343h1m21.004641482s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234236590 (343h1m21.004877925s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234257029 (343h1m21.004898364s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234522136 (343h1m21.005163471s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234551382 (343h1m21.005192717s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234845234 (343h1m21.005486569s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235011733 (343h1m21.005653058s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235220432 (343h1m21.005861767s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235283693 (343h1m21.005925028s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235499466 (343h1m21.006140801s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235689650 (343h1m21.006330995s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235705780 (343h1m21.006347105s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.236133539 (343h1m21.006774874s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:47.936497427 (343h1m22.707138762s) [upload=274371]: Next returned nil segment
Jul 7 16:11:47.936516484 (343h1m22.707157819s) [upload=274371]: Waiting for error group managing segments...
Jul 7 16:11:48.211479176 (343h1m22.982120511s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.211715508 (343h1m22.982356853s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.218504867 (343h1m22.989146203s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.230271649 (343h1m23.000912984s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.256583018 (343h1m23.027224353s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.257289389 (343h1m23.027930734s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.259657138 (343h1m23.030298474s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.259781777 (343h1m23.030423112s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.260572691 (343h1m23.031214026s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.265855147 (343h1m23.036496482s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.266546209 (343h1m23.037187544s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277352043 (343h1m23.047993388s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277897627 (343h1m23.048538962s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277914017 (343h1m23.048555352s) [seg_pos={0 0}, upload=274371]: Segment reached optimal threshold of 13 pieces.
Jul 7 16:11:48.278072831 (343h1m23.048714166s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278154107 (343h1m23.048795442s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278295267 (343h1m23.048936602s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278307922 (343h1m23.048949257s) [seg_pos={0 0}, upload=274371]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 16:11:48.278410327 (343h1m23.049051662s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 16:11:48.278415868 (343h1m23.049057203s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 16:11:48.561077279 (343h1m23.331718614s) [upload=274371]: Done uploading segments...
Jul 7 16:11:48.561099671 (343h1m23.331741007s) [upload=274371]: Upload finished. err: <nil>
Duration: 5.770185948s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
10.865837ms target:
https://ap1.storj.io/login
FAIL (2025-07-07 16:23:15 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused
Duration: 10.891518ms
core
satellite
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
1.478569815s
FAIL (2025-07-07 16:23:02 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.478593489s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............................................XX.............] duration:
1.89249803s
FAIL (2025-07-07 16:22:57 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.892524872s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
5.556115403s
FAIL (2025-07-07 16:22:51 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed piece hash; context canceled; EOF
Jul 7 16:10:35.615412114 (343h0m10.386053449s) [noise=true , address=45.91.116.9:4262 , piece_id=OUDXQP247Y6NARLWHRRENVSU2IJSGEUF4XGPU4S2MTUVDE7ZLGKA, seg_pos={0 0}, upload=274352]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto): protocol: expected piece hash; context canceled; EOF
Jul 7 16:10:35.615420931 (343h0m10.386062266s) [seg_pos={0 0}, upload=274352]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 16:10:35.615484472 (343h0m10.386125807s) [upload=274352]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 16:10:35.615488280 (343h0m10.386129615s) [upload=274352]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 16:10:35.906954897 (343h0m10.677596232s) [upload=274352]: Done uploading segments...
Jul 7 16:10:35.906972671 (343h0m10.677614006s) [upload=274352]: Upload finished. err: <nil>
Jul 7 16:11:45.999839306 (343h1m20.770480631s) [upload=274371]: Starting upload
Jul 7 16:11:45.999947764 (343h1m20.770589109s) [upload=274371]: Done starting upload
Jul 7 16:11:46.000045640 (343h1m20.770686985s) [upload=274371]: Uploading segments...
Jul 7 16:11:46.000313703 (343h1m20.770955049s) [upload=274371]: Got next segment. Inline: false
Jul 7 16:11:46.000362497 (343h1m20.771003902s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 16:11:46.000370652 (343h1m20.771012038s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 16:11:46.233304657 (343h1m21.003945992s) [seg_pos={0 0}, upload=274371]: Begin upload segment...
Jul 7 16:11:46.233346277 (343h1m21.003987612s) [seg_pos={0 0}, upload=274371]: Done begin upload segment.
Jul 7 16:11:46.233366465 (343h1m21.0040078s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.233486575 (343h1m21.00412795s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.233717486 (343h1m21.004358821s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234000157 (343h1m21.004641482s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234236590 (343h1m21.004877925s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234257029 (343h1m21.004898364s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234522136 (343h1m21.005163471s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234551382 (343h1m21.005192717s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234845234 (343h1m21.005486569s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235011733 (343h1m21.005653058s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235220432 (343h1m21.005861767s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235283693 (343h1m21.005925028s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235499466 (343h1m21.006140801s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235689650 (343h1m21.006330995s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235705780 (343h1m21.006347105s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.236133539 (343h1m21.006774874s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:47.936497427 (343h1m22.707138762s) [upload=274371]: Next returned nil segment
Jul 7 16:11:47.936516484 (343h1m22.707157819s) [upload=274371]: Waiting for error group managing segments...
Jul 7 16:11:48.211479176 (343h1m22.982120511s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.211715508 (343h1m22.982356853s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.218504867 (343h1m22.989146203s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.230271649 (343h1m23.000912984s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.256583018 (343h1m23.027224353s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.257289389 (343h1m23.027930734s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.259657138 (343h1m23.030298474s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.259781777 (343h1m23.030423112s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.260572691 (343h1m23.031214026s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.265855147 (343h1m23.036496482s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.266546209 (343h1m23.037187544s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277352043 (343h1m23.047993388s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277897627 (343h1m23.048538962s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277914017 (343h1m23.048555352s) [seg_pos={0 0}, upload=274371]: Segment reached optimal threshold of 13 pieces.
Jul 7 16:11:48.278072831 (343h1m23.048714166s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278154107 (343h1m23.048795442s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278295267 (343h1m23.048936602s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278307922 (343h1m23.048949257s) [seg_pos={0 0}, upload=274371]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 16:11:48.278410327 (343h1m23.049051662s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 16:11:48.278415868 (343h1m23.049057203s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 16:11:48.561077279 (343h1m23.331718614s) [upload=274371]: Done uploading segments...
Jul 7 16:11:48.561099671 (343h1m23.331741007s) [upload=274371]: Upload finished. err: <nil>
Duration: 5.556165459s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
5.886969625s
FAIL (2025-07-07 16:22:34 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed piece hash; context canceled; EOF
Jul 7 16:10:35.615412114 (343h0m10.386053449s) [noise=true , address=45.91.116.9:4262 , piece_id=OUDXQP247Y6NARLWHRRENVSU2IJSGEUF4XGPU4S2MTUVDE7ZLGKA, seg_pos={0 0}, upload=274352]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto): protocol: expected piece hash; context canceled; EOF
Jul 7 16:10:35.615420931 (343h0m10.386062266s) [seg_pos={0 0}, upload=274352]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 16:10:35.615484472 (343h0m10.386125807s) [upload=274352]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 16:10:35.615488280 (343h0m10.386129615s) [upload=274352]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 16:10:35.906954897 (343h0m10.677596232s) [upload=274352]: Done uploading segments...
Jul 7 16:10:35.906972671 (343h0m10.677614006s) [upload=274352]: Upload finished. err: <nil>
Jul 7 16:11:45.999839306 (343h1m20.770480631s) [upload=274371]: Starting upload
Jul 7 16:11:45.999947764 (343h1m20.770589109s) [upload=274371]: Done starting upload
Jul 7 16:11:46.000045640 (343h1m20.770686985s) [upload=274371]: Uploading segments...
Jul 7 16:11:46.000313703 (343h1m20.770955049s) [upload=274371]: Got next segment. Inline: false
Jul 7 16:11:46.000362497 (343h1m20.771003902s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 16:11:46.000370652 (343h1m20.771012038s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 16:11:46.233304657 (343h1m21.003945992s) [seg_pos={0 0}, upload=274371]: Begin upload segment...
Jul 7 16:11:46.233346277 (343h1m21.003987612s) [seg_pos={0 0}, upload=274371]: Done begin upload segment.
Jul 7 16:11:46.233366465 (343h1m21.0040078s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.233486575 (343h1m21.00412795s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.233717486 (343h1m21.004358821s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234000157 (343h1m21.004641482s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234236590 (343h1m21.004877925s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234257029 (343h1m21.004898364s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234522136 (343h1m21.005163471s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234551382 (343h1m21.005192717s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234845234 (343h1m21.005486569s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235011733 (343h1m21.005653058s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235220432 (343h1m21.005861767s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235283693 (343h1m21.005925028s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235499466 (343h1m21.006140801s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235689650 (343h1m21.006330995s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235705780 (343h1m21.006347105s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.236133539 (343h1m21.006774874s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:47.936497427 (343h1m22.707138762s) [upload=274371]: Next returned nil segment
Jul 7 16:11:47.936516484 (343h1m22.707157819s) [upload=274371]: Waiting for error group managing segments...
Jul 7 16:11:48.211479176 (343h1m22.982120511s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.211715508 (343h1m22.982356853s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.218504867 (343h1m22.989146203s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.230271649 (343h1m23.000912984s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.256583018 (343h1m23.027224353s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.257289389 (343h1m23.027930734s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.259657138 (343h1m23.030298474s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.259781777 (343h1m23.030423112s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.260572691 (343h1m23.031214026s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.265855147 (343h1m23.036496482s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.266546209 (343h1m23.037187544s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277352043 (343h1m23.047993388s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277897627 (343h1m23.048538962s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277914017 (343h1m23.048555352s) [seg_pos={0 0}, upload=274371]: Segment reached optimal threshold of 13 pieces.
Jul 7 16:11:48.278072831 (343h1m23.048714166s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278154107 (343h1m23.048795442s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278295267 (343h1m23.048936602s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278307922 (343h1m23.048949257s) [seg_pos={0 0}, upload=274371]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 16:11:48.278410327 (343h1m23.049051662s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 16:11:48.278415868 (343h1m23.049057203s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 16:11:48.561077279 (343h1m23.331718614s) [upload=274371]: Done uploading segments...
Jul 7 16:11:48.561099671 (343h1m23.331741007s) [upload=274371]: Upload finished. err: <nil>
Duration: 5.886995715s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
1.438073185s
FAIL (2025-07-07 16:22:25 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.438103682s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [..............................................XX............] duration:
1.909059084s
FAIL (2025-07-07 16:22:15 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.909086527s
core
uplink
us1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
13.403223ms target:
https://ap1.storj.io/login
FAIL (2025-07-07 16:22:02 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused
Duration: 13.423591ms
core
satellite
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [...............................................XX...........] duration:
1.916893462s
FAIL (2025-07-07 16:21:52 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.91691312s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
5.945354497s
FAIL (2025-07-07 16:21:49 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed piece hash; context canceled; EOF
Jul 7 16:10:35.615412114 (343h0m10.386053449s) [noise=true , address=45.91.116.9:4262 , piece_id=OUDXQP247Y6NARLWHRRENVSU2IJSGEUF4XGPU4S2MTUVDE7ZLGKA, seg_pos={0 0}, upload=274352]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto): protocol: expected piece hash; context canceled; EOF
Jul 7 16:10:35.615420931 (343h0m10.386062266s) [seg_pos={0 0}, upload=274352]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 16:10:35.615484472 (343h0m10.386125807s) [upload=274352]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 16:10:35.615488280 (343h0m10.386129615s) [upload=274352]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 16:10:35.906954897 (343h0m10.677596232s) [upload=274352]: Done uploading segments...
Jul 7 16:10:35.906972671 (343h0m10.677614006s) [upload=274352]: Upload finished. err: <nil>
Jul 7 16:11:45.999839306 (343h1m20.770480631s) [upload=274371]: Starting upload
Jul 7 16:11:45.999947764 (343h1m20.770589109s) [upload=274371]: Done starting upload
Jul 7 16:11:46.000045640 (343h1m20.770686985s) [upload=274371]: Uploading segments...
Jul 7 16:11:46.000313703 (343h1m20.770955049s) [upload=274371]: Got next segment. Inline: false
Jul 7 16:11:46.000362497 (343h1m20.771003902s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 16:11:46.000370652 (343h1m20.771012038s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 16:11:46.233304657 (343h1m21.003945992s) [seg_pos={0 0}, upload=274371]: Begin upload segment...
Jul 7 16:11:46.233346277 (343h1m21.003987612s) [seg_pos={0 0}, upload=274371]: Done begin upload segment.
Jul 7 16:11:46.233366465 (343h1m21.0040078s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.233486575 (343h1m21.00412795s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.233717486 (343h1m21.004358821s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234000157 (343h1m21.004641482s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234236590 (343h1m21.004877925s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234257029 (343h1m21.004898364s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234522136 (343h1m21.005163471s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234551382 (343h1m21.005192717s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234845234 (343h1m21.005486569s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235011733 (343h1m21.005653058s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235220432 (343h1m21.005861767s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235283693 (343h1m21.005925028s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235499466 (343h1m21.006140801s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235689650 (343h1m21.006330995s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235705780 (343h1m21.006347105s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.236133539 (343h1m21.006774874s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:47.936497427 (343h1m22.707138762s) [upload=274371]: Next returned nil segment
Jul 7 16:11:47.936516484 (343h1m22.707157819s) [upload=274371]: Waiting for error group managing segments...
Jul 7 16:11:48.211479176 (343h1m22.982120511s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.211715508 (343h1m22.982356853s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.218504867 (343h1m22.989146203s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.230271649 (343h1m23.000912984s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.256583018 (343h1m23.027224353s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.257289389 (343h1m23.027930734s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.259657138 (343h1m23.030298474s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.259781777 (343h1m23.030423112s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.260572691 (343h1m23.031214026s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.265855147 (343h1m23.036496482s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.266546209 (343h1m23.037187544s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277352043 (343h1m23.047993388s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277897627 (343h1m23.048538962s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277914017 (343h1m23.048555352s) [seg_pos={0 0}, upload=274371]: Segment reached optimal threshold of 13 pieces.
Jul 7 16:11:48.278072831 (343h1m23.048714166s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278154107 (343h1m23.048795442s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278295267 (343h1m23.048936602s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278307922 (343h1m23.048949257s) [seg_pos={0 0}, upload=274371]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 16:11:48.278410327 (343h1m23.049051662s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 16:11:48.278415868 (343h1m23.049057203s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 16:11:48.561077279 (343h1m23.331718614s) [upload=274371]: Done uploading segments...
Jul 7 16:11:48.561099671 (343h1m23.331741007s) [upload=274371]: Upload finished. err: <nil>
Duration: 5.945383571s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
1.527573166s
FAIL (2025-07-07 16:21:31 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.527601561s
core
uplink
eu1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
22.336733ms target:
https://ap1.storj.io/login
FAIL (2025-07-07 16:21:27 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused
Duration: 22.359928ms
core
satellite
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [................................................XX..........] duration:
1.887162232s
FAIL (2025-07-07 16:21:19 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.887187993s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................................................XX.........] duration:
1.906128528s
FAIL (2025-07-07 16:20:47 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.906157043s
core
uplink
us1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
13.824569ms target:
https://ap1.storj.io/login
FAIL (2025-07-07 16:20:43 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused
Duration: 13.852251ms
core
satellite
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
5.783527002s
FAIL (2025-07-07 16:20:40 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed piece hash; context canceled; EOF
Jul 7 16:10:35.615412114 (343h0m10.386053449s) [noise=true , address=45.91.116.9:4262 , piece_id=OUDXQP247Y6NARLWHRRENVSU2IJSGEUF4XGPU4S2MTUVDE7ZLGKA, seg_pos={0 0}, upload=274352]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto): protocol: expected piece hash; context canceled; EOF
Jul 7 16:10:35.615420931 (343h0m10.386062266s) [seg_pos={0 0}, upload=274352]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 16:10:35.615484472 (343h0m10.386125807s) [upload=274352]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 16:10:35.615488280 (343h0m10.386129615s) [upload=274352]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 16:10:35.906954897 (343h0m10.677596232s) [upload=274352]: Done uploading segments...
Jul 7 16:10:35.906972671 (343h0m10.677614006s) [upload=274352]: Upload finished. err: <nil>
Jul 7 16:11:45.999839306 (343h1m20.770480631s) [upload=274371]: Starting upload
Jul 7 16:11:45.999947764 (343h1m20.770589109s) [upload=274371]: Done starting upload
Jul 7 16:11:46.000045640 (343h1m20.770686985s) [upload=274371]: Uploading segments...
Jul 7 16:11:46.000313703 (343h1m20.770955049s) [upload=274371]: Got next segment. Inline: false
Jul 7 16:11:46.000362497 (343h1m20.771003902s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 16:11:46.000370652 (343h1m20.771012038s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 16:11:46.233304657 (343h1m21.003945992s) [seg_pos={0 0}, upload=274371]: Begin upload segment...
Jul 7 16:11:46.233346277 (343h1m21.003987612s) [seg_pos={0 0}, upload=274371]: Done begin upload segment.
Jul 7 16:11:46.233366465 (343h1m21.0040078s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.233486575 (343h1m21.00412795s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.233717486 (343h1m21.004358821s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234000157 (343h1m21.004641482s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234236590 (343h1m21.004877925s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234257029 (343h1m21.004898364s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234522136 (343h1m21.005163471s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234551382 (343h1m21.005192717s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234845234 (343h1m21.005486569s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235011733 (343h1m21.005653058s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235220432 (343h1m21.005861767s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235283693 (343h1m21.005925028s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235499466 (343h1m21.006140801s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235689650 (343h1m21.006330995s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235705780 (343h1m21.006347105s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.236133539 (343h1m21.006774874s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:47.936497427 (343h1m22.707138762s) [upload=274371]: Next returned nil segment
Jul 7 16:11:47.936516484 (343h1m22.707157819s) [upload=274371]: Waiting for error group managing segments...
Jul 7 16:11:48.211479176 (343h1m22.982120511s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.211715508 (343h1m22.982356853s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.218504867 (343h1m22.989146203s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.230271649 (343h1m23.000912984s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.256583018 (343h1m23.027224353s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.257289389 (343h1m23.027930734s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.259657138 (343h1m23.030298474s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.259781777 (343h1m23.030423112s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.260572691 (343h1m23.031214026s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.265855147 (343h1m23.036496482s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.266546209 (343h1m23.037187544s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277352043 (343h1m23.047993388s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277897627 (343h1m23.048538962s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277914017 (343h1m23.048555352s) [seg_pos={0 0}, upload=274371]: Segment reached optimal threshold of 13 pieces.
Jul 7 16:11:48.278072831 (343h1m23.048714166s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278154107 (343h1m23.048795442s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278295267 (343h1m23.048936602s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278307922 (343h1m23.048949257s) [seg_pos={0 0}, upload=274371]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 16:11:48.278410327 (343h1m23.049051662s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 16:11:48.278415868 (343h1m23.049057203s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 16:11:48.561077279 (343h1m23.331718614s) [upload=274371]: Done uploading segments...
Jul 7 16:11:48.561099671 (343h1m23.331741007s) [upload=274371]: Upload finished. err: <nil>
Duration: 5.783553591s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
1.487566305s
FAIL (2025-07-07 16:20:36 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.487595551s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................................................XX........] duration:
1.852878361s
FAIL (2025-07-07 16:20:30 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.852909752s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
5.675363965s
FAIL (2025-07-07 16:20:21 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed piece hash; context canceled; EOF
Jul 7 16:10:35.615412114 (343h0m10.386053449s) [noise=true , address=45.91.116.9:4262 , piece_id=OUDXQP247Y6NARLWHRRENVSU2IJSGEUF4XGPU4S2MTUVDE7ZLGKA, seg_pos={0 0}, upload=274352]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto): protocol: expected piece hash; context canceled; EOF
Jul 7 16:10:35.615420931 (343h0m10.386062266s) [seg_pos={0 0}, upload=274352]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 16:10:35.615484472 (343h0m10.386125807s) [upload=274352]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 16:10:35.615488280 (343h0m10.386129615s) [upload=274352]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 16:10:35.906954897 (343h0m10.677596232s) [upload=274352]: Done uploading segments...
Jul 7 16:10:35.906972671 (343h0m10.677614006s) [upload=274352]: Upload finished. err: <nil>
Jul 7 16:11:45.999839306 (343h1m20.770480631s) [upload=274371]: Starting upload
Jul 7 16:11:45.999947764 (343h1m20.770589109s) [upload=274371]: Done starting upload
Jul 7 16:11:46.000045640 (343h1m20.770686985s) [upload=274371]: Uploading segments...
Jul 7 16:11:46.000313703 (343h1m20.770955049s) [upload=274371]: Got next segment. Inline: false
Jul 7 16:11:46.000362497 (343h1m20.771003902s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 16:11:46.000370652 (343h1m20.771012038s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 16:11:46.233304657 (343h1m21.003945992s) [seg_pos={0 0}, upload=274371]: Begin upload segment...
Jul 7 16:11:46.233346277 (343h1m21.003987612s) [seg_pos={0 0}, upload=274371]: Done begin upload segment.
Jul 7 16:11:46.233366465 (343h1m21.0040078s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.233486575 (343h1m21.00412795s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.233717486 (343h1m21.004358821s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234000157 (343h1m21.004641482s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234236590 (343h1m21.004877925s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234257029 (343h1m21.004898364s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234522136 (343h1m21.005163471s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234551382 (343h1m21.005192717s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234845234 (343h1m21.005486569s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235011733 (343h1m21.005653058s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235220432 (343h1m21.005861767s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235283693 (343h1m21.005925028s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235499466 (343h1m21.006140801s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235689650 (343h1m21.006330995s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235705780 (343h1m21.006347105s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.236133539 (343h1m21.006774874s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:47.936497427 (343h1m22.707138762s) [upload=274371]: Next returned nil segment
Jul 7 16:11:47.936516484 (343h1m22.707157819s) [upload=274371]: Waiting for error group managing segments...
Jul 7 16:11:48.211479176 (343h1m22.982120511s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.211715508 (343h1m22.982356853s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.218504867 (343h1m22.989146203s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.230271649 (343h1m23.000912984s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.256583018 (343h1m23.027224353s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.257289389 (343h1m23.027930734s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.259657138 (343h1m23.030298474s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.259781777 (343h1m23.030423112s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.260572691 (343h1m23.031214026s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.265855147 (343h1m23.036496482s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.266546209 (343h1m23.037187544s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277352043 (343h1m23.047993388s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277897627 (343h1m23.048538962s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277914017 (343h1m23.048555352s) [seg_pos={0 0}, upload=274371]: Segment reached optimal threshold of 13 pieces.
Jul 7 16:11:48.278072831 (343h1m23.048714166s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278154107 (343h1m23.048795442s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278295267 (343h1m23.048936602s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278307922 (343h1m23.048949257s) [seg_pos={0 0}, upload=274371]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 16:11:48.278410327 (343h1m23.049051662s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 16:11:48.278415868 (343h1m23.049057203s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 16:11:48.561077279 (343h1m23.331718614s) [upload=274371]: Done uploading segments...
Jul 7 16:11:48.561099671 (343h1m23.331741007s) [upload=274371]: Upload finished. err: <nil>
Duration: 5.675392429s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
11.344143ms target:
https://ap1.storj.io/login
FAIL (2025-07-07 16:19:59 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused
Duration: 11.371215ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
10.858714ms target:
https://ap1.storj.io/login
FAIL (2025-07-07 16:19:42 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused
Duration: 10.887571ms
core
satellite
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
1.533801501s
FAIL (2025-07-07 16:19:26 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.533833033s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [...................................................XX.......] duration:
1.915053703s
FAIL (2025-07-07 16:19:16 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.915074954s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
5.600871792s
FAIL (2025-07-07 16:19:08 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed piece hash; context canceled; EOF
Jul 7 16:10:35.615412114 (343h0m10.386053449s) [noise=true , address=45.91.116.9:4262 , piece_id=OUDXQP247Y6NARLWHRRENVSU2IJSGEUF4XGPU4S2MTUVDE7ZLGKA, seg_pos={0 0}, upload=274352]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto): protocol: expected piece hash; context canceled; EOF
Jul 7 16:10:35.615420931 (343h0m10.386062266s) [seg_pos={0 0}, upload=274352]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 16:10:35.615484472 (343h0m10.386125807s) [upload=274352]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 16:10:35.615488280 (343h0m10.386129615s) [upload=274352]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 16:10:35.906954897 (343h0m10.677596232s) [upload=274352]: Done uploading segments...
Jul 7 16:10:35.906972671 (343h0m10.677614006s) [upload=274352]: Upload finished. err: <nil>
Jul 7 16:11:45.999839306 (343h1m20.770480631s) [upload=274371]: Starting upload
Jul 7 16:11:45.999947764 (343h1m20.770589109s) [upload=274371]: Done starting upload
Jul 7 16:11:46.000045640 (343h1m20.770686985s) [upload=274371]: Uploading segments...
Jul 7 16:11:46.000313703 (343h1m20.770955049s) [upload=274371]: Got next segment. Inline: false
Jul 7 16:11:46.000362497 (343h1m20.771003902s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 16:11:46.000370652 (343h1m20.771012038s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 16:11:46.233304657 (343h1m21.003945992s) [seg_pos={0 0}, upload=274371]: Begin upload segment...
Jul 7 16:11:46.233346277 (343h1m21.003987612s) [seg_pos={0 0}, upload=274371]: Done begin upload segment.
Jul 7 16:11:46.233366465 (343h1m21.0040078s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.233486575 (343h1m21.00412795s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.233717486 (343h1m21.004358821s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234000157 (343h1m21.004641482s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234236590 (343h1m21.004877925s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234257029 (343h1m21.004898364s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234522136 (343h1m21.005163471s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234551382 (343h1m21.005192717s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234845234 (343h1m21.005486569s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235011733 (343h1m21.005653058s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235220432 (343h1m21.005861767s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235283693 (343h1m21.005925028s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235499466 (343h1m21.006140801s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235689650 (343h1m21.006330995s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235705780 (343h1m21.006347105s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.236133539 (343h1m21.006774874s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:47.936497427 (343h1m22.707138762s) [upload=274371]: Next returned nil segment
Jul 7 16:11:47.936516484 (343h1m22.707157819s) [upload=274371]: Waiting for error group managing segments...
Jul 7 16:11:48.211479176 (343h1m22.982120511s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.211715508 (343h1m22.982356853s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.218504867 (343h1m22.989146203s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.230271649 (343h1m23.000912984s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.256583018 (343h1m23.027224353s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.257289389 (343h1m23.027930734s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.259657138 (343h1m23.030298474s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.259781777 (343h1m23.030423112s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.260572691 (343h1m23.031214026s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.265855147 (343h1m23.036496482s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.266546209 (343h1m23.037187544s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277352043 (343h1m23.047993388s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277897627 (343h1m23.048538962s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277914017 (343h1m23.048555352s) [seg_pos={0 0}, upload=274371]: Segment reached optimal threshold of 13 pieces.
Jul 7 16:11:48.278072831 (343h1m23.048714166s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278154107 (343h1m23.048795442s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278295267 (343h1m23.048936602s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278307922 (343h1m23.048949257s) [seg_pos={0 0}, upload=274371]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 16:11:48.278410327 (343h1m23.049051662s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 16:11:48.278415868 (343h1m23.049057203s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 16:11:48.561077279 (343h1m23.331718614s) [upload=274371]: Done uploading segments...
Jul 7 16:11:48.561099671 (343h1m23.331741007s) [upload=274371]: Upload finished. err: <nil>
Duration: 5.600898402s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
13.001023ms target:
https://ap1.storj.io/login
FAIL (2025-07-07 16:18:56 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused
Duration: 13.016894ms
core
satellite
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
7.114066466s
FAIL (2025-07-07 16:18:35 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed piece hash; context canceled; EOF
Jul 7 16:10:35.615412114 (343h0m10.386053449s) [noise=true , address=45.91.116.9:4262 , piece_id=OUDXQP247Y6NARLWHRRENVSU2IJSGEUF4XGPU4S2MTUVDE7ZLGKA, seg_pos={0 0}, upload=274352]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto): protocol: expected piece hash; context canceled; EOF
Jul 7 16:10:35.615420931 (343h0m10.386062266s) [seg_pos={0 0}, upload=274352]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 16:10:35.615484472 (343h0m10.386125807s) [upload=274352]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 16:10:35.615488280 (343h0m10.386129615s) [upload=274352]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 16:10:35.906954897 (343h0m10.677596232s) [upload=274352]: Done uploading segments...
Jul 7 16:10:35.906972671 (343h0m10.677614006s) [upload=274352]: Upload finished. err: <nil>
Jul 7 16:11:45.999839306 (343h1m20.770480631s) [upload=274371]: Starting upload
Jul 7 16:11:45.999947764 (343h1m20.770589109s) [upload=274371]: Done starting upload
Jul 7 16:11:46.000045640 (343h1m20.770686985s) [upload=274371]: Uploading segments...
Jul 7 16:11:46.000313703 (343h1m20.770955049s) [upload=274371]: Got next segment. Inline: false
Jul 7 16:11:46.000362497 (343h1m20.771003902s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 16:11:46.000370652 (343h1m20.771012038s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 16:11:46.233304657 (343h1m21.003945992s) [seg_pos={0 0}, upload=274371]: Begin upload segment...
Jul 7 16:11:46.233346277 (343h1m21.003987612s) [seg_pos={0 0}, upload=274371]: Done begin upload segment.
Jul 7 16:11:46.233366465 (343h1m21.0040078s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.233486575 (343h1m21.00412795s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.233717486 (343h1m21.004358821s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234000157 (343h1m21.004641482s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234236590 (343h1m21.004877925s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234257029 (343h1m21.004898364s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234522136 (343h1m21.005163471s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234551382 (343h1m21.005192717s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234845234 (343h1m21.005486569s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235011733 (343h1m21.005653058s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235220432 (343h1m21.005861767s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235283693 (343h1m21.005925028s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235499466 (343h1m21.006140801s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235689650 (343h1m21.006330995s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235705780 (343h1m21.006347105s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.236133539 (343h1m21.006774874s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:47.936497427 (343h1m22.707138762s) [upload=274371]: Next returned nil segment
Jul 7 16:11:47.936516484 (343h1m22.707157819s) [upload=274371]: Waiting for error group managing segments...
Jul 7 16:11:48.211479176 (343h1m22.982120511s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.211715508 (343h1m22.982356853s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.218504867 (343h1m22.989146203s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.230271649 (343h1m23.000912984s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.256583018 (343h1m23.027224353s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.257289389 (343h1m23.027930734s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.259657138 (343h1m23.030298474s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.259781777 (343h1m23.030423112s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.260572691 (343h1m23.031214026s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.265855147 (343h1m23.036496482s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.266546209 (343h1m23.037187544s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277352043 (343h1m23.047993388s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277897627 (343h1m23.048538962s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277914017 (343h1m23.048555352s) [seg_pos={0 0}, upload=274371]: Segment reached optimal threshold of 13 pieces.
Jul 7 16:11:48.278072831 (343h1m23.048714166s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278154107 (343h1m23.048795442s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278295267 (343h1m23.048936602s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278307922 (343h1m23.048949257s) [seg_pos={0 0}, upload=274371]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 16:11:48.278410327 (343h1m23.049051662s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 16:11:48.278415868 (343h1m23.049057203s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 16:11:48.561077279 (343h1m23.331718614s) [upload=274371]: Done uploading segments...
Jul 7 16:11:48.561099671 (343h1m23.331741007s) [upload=274371]: Upload finished. err: <nil>
Duration: 7.114088838s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [....................................................XX......] duration:
1.875558756s
FAIL (2025-07-07 16:18:34 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.875586479s
core
uplink
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
1.450576732s
FAIL (2025-07-07 16:18:23 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.450607941s
core
uplink
eu1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
11.397906ms target:
https://ap1.storj.io/login
FAIL (2025-07-07 16:18:22 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused
Duration: 11.424387ms
core
satellite
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
1.425124718s
FAIL (2025-07-07 16:18:01 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.425159674s
core
uplink
eu1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
9.971868ms target:
https://ap1.storj.io/login
FAIL (2025-07-07 16:17:39 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused
Duration: 10.004169ms
core
satellite
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....................................................XX.....] duration:
1.999357236s
FAIL (2025-07-07 16:17:33 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.999389657s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
5.754404139s
FAIL (2025-07-07 16:17:23 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed piece hash; context canceled; EOF
Jul 7 16:10:35.615412114 (343h0m10.386053449s) [noise=true , address=45.91.116.9:4262 , piece_id=OUDXQP247Y6NARLWHRRENVSU2IJSGEUF4XGPU4S2MTUVDE7ZLGKA, seg_pos={0 0}, upload=274352]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto): protocol: expected piece hash; context canceled; EOF
Jul 7 16:10:35.615420931 (343h0m10.386062266s) [seg_pos={0 0}, upload=274352]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 16:10:35.615484472 (343h0m10.386125807s) [upload=274352]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 16:10:35.615488280 (343h0m10.386129615s) [upload=274352]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 16:10:35.906954897 (343h0m10.677596232s) [upload=274352]: Done uploading segments...
Jul 7 16:10:35.906972671 (343h0m10.677614006s) [upload=274352]: Upload finished. err: <nil>
Jul 7 16:11:45.999839306 (343h1m20.770480631s) [upload=274371]: Starting upload
Jul 7 16:11:45.999947764 (343h1m20.770589109s) [upload=274371]: Done starting upload
Jul 7 16:11:46.000045640 (343h1m20.770686985s) [upload=274371]: Uploading segments...
Jul 7 16:11:46.000313703 (343h1m20.770955049s) [upload=274371]: Got next segment. Inline: false
Jul 7 16:11:46.000362497 (343h1m20.771003902s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 16:11:46.000370652 (343h1m20.771012038s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 16:11:46.233304657 (343h1m21.003945992s) [seg_pos={0 0}, upload=274371]: Begin upload segment...
Jul 7 16:11:46.233346277 (343h1m21.003987612s) [seg_pos={0 0}, upload=274371]: Done begin upload segment.
Jul 7 16:11:46.233366465 (343h1m21.0040078s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.233486575 (343h1m21.00412795s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.233717486 (343h1m21.004358821s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234000157 (343h1m21.004641482s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234236590 (343h1m21.004877925s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234257029 (343h1m21.004898364s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234522136 (343h1m21.005163471s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234551382 (343h1m21.005192717s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234845234 (343h1m21.005486569s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235011733 (343h1m21.005653058s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235220432 (343h1m21.005861767s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235283693 (343h1m21.005925028s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235499466 (343h1m21.006140801s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235689650 (343h1m21.006330995s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235705780 (343h1m21.006347105s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.236133539 (343h1m21.006774874s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:47.936497427 (343h1m22.707138762s) [upload=274371]: Next returned nil segment
Jul 7 16:11:47.936516484 (343h1m22.707157819s) [upload=274371]: Waiting for error group managing segments...
Jul 7 16:11:48.211479176 (343h1m22.982120511s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.211715508 (343h1m22.982356853s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.218504867 (343h1m22.989146203s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.230271649 (343h1m23.000912984s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.256583018 (343h1m23.027224353s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.257289389 (343h1m23.027930734s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.259657138 (343h1m23.030298474s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.259781777 (343h1m23.030423112s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.260572691 (343h1m23.031214026s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.265855147 (343h1m23.036496482s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.266546209 (343h1m23.037187544s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277352043 (343h1m23.047993388s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277897627 (343h1m23.048538962s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277914017 (343h1m23.048555352s) [seg_pos={0 0}, upload=274371]: Segment reached optimal threshold of 13 pieces.
Jul 7 16:11:48.278072831 (343h1m23.048714166s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278154107 (343h1m23.048795442s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278295267 (343h1m23.048936602s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278307922 (343h1m23.048949257s) [seg_pos={0 0}, upload=274371]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 16:11:48.278410327 (343h1m23.049051662s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 16:11:48.278415868 (343h1m23.049057203s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 16:11:48.561077279 (343h1m23.331718614s) [upload=274371]: Done uploading segments...
Jul 7 16:11:48.561099671 (343h1m23.331741007s) [upload=274371]: Upload finished. err: <nil>
Duration: 5.75442553s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
11.549627ms target:
https://ap1.storj.io/login
FAIL (2025-07-07 16:17:02 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused
Duration: 11.576398ms
core
satellite
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
1.464786005s
FAIL (2025-07-07 16:16:58 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.464810591s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
5.709188503s
FAIL (2025-07-07 16:16:39 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed piece hash; context canceled; EOF
Jul 7 16:10:35.615412114 (343h0m10.386053449s) [noise=true , address=45.91.116.9:4262 , piece_id=OUDXQP247Y6NARLWHRRENVSU2IJSGEUF4XGPU4S2MTUVDE7ZLGKA, seg_pos={0 0}, upload=274352]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto): protocol: expected piece hash; context canceled; EOF
Jul 7 16:10:35.615420931 (343h0m10.386062266s) [seg_pos={0 0}, upload=274352]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 16:10:35.615484472 (343h0m10.386125807s) [upload=274352]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 16:10:35.615488280 (343h0m10.386129615s) [upload=274352]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 16:10:35.906954897 (343h0m10.677596232s) [upload=274352]: Done uploading segments...
Jul 7 16:10:35.906972671 (343h0m10.677614006s) [upload=274352]: Upload finished. err: <nil>
Jul 7 16:11:45.999839306 (343h1m20.770480631s) [upload=274371]: Starting upload
Jul 7 16:11:45.999947764 (343h1m20.770589109s) [upload=274371]: Done starting upload
Jul 7 16:11:46.000045640 (343h1m20.770686985s) [upload=274371]: Uploading segments...
Jul 7 16:11:46.000313703 (343h1m20.770955049s) [upload=274371]: Got next segment. Inline: false
Jul 7 16:11:46.000362497 (343h1m20.771003902s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 16:11:46.000370652 (343h1m20.771012038s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 16:11:46.233304657 (343h1m21.003945992s) [seg_pos={0 0}, upload=274371]: Begin upload segment...
Jul 7 16:11:46.233346277 (343h1m21.003987612s) [seg_pos={0 0}, upload=274371]: Done begin upload segment.
Jul 7 16:11:46.233366465 (343h1m21.0040078s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.233486575 (343h1m21.00412795s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.233717486 (343h1m21.004358821s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234000157 (343h1m21.004641482s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234236590 (343h1m21.004877925s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234257029 (343h1m21.004898364s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234522136 (343h1m21.005163471s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234551382 (343h1m21.005192717s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234845234 (343h1m21.005486569s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235011733 (343h1m21.005653058s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235220432 (343h1m21.005861767s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235283693 (343h1m21.005925028s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235499466 (343h1m21.006140801s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235689650 (343h1m21.006330995s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235705780 (343h1m21.006347105s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.236133539 (343h1m21.006774874s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:47.936497427 (343h1m22.707138762s) [upload=274371]: Next returned nil segment
Jul 7 16:11:47.936516484 (343h1m22.707157819s) [upload=274371]: Waiting for error group managing segments...
Jul 7 16:11:48.211479176 (343h1m22.982120511s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.211715508 (343h1m22.982356853s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.218504867 (343h1m22.989146203s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.230271649 (343h1m23.000912984s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.256583018 (343h1m23.027224353s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.257289389 (343h1m23.027930734s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.259657138 (343h1m23.030298474s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.259781777 (343h1m23.030423112s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.260572691 (343h1m23.031214026s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.265855147 (343h1m23.036496482s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.266546209 (343h1m23.037187544s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277352043 (343h1m23.047993388s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277897627 (343h1m23.048538962s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277914017 (343h1m23.048555352s) [seg_pos={0 0}, upload=274371]: Segment reached optimal threshold of 13 pieces.
Jul 7 16:11:48.278072831 (343h1m23.048714166s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278154107 (343h1m23.048795442s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278295267 (343h1m23.048936602s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278307922 (343h1m23.048949257s) [seg_pos={0 0}, upload=274371]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 16:11:48.278410327 (343h1m23.049051662s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 16:11:48.278415868 (343h1m23.049057203s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 16:11:48.561077279 (343h1m23.331718614s) [upload=274371]: Done uploading segments...
Jul 7 16:11:48.561099671 (343h1m23.331741007s) [upload=274371]: Upload finished. err: <nil>
Duration: 5.709214644s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [......................................................XX....] duration:
2.156360822s
FAIL (2025-07-07 16:16:34 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 2.156390279s
core
uplink
us1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
17.469452ms target:
https://ap1.storj.io/login
FAIL (2025-07-07 16:16:30 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused
Duration: 17.496445ms
core
satellite
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
1.453236891s
FAIL (2025-07-07 16:16:27 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.453261548s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......................................................XX...] duration:
1.870286132s
FAIL (2025-07-07 16:16:00 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.870313003s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
5.587286674s
FAIL (2025-07-07 16:15:56 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed piece hash; context canceled; EOF
Jul 7 16:10:35.615412114 (343h0m10.386053449s) [noise=true , address=45.91.116.9:4262 , piece_id=OUDXQP247Y6NARLWHRRENVSU2IJSGEUF4XGPU4S2MTUVDE7ZLGKA, seg_pos={0 0}, upload=274352]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto): protocol: expected piece hash; context canceled; EOF
Jul 7 16:10:35.615420931 (343h0m10.386062266s) [seg_pos={0 0}, upload=274352]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 16:10:35.615484472 (343h0m10.386125807s) [upload=274352]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 16:10:35.615488280 (343h0m10.386129615s) [upload=274352]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 16:10:35.906954897 (343h0m10.677596232s) [upload=274352]: Done uploading segments...
Jul 7 16:10:35.906972671 (343h0m10.677614006s) [upload=274352]: Upload finished. err: <nil>
Jul 7 16:11:45.999839306 (343h1m20.770480631s) [upload=274371]: Starting upload
Jul 7 16:11:45.999947764 (343h1m20.770589109s) [upload=274371]: Done starting upload
Jul 7 16:11:46.000045640 (343h1m20.770686985s) [upload=274371]: Uploading segments...
Jul 7 16:11:46.000313703 (343h1m20.770955049s) [upload=274371]: Got next segment. Inline: false
Jul 7 16:11:46.000362497 (343h1m20.771003902s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 16:11:46.000370652 (343h1m20.771012038s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 16:11:46.233304657 (343h1m21.003945992s) [seg_pos={0 0}, upload=274371]: Begin upload segment...
Jul 7 16:11:46.233346277 (343h1m21.003987612s) [seg_pos={0 0}, upload=274371]: Done begin upload segment.
Jul 7 16:11:46.233366465 (343h1m21.0040078s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.233486575 (343h1m21.00412795s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.233717486 (343h1m21.004358821s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234000157 (343h1m21.004641482s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234236590 (343h1m21.004877925s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234257029 (343h1m21.004898364s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234522136 (343h1m21.005163471s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234551382 (343h1m21.005192717s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.234845234 (343h1m21.005486569s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235011733 (343h1m21.005653058s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235220432 (343h1m21.005861767s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235283693 (343h1m21.005925028s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235499466 (343h1m21.006140801s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235689650 (343h1m21.006330995s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.235705780 (343h1m21.006347105s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:46.236133539 (343h1m21.006774874s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Uploading piece...
Jul 7 16:11:47.936497427 (343h1m22.707138762s) [upload=274371]: Next returned nil segment
Jul 7 16:11:47.936516484 (343h1m22.707157819s) [upload=274371]: Waiting for error group managing segments...
Jul 7 16:11:48.211479176 (343h1m22.982120511s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.211715508 (343h1m22.982356853s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.218504867 (343h1m22.989146203s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.230271649 (343h1m23.000912984s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.256583018 (343h1m23.027224353s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.257289389 (343h1m23.027930734s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.259657138 (343h1m23.030298474s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.259781777 (343h1m23.030423112s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.260572691 (343h1m23.031214026s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.265855147 (343h1m23.036496482s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.266546209 (343h1m23.037187544s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277352043 (343h1m23.047993388s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277897627 (343h1m23.048538962s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil>
Jul 7 16:11:48.277914017 (343h1m23.048555352s) [seg_pos={0 0}, upload=274371]: Segment reached optimal threshold of 13 pieces.
Jul 7 16:11:48.278072831 (343h1m23.048714166s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278154107 (343h1m23.048795442s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278295267 (343h1m23.048936602s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF
Jul 7 16:11:48.278307922 (343h1m23.048949257s) [seg_pos={0 0}, upload=274371]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 16:11:48.278410327 (343h1m23.049051662s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 16:11:48.278415868 (343h1m23.049057203s) [upload=274371]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 16:11:48.561077279 (343h1m23.331718614s) [upload=274371]: Done uploading segments...
Jul 7 16:11:48.561099671 (343h1m23.331741007s) [upload=274371]: Upload finished. err: <nil>
Duration: 5.587313986s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
19.424332ms target:
https://ap1.storj.io/login
FAIL (2025-07-07 16:15:43 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused
Duration: 19.645495ms
core
satellite
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [........................................................XX..] duration:
2.005394215s
FAIL (2025-07-07 16:15:37 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 2.005426718s
core
uplink
us1
|