Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 6.083578683s FAIL (2025-07-07 16:35:11 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== ed piece hash; context canceled; EOF Jul 7 16:10:35.615412114 (343h0m10.386053449s) [noise=true , address=45.91.116.9:4262 , piece_id=OUDXQP247Y6NARLWHRRENVSU2IJSGEUF4XGPU4S2MTUVDE7ZLGKA, seg_pos={0 0}, upload=274352]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto): protocol: expected piece hash; context canceled; EOF Jul 7 16:10:35.615420931 (343h0m10.386062266s) [seg_pos={0 0}, upload=274352]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 16:10:35.615484472 (343h0m10.386125807s) [upload=274352]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 16:10:35.615488280 (343h0m10.386129615s) [upload=274352]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 16:10:35.906954897 (343h0m10.677596232s) [upload=274352]: Done uploading segments... Jul 7 16:10:35.906972671 (343h0m10.677614006s) [upload=274352]: Upload finished. err: <nil> Jul 7 16:11:45.999839306 (343h1m20.770480631s) [upload=274371]: Starting upload Jul 7 16:11:45.999947764 (343h1m20.770589109s) [upload=274371]: Done starting upload Jul 7 16:11:46.000045640 (343h1m20.770686985s) [upload=274371]: Uploading segments... Jul 7 16:11:46.000313703 (343h1m20.770955049s) [upload=274371]: Got next segment. Inline: false Jul 7 16:11:46.000362497 (343h1m20.771003902s) [upload=274371]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 7 16:11:46.000370652 (343h1m20.771012038s) [upload=274371]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 7 16:11:46.233304657 (343h1m21.003945992s) [seg_pos={0 0}, upload=274371]: Begin upload segment... Jul 7 16:11:46.233346277 (343h1m21.003987612s) [seg_pos={0 0}, upload=274371]: Done begin upload segment. Jul 7 16:11:46.233366465 (343h1m21.0040078s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.233486575 (343h1m21.00412795s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.233717486 (343h1m21.004358821s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.234000157 (343h1m21.004641482s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.234236590 (343h1m21.004877925s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.234257029 (343h1m21.004898364s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.234522136 (343h1m21.005163471s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.234551382 (343h1m21.005192717s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.234845234 (343h1m21.005486569s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.235011733 (343h1m21.005653058s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.235220432 (343h1m21.005861767s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.235283693 (343h1m21.005925028s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.235499466 (343h1m21.006140801s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.235689650 (343h1m21.006330995s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.235705780 (343h1m21.006347105s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.236133539 (343h1m21.006774874s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:47.936497427 (343h1m22.707138762s) [upload=274371]: Next returned nil segment Jul 7 16:11:47.936516484 (343h1m22.707157819s) [upload=274371]: Waiting for error group managing segments... Jul 7 16:11:48.211479176 (343h1m22.982120511s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.211715508 (343h1m22.982356853s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.218504867 (343h1m22.989146203s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.230271649 (343h1m23.000912984s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.256583018 (343h1m23.027224353s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.257289389 (343h1m23.027930734s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.259657138 (343h1m23.030298474s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.259781777 (343h1m23.030423112s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.260572691 (343h1m23.031214026s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.265855147 (343h1m23.036496482s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.266546209 (343h1m23.037187544s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.277352043 (343h1m23.047993388s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.277897627 (343h1m23.048538962s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.277914017 (343h1m23.048555352s) [seg_pos={0 0}, upload=274371]: Segment reached optimal threshold of 13 pieces. Jul 7 16:11:48.278072831 (343h1m23.048714166s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 7 16:11:48.278154107 (343h1m23.048795442s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF Jul 7 16:11:48.278295267 (343h1m23.048936602s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Jul 7 16:11:48.278307922 (343h1m23.048949257s) [seg_pos={0 0}, upload=274371]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 16:11:48.278410327 (343h1m23.049051662s) [upload=274371]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 16:11:48.278415868 (343h1m23.049057203s) [upload=274371]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 16:11:48.561077279 (343h1m23.331718614s) [upload=274371]: Done uploading segments... Jul 7 16:11:48.561099671 (343h1m23.331741007s) [upload=274371]: Upload finished. err: <nil> Duration: 6.083622206s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 1.456958565s FAIL (2025-07-07 16:35:00 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.457003611s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.............................XX.............................] duration: 2.259407644s FAIL (2025-07-07 16:34:51 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 2.259435378s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [..............................XX............................] duration: 2.418395996s FAIL (2025-07-07 16:34:33 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 2.418464447s core uplink us1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 16.538251ms target: https://ap1.storj.io/login FAIL (2025-07-07 16:34:23 UTC) orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused Duration: 16.552188ms core satellite ap1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 1.440487707s FAIL (2025-07-07 16:34:12 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.440514698s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 6.0505594s FAIL (2025-07-07 16:34:11 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== ed piece hash; context canceled; EOF Jul 7 16:10:35.615412114 (343h0m10.386053449s) [noise=true , address=45.91.116.9:4262 , piece_id=OUDXQP247Y6NARLWHRRENVSU2IJSGEUF4XGPU4S2MTUVDE7ZLGKA, seg_pos={0 0}, upload=274352]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto): protocol: expected piece hash; context canceled; EOF Jul 7 16:10:35.615420931 (343h0m10.386062266s) [seg_pos={0 0}, upload=274352]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 16:10:35.615484472 (343h0m10.386125807s) [upload=274352]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 16:10:35.615488280 (343h0m10.386129615s) [upload=274352]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 16:10:35.906954897 (343h0m10.677596232s) [upload=274352]: Done uploading segments... Jul 7 16:10:35.906972671 (343h0m10.677614006s) [upload=274352]: Upload finished. err: <nil> Jul 7 16:11:45.999839306 (343h1m20.770480631s) [upload=274371]: Starting upload Jul 7 16:11:45.999947764 (343h1m20.770589109s) [upload=274371]: Done starting upload Jul 7 16:11:46.000045640 (343h1m20.770686985s) [upload=274371]: Uploading segments... Jul 7 16:11:46.000313703 (343h1m20.770955049s) [upload=274371]: Got next segment. Inline: false Jul 7 16:11:46.000362497 (343h1m20.771003902s) [upload=274371]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 7 16:11:46.000370652 (343h1m20.771012038s) [upload=274371]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 7 16:11:46.233304657 (343h1m21.003945992s) [seg_pos={0 0}, upload=274371]: Begin upload segment... Jul 7 16:11:46.233346277 (343h1m21.003987612s) [seg_pos={0 0}, upload=274371]: Done begin upload segment. Jul 7 16:11:46.233366465 (343h1m21.0040078s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.233486575 (343h1m21.00412795s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.233717486 (343h1m21.004358821s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.234000157 (343h1m21.004641482s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.234236590 (343h1m21.004877925s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.234257029 (343h1m21.004898364s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.234522136 (343h1m21.005163471s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.234551382 (343h1m21.005192717s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.234845234 (343h1m21.005486569s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.235011733 (343h1m21.005653058s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.235220432 (343h1m21.005861767s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.235283693 (343h1m21.005925028s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.235499466 (343h1m21.006140801s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.235689650 (343h1m21.006330995s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.235705780 (343h1m21.006347105s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.236133539 (343h1m21.006774874s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:47.936497427 (343h1m22.707138762s) [upload=274371]: Next returned nil segment Jul 7 16:11:47.936516484 (343h1m22.707157819s) [upload=274371]: Waiting for error group managing segments... Jul 7 16:11:48.211479176 (343h1m22.982120511s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.211715508 (343h1m22.982356853s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.218504867 (343h1m22.989146203s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.230271649 (343h1m23.000912984s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.256583018 (343h1m23.027224353s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.257289389 (343h1m23.027930734s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.259657138 (343h1m23.030298474s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.259781777 (343h1m23.030423112s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.260572691 (343h1m23.031214026s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.265855147 (343h1m23.036496482s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.266546209 (343h1m23.037187544s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.277352043 (343h1m23.047993388s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.277897627 (343h1m23.048538962s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.277914017 (343h1m23.048555352s) [seg_pos={0 0}, upload=274371]: Segment reached optimal threshold of 13 pieces. Jul 7 16:11:48.278072831 (343h1m23.048714166s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 7 16:11:48.278154107 (343h1m23.048795442s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF Jul 7 16:11:48.278295267 (343h1m23.048936602s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Jul 7 16:11:48.278307922 (343h1m23.048949257s) [seg_pos={0 0}, upload=274371]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 16:11:48.278410327 (343h1m23.049051662s) [upload=274371]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 16:11:48.278415868 (343h1m23.049057203s) [upload=274371]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 16:11:48.561077279 (343h1m23.331718614s) [upload=274371]: Done uploading segments... Jul 7 16:11:48.561099671 (343h1m23.331741007s) [upload=274371]: Upload finished. err: <nil> Duration: 6.0505853s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [...............................XX...........................] duration: 2.362919189s FAIL (2025-07-07 16:34:09 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 2.362940079s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 6.112155675s FAIL (2025-07-07 16:33:40 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== ed piece hash; context canceled; EOF Jul 7 16:10:35.615412114 (343h0m10.386053449s) [noise=true , address=45.91.116.9:4262 , piece_id=OUDXQP247Y6NARLWHRRENVSU2IJSGEUF4XGPU4S2MTUVDE7ZLGKA, seg_pos={0 0}, upload=274352]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto): protocol: expected piece hash; context canceled; EOF Jul 7 16:10:35.615420931 (343h0m10.386062266s) [seg_pos={0 0}, upload=274352]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 16:10:35.615484472 (343h0m10.386125807s) [upload=274352]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 16:10:35.615488280 (343h0m10.386129615s) [upload=274352]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 16:10:35.906954897 (343h0m10.677596232s) [upload=274352]: Done uploading segments... Jul 7 16:10:35.906972671 (343h0m10.677614006s) [upload=274352]: Upload finished. err: <nil> Jul 7 16:11:45.999839306 (343h1m20.770480631s) [upload=274371]: Starting upload Jul 7 16:11:45.999947764 (343h1m20.770589109s) [upload=274371]: Done starting upload Jul 7 16:11:46.000045640 (343h1m20.770686985s) [upload=274371]: Uploading segments... Jul 7 16:11:46.000313703 (343h1m20.770955049s) [upload=274371]: Got next segment. Inline: false Jul 7 16:11:46.000362497 (343h1m20.771003902s) [upload=274371]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 7 16:11:46.000370652 (343h1m20.771012038s) [upload=274371]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 7 16:11:46.233304657 (343h1m21.003945992s) [seg_pos={0 0}, upload=274371]: Begin upload segment... Jul 7 16:11:46.233346277 (343h1m21.003987612s) [seg_pos={0 0}, upload=274371]: Done begin upload segment. Jul 7 16:11:46.233366465 (343h1m21.0040078s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.233486575 (343h1m21.00412795s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.233717486 (343h1m21.004358821s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.234000157 (343h1m21.004641482s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.234236590 (343h1m21.004877925s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.234257029 (343h1m21.004898364s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.234522136 (343h1m21.005163471s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.234551382 (343h1m21.005192717s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.234845234 (343h1m21.005486569s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.235011733 (343h1m21.005653058s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.235220432 (343h1m21.005861767s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.235283693 (343h1m21.005925028s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.235499466 (343h1m21.006140801s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.235689650 (343h1m21.006330995s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.235705780 (343h1m21.006347105s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.236133539 (343h1m21.006774874s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:47.936497427 (343h1m22.707138762s) [upload=274371]: Next returned nil segment Jul 7 16:11:47.936516484 (343h1m22.707157819s) [upload=274371]: Waiting for error group managing segments... Jul 7 16:11:48.211479176 (343h1m22.982120511s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.211715508 (343h1m22.982356853s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.218504867 (343h1m22.989146203s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.230271649 (343h1m23.000912984s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.256583018 (343h1m23.027224353s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.257289389 (343h1m23.027930734s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.259657138 (343h1m23.030298474s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.259781777 (343h1m23.030423112s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.260572691 (343h1m23.031214026s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.265855147 (343h1m23.036496482s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.266546209 (343h1m23.037187544s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.277352043 (343h1m23.047993388s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.277897627 (343h1m23.048538962s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.277914017 (343h1m23.048555352s) [seg_pos={0 0}, upload=274371]: Segment reached optimal threshold of 13 pieces. Jul 7 16:11:48.278072831 (343h1m23.048714166s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 7 16:11:48.278154107 (343h1m23.048795442s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF Jul 7 16:11:48.278295267 (343h1m23.048936602s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Jul 7 16:11:48.278307922 (343h1m23.048949257s) [seg_pos={0 0}, upload=274371]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 16:11:48.278410327 (343h1m23.049051662s) [upload=274371]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 16:11:48.278415868 (343h1m23.049057203s) [upload=274371]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 16:11:48.561077279 (343h1m23.331718614s) [upload=274371]: Done uploading segments... Jul 7 16:11:48.561099671 (343h1m23.331741007s) [upload=274371]: Upload finished. err: <nil> Duration: 6.11217948s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [................................XX..........................] duration: 2.178383933s FAIL (2025-07-07 16:33:34 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 2.178409223s core uplink us1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 20.57833ms target: https://ap1.storj.io/login FAIL (2025-07-07 16:33:22 UTC) orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused Duration: 20.616042ms core satellite ap1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 13.211526ms target: https://ap1.storj.io/login FAIL (2025-07-07 16:33:03 UTC) orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused Duration: 13.239139ms core satellite ap1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 1.440263979s FAIL (2025-07-07 16:33:02 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.440289718s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.................................XX.........................] duration: 1.891975201s FAIL (2025-07-07 16:32:37 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.892001641s core uplink us1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 1.437746489s FAIL (2025-07-07 16:32:37 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.437771449s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 5.604313044s FAIL (2025-07-07 16:32:32 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== ed piece hash; context canceled; EOF Jul 7 16:10:35.615412114 (343h0m10.386053449s) [noise=true , address=45.91.116.9:4262 , piece_id=OUDXQP247Y6NARLWHRRENVSU2IJSGEUF4XGPU4S2MTUVDE7ZLGKA, seg_pos={0 0}, upload=274352]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto): protocol: expected piece hash; context canceled; EOF Jul 7 16:10:35.615420931 (343h0m10.386062266s) [seg_pos={0 0}, upload=274352]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 16:10:35.615484472 (343h0m10.386125807s) [upload=274352]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 16:10:35.615488280 (343h0m10.386129615s) [upload=274352]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 16:10:35.906954897 (343h0m10.677596232s) [upload=274352]: Done uploading segments... Jul 7 16:10:35.906972671 (343h0m10.677614006s) [upload=274352]: Upload finished. err: <nil> Jul 7 16:11:45.999839306 (343h1m20.770480631s) [upload=274371]: Starting upload Jul 7 16:11:45.999947764 (343h1m20.770589109s) [upload=274371]: Done starting upload Jul 7 16:11:46.000045640 (343h1m20.770686985s) [upload=274371]: Uploading segments... Jul 7 16:11:46.000313703 (343h1m20.770955049s) [upload=274371]: Got next segment. Inline: false Jul 7 16:11:46.000362497 (343h1m20.771003902s) [upload=274371]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 7 16:11:46.000370652 (343h1m20.771012038s) [upload=274371]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 7 16:11:46.233304657 (343h1m21.003945992s) [seg_pos={0 0}, upload=274371]: Begin upload segment... Jul 7 16:11:46.233346277 (343h1m21.003987612s) [seg_pos={0 0}, upload=274371]: Done begin upload segment. Jul 7 16:11:46.233366465 (343h1m21.0040078s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.233486575 (343h1m21.00412795s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.233717486 (343h1m21.004358821s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.234000157 (343h1m21.004641482s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.234236590 (343h1m21.004877925s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.234257029 (343h1m21.004898364s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.234522136 (343h1m21.005163471s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.234551382 (343h1m21.005192717s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.234845234 (343h1m21.005486569s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.235011733 (343h1m21.005653058s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.235220432 (343h1m21.005861767s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.235283693 (343h1m21.005925028s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.235499466 (343h1m21.006140801s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.235689650 (343h1m21.006330995s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.235705780 (343h1m21.006347105s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.236133539 (343h1m21.006774874s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:47.936497427 (343h1m22.707138762s) [upload=274371]: Next returned nil segment Jul 7 16:11:47.936516484 (343h1m22.707157819s) [upload=274371]: Waiting for error group managing segments... Jul 7 16:11:48.211479176 (343h1m22.982120511s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.211715508 (343h1m22.982356853s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.218504867 (343h1m22.989146203s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.230271649 (343h1m23.000912984s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.256583018 (343h1m23.027224353s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.257289389 (343h1m23.027930734s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.259657138 (343h1m23.030298474s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.259781777 (343h1m23.030423112s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.260572691 (343h1m23.031214026s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.265855147 (343h1m23.036496482s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.266546209 (343h1m23.037187544s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.277352043 (343h1m23.047993388s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.277897627 (343h1m23.048538962s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.277914017 (343h1m23.048555352s) [seg_pos={0 0}, upload=274371]: Segment reached optimal threshold of 13 pieces. Jul 7 16:11:48.278072831 (343h1m23.048714166s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 7 16:11:48.278154107 (343h1m23.048795442s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF Jul 7 16:11:48.278295267 (343h1m23.048936602s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Jul 7 16:11:48.278307922 (343h1m23.048949257s) [seg_pos={0 0}, upload=274371]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 16:11:48.278410327 (343h1m23.049051662s) [upload=274371]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 16:11:48.278415868 (343h1m23.049057203s) [upload=274371]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 16:11:48.561077279 (343h1m23.331718614s) [upload=274371]: Done uploading segments... Jul 7 16:11:48.561099671 (343h1m23.331741007s) [upload=274371]: Upload finished. err: <nil> Duration: 5.604338082s core uplink us-select-1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 15.289462ms target: https://ap1.storj.io/login FAIL (2025-07-07 16:32:08 UTC) orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused Duration: 15.319229ms core satellite ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 5.591167034s FAIL (2025-07-07 16:31:59 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== ed piece hash; context canceled; EOF Jul 7 16:10:35.615412114 (343h0m10.386053449s) [noise=true , address=45.91.116.9:4262 , piece_id=OUDXQP247Y6NARLWHRRENVSU2IJSGEUF4XGPU4S2MTUVDE7ZLGKA, seg_pos={0 0}, upload=274352]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto): protocol: expected piece hash; context canceled; EOF Jul 7 16:10:35.615420931 (343h0m10.386062266s) [seg_pos={0 0}, upload=274352]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 16:10:35.615484472 (343h0m10.386125807s) [upload=274352]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 16:10:35.615488280 (343h0m10.386129615s) [upload=274352]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 16:10:35.906954897 (343h0m10.677596232s) [upload=274352]: Done uploading segments... Jul 7 16:10:35.906972671 (343h0m10.677614006s) [upload=274352]: Upload finished. err: <nil> Jul 7 16:11:45.999839306 (343h1m20.770480631s) [upload=274371]: Starting upload Jul 7 16:11:45.999947764 (343h1m20.770589109s) [upload=274371]: Done starting upload Jul 7 16:11:46.000045640 (343h1m20.770686985s) [upload=274371]: Uploading segments... Jul 7 16:11:46.000313703 (343h1m20.770955049s) [upload=274371]: Got next segment. Inline: false Jul 7 16:11:46.000362497 (343h1m20.771003902s) [upload=274371]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 7 16:11:46.000370652 (343h1m20.771012038s) [upload=274371]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 7 16:11:46.233304657 (343h1m21.003945992s) [seg_pos={0 0}, upload=274371]: Begin upload segment... Jul 7 16:11:46.233346277 (343h1m21.003987612s) [seg_pos={0 0}, upload=274371]: Done begin upload segment. Jul 7 16:11:46.233366465 (343h1m21.0040078s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.233486575 (343h1m21.00412795s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.233717486 (343h1m21.004358821s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.234000157 (343h1m21.004641482s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.234236590 (343h1m21.004877925s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.234257029 (343h1m21.004898364s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.234522136 (343h1m21.005163471s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.234551382 (343h1m21.005192717s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.234845234 (343h1m21.005486569s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.235011733 (343h1m21.005653058s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.235220432 (343h1m21.005861767s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.235283693 (343h1m21.005925028s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.235499466 (343h1m21.006140801s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.235689650 (343h1m21.006330995s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.235705780 (343h1m21.006347105s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.236133539 (343h1m21.006774874s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:47.936497427 (343h1m22.707138762s) [upload=274371]: Next returned nil segment Jul 7 16:11:47.936516484 (343h1m22.707157819s) [upload=274371]: Waiting for error group managing segments... Jul 7 16:11:48.211479176 (343h1m22.982120511s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.211715508 (343h1m22.982356853s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.218504867 (343h1m22.989146203s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.230271649 (343h1m23.000912984s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.256583018 (343h1m23.027224353s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.257289389 (343h1m23.027930734s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.259657138 (343h1m23.030298474s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.259781777 (343h1m23.030423112s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.260572691 (343h1m23.031214026s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.265855147 (343h1m23.036496482s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.266546209 (343h1m23.037187544s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.277352043 (343h1m23.047993388s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.277897627 (343h1m23.048538962s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.277914017 (343h1m23.048555352s) [seg_pos={0 0}, upload=274371]: Segment reached optimal threshold of 13 pieces. Jul 7 16:11:48.278072831 (343h1m23.048714166s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 7 16:11:48.278154107 (343h1m23.048795442s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF Jul 7 16:11:48.278295267 (343h1m23.048936602s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Jul 7 16:11:48.278307922 (343h1m23.048949257s) [seg_pos={0 0}, upload=274371]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 16:11:48.278410327 (343h1m23.049051662s) [upload=274371]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 16:11:48.278415868 (343h1m23.049057203s) [upload=274371]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 16:11:48.561077279 (343h1m23.331718614s) [upload=274371]: Done uploading segments... Jul 7 16:11:48.561099671 (343h1m23.331741007s) [upload=274371]: Upload finished. err: <nil> Duration: 5.591193125s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [..................................XX........................] duration: 1.920090962s FAIL (2025-07-07 16:31:48 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.92012193s core uplink us1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 1.451039333s FAIL (2025-07-07 16:31:45 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.451065673s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 5.668773108s FAIL (2025-07-07 16:31:14 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== ed piece hash; context canceled; EOF Jul 7 16:10:35.615412114 (343h0m10.386053449s) [noise=true , address=45.91.116.9:4262 , piece_id=OUDXQP247Y6NARLWHRRENVSU2IJSGEUF4XGPU4S2MTUVDE7ZLGKA, seg_pos={0 0}, upload=274352]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto): protocol: expected piece hash; context canceled; EOF Jul 7 16:10:35.615420931 (343h0m10.386062266s) [seg_pos={0 0}, upload=274352]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 16:10:35.615484472 (343h0m10.386125807s) [upload=274352]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 16:10:35.615488280 (343h0m10.386129615s) [upload=274352]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 16:10:35.906954897 (343h0m10.677596232s) [upload=274352]: Done uploading segments... Jul 7 16:10:35.906972671 (343h0m10.677614006s) [upload=274352]: Upload finished. err: <nil> Jul 7 16:11:45.999839306 (343h1m20.770480631s) [upload=274371]: Starting upload Jul 7 16:11:45.999947764 (343h1m20.770589109s) [upload=274371]: Done starting upload Jul 7 16:11:46.000045640 (343h1m20.770686985s) [upload=274371]: Uploading segments... Jul 7 16:11:46.000313703 (343h1m20.770955049s) [upload=274371]: Got next segment. Inline: false Jul 7 16:11:46.000362497 (343h1m20.771003902s) [upload=274371]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 7 16:11:46.000370652 (343h1m20.771012038s) [upload=274371]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 7 16:11:46.233304657 (343h1m21.003945992s) [seg_pos={0 0}, upload=274371]: Begin upload segment... Jul 7 16:11:46.233346277 (343h1m21.003987612s) [seg_pos={0 0}, upload=274371]: Done begin upload segment. Jul 7 16:11:46.233366465 (343h1m21.0040078s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.233486575 (343h1m21.00412795s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.233717486 (343h1m21.004358821s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.234000157 (343h1m21.004641482s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.234236590 (343h1m21.004877925s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.234257029 (343h1m21.004898364s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.234522136 (343h1m21.005163471s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.234551382 (343h1m21.005192717s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.234845234 (343h1m21.005486569s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.235011733 (343h1m21.005653058s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.235220432 (343h1m21.005861767s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.235283693 (343h1m21.005925028s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.235499466 (343h1m21.006140801s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.235689650 (343h1m21.006330995s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.235705780 (343h1m21.006347105s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.236133539 (343h1m21.006774874s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:47.936497427 (343h1m22.707138762s) [upload=274371]: Next returned nil segment Jul 7 16:11:47.936516484 (343h1m22.707157819s) [upload=274371]: Waiting for error group managing segments... Jul 7 16:11:48.211479176 (343h1m22.982120511s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.211715508 (343h1m22.982356853s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.218504867 (343h1m22.989146203s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.230271649 (343h1m23.000912984s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.256583018 (343h1m23.027224353s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.257289389 (343h1m23.027930734s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.259657138 (343h1m23.030298474s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.259781777 (343h1m23.030423112s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.260572691 (343h1m23.031214026s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.265855147 (343h1m23.036496482s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.266546209 (343h1m23.037187544s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.277352043 (343h1m23.047993388s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.277897627 (343h1m23.048538962s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.277914017 (343h1m23.048555352s) [seg_pos={0 0}, upload=274371]: Segment reached optimal threshold of 13 pieces. Jul 7 16:11:48.278072831 (343h1m23.048714166s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 7 16:11:48.278154107 (343h1m23.048795442s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF Jul 7 16:11:48.278295267 (343h1m23.048936602s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Jul 7 16:11:48.278307922 (343h1m23.048949257s) [seg_pos={0 0}, upload=274371]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 16:11:48.278410327 (343h1m23.049051662s) [upload=274371]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 16:11:48.278415868 (343h1m23.049057203s) [upload=274371]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 16:11:48.561077279 (343h1m23.331718614s) [upload=274371]: Done uploading segments... Jul 7 16:11:48.561099671 (343h1m23.331741007s) [upload=274371]: Upload finished. err: <nil> Duration: 5.668798838s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [...................................XX.......................] duration: 1.919990859s FAIL (2025-07-07 16:31:03 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.920021918s core uplink us1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 15.630485ms target: https://ap1.storj.io/login FAIL (2025-07-07 16:31:01 UTC) orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused Duration: 15.661212ms core satellite ap1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 1.438853319s FAIL (2025-07-07 16:30:41 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.438899247s core uplink eu1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 19.274046ms target: https://ap1.storj.io/login FAIL (2025-07-07 16:30:27 UTC) orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused Duration: 19.300265ms core satellite ap1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 1.451941178s FAIL (2025-07-07 16:30:22 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.451996915s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [....................................XX......................] duration: 1.866605873s FAIL (2025-07-07 16:30:16 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.866647382s core uplink us1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 12.233486ms target: https://ap1.storj.io/login FAIL (2025-07-07 16:30:10 UTC) orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused Duration: 12.260717ms core satellite ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 5.680091721s FAIL (2025-07-07 16:30:02 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== ed piece hash; context canceled; EOF Jul 7 16:10:35.615412114 (343h0m10.386053449s) [noise=true , address=45.91.116.9:4262 , piece_id=OUDXQP247Y6NARLWHRRENVSU2IJSGEUF4XGPU4S2MTUVDE7ZLGKA, seg_pos={0 0}, upload=274352]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto): protocol: expected piece hash; context canceled; EOF Jul 7 16:10:35.615420931 (343h0m10.386062266s) [seg_pos={0 0}, upload=274352]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 16:10:35.615484472 (343h0m10.386125807s) [upload=274352]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 16:10:35.615488280 (343h0m10.386129615s) [upload=274352]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 16:10:35.906954897 (343h0m10.677596232s) [upload=274352]: Done uploading segments... Jul 7 16:10:35.906972671 (343h0m10.677614006s) [upload=274352]: Upload finished. err: <nil> Jul 7 16:11:45.999839306 (343h1m20.770480631s) [upload=274371]: Starting upload Jul 7 16:11:45.999947764 (343h1m20.770589109s) [upload=274371]: Done starting upload Jul 7 16:11:46.000045640 (343h1m20.770686985s) [upload=274371]: Uploading segments... Jul 7 16:11:46.000313703 (343h1m20.770955049s) [upload=274371]: Got next segment. Inline: false Jul 7 16:11:46.000362497 (343h1m20.771003902s) [upload=274371]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 7 16:11:46.000370652 (343h1m20.771012038s) [upload=274371]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 7 16:11:46.233304657 (343h1m21.003945992s) [seg_pos={0 0}, upload=274371]: Begin upload segment... Jul 7 16:11:46.233346277 (343h1m21.003987612s) [seg_pos={0 0}, upload=274371]: Done begin upload segment. Jul 7 16:11:46.233366465 (343h1m21.0040078s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.233486575 (343h1m21.00412795s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.233717486 (343h1m21.004358821s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.234000157 (343h1m21.004641482s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.234236590 (343h1m21.004877925s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.234257029 (343h1m21.004898364s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.234522136 (343h1m21.005163471s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.234551382 (343h1m21.005192717s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.234845234 (343h1m21.005486569s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.235011733 (343h1m21.005653058s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.235220432 (343h1m21.005861767s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.235283693 (343h1m21.005925028s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.235499466 (343h1m21.006140801s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.235689650 (343h1m21.006330995s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.235705780 (343h1m21.006347105s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.236133539 (343h1m21.006774874s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:47.936497427 (343h1m22.707138762s) [upload=274371]: Next returned nil segment Jul 7 16:11:47.936516484 (343h1m22.707157819s) [upload=274371]: Waiting for error group managing segments... Jul 7 16:11:48.211479176 (343h1m22.982120511s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.211715508 (343h1m22.982356853s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.218504867 (343h1m22.989146203s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.230271649 (343h1m23.000912984s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.256583018 (343h1m23.027224353s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.257289389 (343h1m23.027930734s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.259657138 (343h1m23.030298474s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.259781777 (343h1m23.030423112s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.260572691 (343h1m23.031214026s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.265855147 (343h1m23.036496482s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.266546209 (343h1m23.037187544s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.277352043 (343h1m23.047993388s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.277897627 (343h1m23.048538962s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.277914017 (343h1m23.048555352s) [seg_pos={0 0}, upload=274371]: Segment reached optimal threshold of 13 pieces. Jul 7 16:11:48.278072831 (343h1m23.048714166s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 7 16:11:48.278154107 (343h1m23.048795442s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF Jul 7 16:11:48.278295267 (343h1m23.048936602s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Jul 7 16:11:48.278307922 (343h1m23.048949257s) [seg_pos={0 0}, upload=274371]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 16:11:48.278410327 (343h1m23.049051662s) [upload=274371]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 16:11:48.278415868 (343h1m23.049057203s) [upload=274371]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 16:11:48.561077279 (343h1m23.331718614s) [upload=274371]: Done uploading segments... Jul 7 16:11:48.561099671 (343h1m23.331741007s) [upload=274371]: Upload finished. err: <nil> Duration: 5.680125346s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 5.504496345s FAIL (2025-07-07 16:29:41 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== ed piece hash; context canceled; EOF Jul 7 16:10:35.615412114 (343h0m10.386053449s) [noise=true , address=45.91.116.9:4262 , piece_id=OUDXQP247Y6NARLWHRRENVSU2IJSGEUF4XGPU4S2MTUVDE7ZLGKA, seg_pos={0 0}, upload=274352]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto): protocol: expected piece hash; context canceled; EOF Jul 7 16:10:35.615420931 (343h0m10.386062266s) [seg_pos={0 0}, upload=274352]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 16:10:35.615484472 (343h0m10.386125807s) [upload=274352]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 16:10:35.615488280 (343h0m10.386129615s) [upload=274352]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 16:10:35.906954897 (343h0m10.677596232s) [upload=274352]: Done uploading segments... Jul 7 16:10:35.906972671 (343h0m10.677614006s) [upload=274352]: Upload finished. err: <nil> Jul 7 16:11:45.999839306 (343h1m20.770480631s) [upload=274371]: Starting upload Jul 7 16:11:45.999947764 (343h1m20.770589109s) [upload=274371]: Done starting upload Jul 7 16:11:46.000045640 (343h1m20.770686985s) [upload=274371]: Uploading segments... Jul 7 16:11:46.000313703 (343h1m20.770955049s) [upload=274371]: Got next segment. Inline: false Jul 7 16:11:46.000362497 (343h1m20.771003902s) [upload=274371]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 7 16:11:46.000370652 (343h1m20.771012038s) [upload=274371]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 7 16:11:46.233304657 (343h1m21.003945992s) [seg_pos={0 0}, upload=274371]: Begin upload segment... Jul 7 16:11:46.233346277 (343h1m21.003987612s) [seg_pos={0 0}, upload=274371]: Done begin upload segment. Jul 7 16:11:46.233366465 (343h1m21.0040078s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.233486575 (343h1m21.00412795s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.233717486 (343h1m21.004358821s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.234000157 (343h1m21.004641482s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.234236590 (343h1m21.004877925s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.234257029 (343h1m21.004898364s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.234522136 (343h1m21.005163471s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.234551382 (343h1m21.005192717s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.234845234 (343h1m21.005486569s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.235011733 (343h1m21.005653058s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.235220432 (343h1m21.005861767s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.235283693 (343h1m21.005925028s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.235499466 (343h1m21.006140801s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.235689650 (343h1m21.006330995s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.235705780 (343h1m21.006347105s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.236133539 (343h1m21.006774874s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:47.936497427 (343h1m22.707138762s) [upload=274371]: Next returned nil segment Jul 7 16:11:47.936516484 (343h1m22.707157819s) [upload=274371]: Waiting for error group managing segments... Jul 7 16:11:48.211479176 (343h1m22.982120511s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.211715508 (343h1m22.982356853s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.218504867 (343h1m22.989146203s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.230271649 (343h1m23.000912984s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.256583018 (343h1m23.027224353s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.257289389 (343h1m23.027930734s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.259657138 (343h1m23.030298474s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.259781777 (343h1m23.030423112s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.260572691 (343h1m23.031214026s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.265855147 (343h1m23.036496482s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.266546209 (343h1m23.037187544s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.277352043 (343h1m23.047993388s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.277897627 (343h1m23.048538962s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.277914017 (343h1m23.048555352s) [seg_pos={0 0}, upload=274371]: Segment reached optimal threshold of 13 pieces. Jul 7 16:11:48.278072831 (343h1m23.048714166s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 7 16:11:48.278154107 (343h1m23.048795442s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF Jul 7 16:11:48.278295267 (343h1m23.048936602s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Jul 7 16:11:48.278307922 (343h1m23.048949257s) [seg_pos={0 0}, upload=274371]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 16:11:48.278410327 (343h1m23.049051662s) [upload=274371]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 16:11:48.278415868 (343h1m23.049057203s) [upload=274371]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 16:11:48.561077279 (343h1m23.331718614s) [upload=274371]: Done uploading segments... Jul 7 16:11:48.561099671 (343h1m23.331741007s) [upload=274371]: Upload finished. err: <nil> Duration: 5.50451991s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.....................................XX.....................] duration: 1.835636734s FAIL (2025-07-07 16:29:28 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.835663637s core uplink us1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 1.43627642s FAIL (2025-07-07 16:29:23 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.436305775s core uplink eu1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 11.062354ms target: https://ap1.storj.io/login FAIL (2025-07-07 16:29:04 UTC) orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused Duration: 11.082482ms core satellite ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [......................................XX....................] duration: 1.879004287s FAIL (2025-07-07 16:28:43 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.879033431s core uplink us1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 1.435071594s FAIL (2025-07-07 16:28:38 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.435100739s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 5.616237447s FAIL (2025-07-07 16:28:32 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== ed piece hash; context canceled; EOF Jul 7 16:10:35.615412114 (343h0m10.386053449s) [noise=true , address=45.91.116.9:4262 , piece_id=OUDXQP247Y6NARLWHRRENVSU2IJSGEUF4XGPU4S2MTUVDE7ZLGKA, seg_pos={0 0}, upload=274352]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto): protocol: expected piece hash; context canceled; EOF Jul 7 16:10:35.615420931 (343h0m10.386062266s) [seg_pos={0 0}, upload=274352]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 16:10:35.615484472 (343h0m10.386125807s) [upload=274352]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 16:10:35.615488280 (343h0m10.386129615s) [upload=274352]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 16:10:35.906954897 (343h0m10.677596232s) [upload=274352]: Done uploading segments... Jul 7 16:10:35.906972671 (343h0m10.677614006s) [upload=274352]: Upload finished. err: <nil> Jul 7 16:11:45.999839306 (343h1m20.770480631s) [upload=274371]: Starting upload Jul 7 16:11:45.999947764 (343h1m20.770589109s) [upload=274371]: Done starting upload Jul 7 16:11:46.000045640 (343h1m20.770686985s) [upload=274371]: Uploading segments... Jul 7 16:11:46.000313703 (343h1m20.770955049s) [upload=274371]: Got next segment. Inline: false Jul 7 16:11:46.000362497 (343h1m20.771003902s) [upload=274371]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 7 16:11:46.000370652 (343h1m20.771012038s) [upload=274371]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 7 16:11:46.233304657 (343h1m21.003945992s) [seg_pos={0 0}, upload=274371]: Begin upload segment... Jul 7 16:11:46.233346277 (343h1m21.003987612s) [seg_pos={0 0}, upload=274371]: Done begin upload segment. Jul 7 16:11:46.233366465 (343h1m21.0040078s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.233486575 (343h1m21.00412795s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.233717486 (343h1m21.004358821s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.234000157 (343h1m21.004641482s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.234236590 (343h1m21.004877925s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.234257029 (343h1m21.004898364s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.234522136 (343h1m21.005163471s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.234551382 (343h1m21.005192717s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.234845234 (343h1m21.005486569s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.235011733 (343h1m21.005653058s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.235220432 (343h1m21.005861767s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.235283693 (343h1m21.005925028s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.235499466 (343h1m21.006140801s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.235689650 (343h1m21.006330995s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.235705780 (343h1m21.006347105s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.236133539 (343h1m21.006774874s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:47.936497427 (343h1m22.707138762s) [upload=274371]: Next returned nil segment Jul 7 16:11:47.936516484 (343h1m22.707157819s) [upload=274371]: Waiting for error group managing segments... Jul 7 16:11:48.211479176 (343h1m22.982120511s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.211715508 (343h1m22.982356853s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.218504867 (343h1m22.989146203s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.230271649 (343h1m23.000912984s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.256583018 (343h1m23.027224353s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.257289389 (343h1m23.027930734s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.259657138 (343h1m23.030298474s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.259781777 (343h1m23.030423112s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.260572691 (343h1m23.031214026s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.265855147 (343h1m23.036496482s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.266546209 (343h1m23.037187544s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.277352043 (343h1m23.047993388s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.277897627 (343h1m23.048538962s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.277914017 (343h1m23.048555352s) [seg_pos={0 0}, upload=274371]: Segment reached optimal threshold of 13 pieces. Jul 7 16:11:48.278072831 (343h1m23.048714166s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 7 16:11:48.278154107 (343h1m23.048795442s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF Jul 7 16:11:48.278295267 (343h1m23.048936602s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Jul 7 16:11:48.278307922 (343h1m23.048949257s) [seg_pos={0 0}, upload=274371]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 16:11:48.278410327 (343h1m23.049051662s) [upload=274371]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 16:11:48.278415868 (343h1m23.049057203s) [upload=274371]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 16:11:48.561077279 (343h1m23.331718614s) [upload=274371]: Done uploading segments... Jul 7 16:11:48.561099671 (343h1m23.331741007s) [upload=274371]: Upload finished. err: <nil> Duration: 5.616263769s core uplink us-select-1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 12.87905ms target: https://ap1.storj.io/login FAIL (2025-07-07 16:28:23 UTC) orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused Duration: 12.900622ms core satellite ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.......................................XX...................] duration: 1.848995904s FAIL (2025-07-07 16:27:58 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.849023116s core uplink us1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 1.439948244s FAIL (2025-07-07 16:27:58 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.439975938s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 5.684557716s FAIL (2025-07-07 16:27:48 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== ed piece hash; context canceled; EOF Jul 7 16:10:35.615412114 (343h0m10.386053449s) [noise=true , address=45.91.116.9:4262 , piece_id=OUDXQP247Y6NARLWHRRENVSU2IJSGEUF4XGPU4S2MTUVDE7ZLGKA, seg_pos={0 0}, upload=274352]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto): protocol: expected piece hash; context canceled; EOF Jul 7 16:10:35.615420931 (343h0m10.386062266s) [seg_pos={0 0}, upload=274352]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 16:10:35.615484472 (343h0m10.386125807s) [upload=274352]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 16:10:35.615488280 (343h0m10.386129615s) [upload=274352]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 16:10:35.906954897 (343h0m10.677596232s) [upload=274352]: Done uploading segments... Jul 7 16:10:35.906972671 (343h0m10.677614006s) [upload=274352]: Upload finished. err: <nil> Jul 7 16:11:45.999839306 (343h1m20.770480631s) [upload=274371]: Starting upload Jul 7 16:11:45.999947764 (343h1m20.770589109s) [upload=274371]: Done starting upload Jul 7 16:11:46.000045640 (343h1m20.770686985s) [upload=274371]: Uploading segments... Jul 7 16:11:46.000313703 (343h1m20.770955049s) [upload=274371]: Got next segment. Inline: false Jul 7 16:11:46.000362497 (343h1m20.771003902s) [upload=274371]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 7 16:11:46.000370652 (343h1m20.771012038s) [upload=274371]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 7 16:11:46.233304657 (343h1m21.003945992s) [seg_pos={0 0}, upload=274371]: Begin upload segment... Jul 7 16:11:46.233346277 (343h1m21.003987612s) [seg_pos={0 0}, upload=274371]: Done begin upload segment. Jul 7 16:11:46.233366465 (343h1m21.0040078s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.233486575 (343h1m21.00412795s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.233717486 (343h1m21.004358821s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.234000157 (343h1m21.004641482s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.234236590 (343h1m21.004877925s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.234257029 (343h1m21.004898364s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.234522136 (343h1m21.005163471s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.234551382 (343h1m21.005192717s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.234845234 (343h1m21.005486569s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.235011733 (343h1m21.005653058s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.235220432 (343h1m21.005861767s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.235283693 (343h1m21.005925028s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.235499466 (343h1m21.006140801s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.235689650 (343h1m21.006330995s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.235705780 (343h1m21.006347105s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.236133539 (343h1m21.006774874s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:47.936497427 (343h1m22.707138762s) [upload=274371]: Next returned nil segment Jul 7 16:11:47.936516484 (343h1m22.707157819s) [upload=274371]: Waiting for error group managing segments... Jul 7 16:11:48.211479176 (343h1m22.982120511s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.211715508 (343h1m22.982356853s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.218504867 (343h1m22.989146203s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.230271649 (343h1m23.000912984s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.256583018 (343h1m23.027224353s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.257289389 (343h1m23.027930734s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.259657138 (343h1m23.030298474s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.259781777 (343h1m23.030423112s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.260572691 (343h1m23.031214026s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.265855147 (343h1m23.036496482s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.266546209 (343h1m23.037187544s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.277352043 (343h1m23.047993388s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.277897627 (343h1m23.048538962s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.277914017 (343h1m23.048555352s) [seg_pos={0 0}, upload=274371]: Segment reached optimal threshold of 13 pieces. Jul 7 16:11:48.278072831 (343h1m23.048714166s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 7 16:11:48.278154107 (343h1m23.048795442s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF Jul 7 16:11:48.278295267 (343h1m23.048936602s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Jul 7 16:11:48.278307922 (343h1m23.048949257s) [seg_pos={0 0}, upload=274371]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 16:11:48.278410327 (343h1m23.049051662s) [upload=274371]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 16:11:48.278415868 (343h1m23.049057203s) [upload=274371]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 16:11:48.561077279 (343h1m23.331718614s) [upload=274371]: Done uploading segments... Jul 7 16:11:48.561099671 (343h1m23.331741007s) [upload=274371]: Upload finished. err: <nil> Duration: 5.684590358s core uplink us-select-1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 16.392832ms target: https://ap1.storj.io/login FAIL (2025-07-07 16:27:37 UTC) orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused Duration: 16.425474ms core satellite ap1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 1.429670559s FAIL (2025-07-07 16:27:30 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.429695298s core uplink eu1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 14.367236ms target: https://ap1.storj.io/login FAIL (2025-07-07 16:27:13 UTC) orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused Duration: 14.397785ms core satellite ap1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 1.426483785s FAIL (2025-07-07 16:26:55 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.426510225s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 5.524551029s FAIL (2025-07-07 16:26:54 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== ed piece hash; context canceled; EOF Jul 7 16:10:35.615412114 (343h0m10.386053449s) [noise=true , address=45.91.116.9:4262 , piece_id=OUDXQP247Y6NARLWHRRENVSU2IJSGEUF4XGPU4S2MTUVDE7ZLGKA, seg_pos={0 0}, upload=274352]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto): protocol: expected piece hash; context canceled; EOF Jul 7 16:10:35.615420931 (343h0m10.386062266s) [seg_pos={0 0}, upload=274352]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 16:10:35.615484472 (343h0m10.386125807s) [upload=274352]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 16:10:35.615488280 (343h0m10.386129615s) [upload=274352]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 16:10:35.906954897 (343h0m10.677596232s) [upload=274352]: Done uploading segments... Jul 7 16:10:35.906972671 (343h0m10.677614006s) [upload=274352]: Upload finished. err: <nil> Jul 7 16:11:45.999839306 (343h1m20.770480631s) [upload=274371]: Starting upload Jul 7 16:11:45.999947764 (343h1m20.770589109s) [upload=274371]: Done starting upload Jul 7 16:11:46.000045640 (343h1m20.770686985s) [upload=274371]: Uploading segments... Jul 7 16:11:46.000313703 (343h1m20.770955049s) [upload=274371]: Got next segment. Inline: false Jul 7 16:11:46.000362497 (343h1m20.771003902s) [upload=274371]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 7 16:11:46.000370652 (343h1m20.771012038s) [upload=274371]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 7 16:11:46.233304657 (343h1m21.003945992s) [seg_pos={0 0}, upload=274371]: Begin upload segment... Jul 7 16:11:46.233346277 (343h1m21.003987612s) [seg_pos={0 0}, upload=274371]: Done begin upload segment. Jul 7 16:11:46.233366465 (343h1m21.0040078s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.233486575 (343h1m21.00412795s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.233717486 (343h1m21.004358821s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.234000157 (343h1m21.004641482s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.234236590 (343h1m21.004877925s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.234257029 (343h1m21.004898364s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.234522136 (343h1m21.005163471s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.234551382 (343h1m21.005192717s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.234845234 (343h1m21.005486569s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.235011733 (343h1m21.005653058s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.235220432 (343h1m21.005861767s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.235283693 (343h1m21.005925028s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.235499466 (343h1m21.006140801s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.235689650 (343h1m21.006330995s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.235705780 (343h1m21.006347105s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.236133539 (343h1m21.006774874s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:47.936497427 (343h1m22.707138762s) [upload=274371]: Next returned nil segment Jul 7 16:11:47.936516484 (343h1m22.707157819s) [upload=274371]: Waiting for error group managing segments... Jul 7 16:11:48.211479176 (343h1m22.982120511s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.211715508 (343h1m22.982356853s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.218504867 (343h1m22.989146203s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.230271649 (343h1m23.000912984s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.256583018 (343h1m23.027224353s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.257289389 (343h1m23.027930734s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.259657138 (343h1m23.030298474s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.259781777 (343h1m23.030423112s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.260572691 (343h1m23.031214026s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.265855147 (343h1m23.036496482s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.266546209 (343h1m23.037187544s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.277352043 (343h1m23.047993388s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.277897627 (343h1m23.048538962s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.277914017 (343h1m23.048555352s) [seg_pos={0 0}, upload=274371]: Segment reached optimal threshold of 13 pieces. Jul 7 16:11:48.278072831 (343h1m23.048714166s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 7 16:11:48.278154107 (343h1m23.048795442s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF Jul 7 16:11:48.278295267 (343h1m23.048936602s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Jul 7 16:11:48.278307922 (343h1m23.048949257s) [seg_pos={0 0}, upload=274371]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 16:11:48.278410327 (343h1m23.049051662s) [upload=274371]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 16:11:48.278415868 (343h1m23.049057203s) [upload=274371]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 16:11:48.561077279 (343h1m23.331718614s) [upload=274371]: Done uploading segments... Jul 7 16:11:48.561099671 (343h1m23.331741007s) [upload=274371]: Upload finished. err: <nil> Duration: 5.524578s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [........................................XX..................] duration: 1.882454295s FAIL (2025-07-07 16:26:49 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.882478962s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.........................................XX.................] duration: 1.882849251s FAIL (2025-07-07 16:26:34 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.882876173s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 5.603684902s FAIL (2025-07-07 16:26:31 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== ed piece hash; context canceled; EOF Jul 7 16:10:35.615412114 (343h0m10.386053449s) [noise=true , address=45.91.116.9:4262 , piece_id=OUDXQP247Y6NARLWHRRENVSU2IJSGEUF4XGPU4S2MTUVDE7ZLGKA, seg_pos={0 0}, upload=274352]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto): protocol: expected piece hash; context canceled; EOF Jul 7 16:10:35.615420931 (343h0m10.386062266s) [seg_pos={0 0}, upload=274352]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 16:10:35.615484472 (343h0m10.386125807s) [upload=274352]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 16:10:35.615488280 (343h0m10.386129615s) [upload=274352]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 16:10:35.906954897 (343h0m10.677596232s) [upload=274352]: Done uploading segments... Jul 7 16:10:35.906972671 (343h0m10.677614006s) [upload=274352]: Upload finished. err: <nil> Jul 7 16:11:45.999839306 (343h1m20.770480631s) [upload=274371]: Starting upload Jul 7 16:11:45.999947764 (343h1m20.770589109s) [upload=274371]: Done starting upload Jul 7 16:11:46.000045640 (343h1m20.770686985s) [upload=274371]: Uploading segments... Jul 7 16:11:46.000313703 (343h1m20.770955049s) [upload=274371]: Got next segment. Inline: false Jul 7 16:11:46.000362497 (343h1m20.771003902s) [upload=274371]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 7 16:11:46.000370652 (343h1m20.771012038s) [upload=274371]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 7 16:11:46.233304657 (343h1m21.003945992s) [seg_pos={0 0}, upload=274371]: Begin upload segment... Jul 7 16:11:46.233346277 (343h1m21.003987612s) [seg_pos={0 0}, upload=274371]: Done begin upload segment. Jul 7 16:11:46.233366465 (343h1m21.0040078s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.233486575 (343h1m21.00412795s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.233717486 (343h1m21.004358821s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.234000157 (343h1m21.004641482s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.234236590 (343h1m21.004877925s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.234257029 (343h1m21.004898364s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.234522136 (343h1m21.005163471s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.234551382 (343h1m21.005192717s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.234845234 (343h1m21.005486569s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.235011733 (343h1m21.005653058s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.235220432 (343h1m21.005861767s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.235283693 (343h1m21.005925028s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.235499466 (343h1m21.006140801s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.235689650 (343h1m21.006330995s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.235705780 (343h1m21.006347105s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:46.236133539 (343h1m21.006774874s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Uploading piece... Jul 7 16:11:47.936497427 (343h1m22.707138762s) [upload=274371]: Next returned nil segment Jul 7 16:11:47.936516484 (343h1m22.707157819s) [upload=274371]: Waiting for error group managing segments... Jul 7 16:11:48.211479176 (343h1m22.982120511s) [noise=true , address=104.36.82.8:4971 , piece_id=TXCUZWGNXTDWVQECJLDPHLWG53WT3A6GAYZSWU4KEMEVMDRQUULA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.211715508 (343h1m22.982356853s) [noise=true , address=104.36.82.13:4186 , piece_id=ERLPVSVB7LB37NB5A3ZOTCOZYGFQPN33NF5VUUM4UWHJAUID2NHA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.218504867 (343h1m22.989146203s) [noise=true , address=104.36.82.4:4804 , piece_id=NCOYAICFNWEPXVJ67KKURT5DJOEBZVPAHHRZ3KIUQPPFM35HXQGA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.230271649 (343h1m23.000912984s) [noise=true , address=104.36.82.7:4910 , piece_id=SKNP27C6DB3T2KC4PJHF2YBUNKBJNH7XKPMIBJANFH7JF2AMNMVQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.256583018 (343h1m23.027224353s) [noise=true , address=45.91.116.13:4153 , piece_id=WY7UKENTU4NJONPLDDWQYRRQMWMSILD64FQLDMLUND7IDNPJ3FNQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.257289389 (343h1m23.027930734s) [noise=true , address=45.91.116.7:4011 , piece_id=B4OLUXSFCKVA64PM2Y6D4TFYAEY7M2RMDDQLZYS674FOSUB3K3BQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.259657138 (343h1m23.030298474s) [noise=true , address=77.90.31.16:4734 , piece_id=YMPRYAFL7MSTNSRQS36IFQYZ7P24NF7UH65FT2YR3DEQFHESUVBQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.259781777 (343h1m23.030423112s) [noise=true , address=77.90.31.18:4805 , piece_id=MDBFHRONAXAXZGP7GLHGJHJR6QISF6W6UMKZ6IUB2OBQ2MS2NDEQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.260572691 (343h1m23.031214026s) [noise=true , address=77.90.31.21:4879 , piece_id=QEJVRKERTIED5MG36DWNIP23IGEFVCRBPMYOG4KMPCERD6XSLQXQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.265855147 (343h1m23.036496482s) [noise=true , address=104.36.82.10:4079 , piece_id=X3RVNNTJ3NAROO6WJMIY4SJFX2QODD3GEKKYRSSAKW6STSE6UPQA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.266546209 (343h1m23.037187544s) [noise=true , address=77.90.31.19:4842 , piece_id=OGCPQDGZ7QKRZNNXX2WI2SQDMXXBQ3OKCV6X2E5O2ASPPSA57VPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.277352043 (343h1m23.047993388s) [noise=true , address=104.36.82.11:4113 , piece_id=MFWDDGLV4VR3DCMUFL4AFCSEVAEE2LYYQVMW22H35U6YS4HI25JQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.277897627 (343h1m23.048538962s) [noise=true , address=77.90.31.10:4517 , piece_id=VDQ5KVIORFE4WII5KEE5AU65KYTZ7PIOF7AFGF7XWJ325IKBCTWQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: <nil> Jul 7 16:11:48.277914017 (343h1m23.048555352s) [seg_pos={0 0}, upload=274371]: Segment reached optimal threshold of 13 pieces. Jul 7 16:11:48.278072831 (343h1m23.048714166s) [noise=true , address=45.91.116.6:4975 , piece_id=7VFT6NDRISMGBGQHL4GBCJHGLNV4MEDSF2AH44UR3EXTOLS3XBPA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 7 16:11:48.278154107 (343h1m23.048795442s) [noise=true , address=45.91.116.5:4299 , piece_id=JKXQB5PYKYYDRNFILZRODEB4S5WZ7XXTODRUH7WF2YUBHG2XVLNA, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF Jul 7 16:11:48.278295267 (343h1m23.048936602s) [noise=true , address=77.90.31.17:4770 , piece_id=ICCTTDULCPSGQ56WMD7NEIDQZLKWGMTIK6VLVX4IZ3I5BHNFRUIQ, seg_pos={0 0}, upload=274371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Jul 7 16:11:48.278307922 (343h1m23.048949257s) [seg_pos={0 0}, upload=274371]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 16:11:48.278410327 (343h1m23.049051662s) [upload=274371]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 16:11:48.278415868 (343h1m23.049057203s) [upload=274371]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 16:11:48.561077279 (343h1m23.331718614s) [upload=274371]: Done uploading segments... Jul 7 16:11:48.561099671 (343h1m23.331741007s) [upload=274371]: Upload finished. err: <nil> Duration: 5.603703016s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 1.419914126s FAIL (2025-07-07 16:26:27 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.41994778s core uplink eu1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 15.053931ms target: https://ap1.storj.io/login FAIL (2025-07-07 16:26:22 UTC) orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused Duration: 15.080091ms core satellite ap1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)