Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
5.53665135s
FAIL (2025-07-07 05:26:16 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
65483]: Got next segment. Inline: false
Jul 7 05:04:06.097422800 (331h53m40.868064135s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:04:06.097428120 (331h53m40.868069445s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:04:06.623732228 (331h53m41.394373563s) [seg_pos={0 0}, upload=265483]: Begin upload segment...
Jul 7 05:04:06.623774189 (331h53m41.394415524s) [seg_pos={0 0}, upload=265483]: Done begin upload segment.
Jul 7 05:04:06.623795539 (331h53m41.394436874s) [noise=true , address=77.90.31.14:4674 , piece_id=KUGSISFXDEFATV2BHKW34NREXENVYMNZRSM3VTXHCZOLBWYCO3IA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.623850364 (331h53m41.394491699s) [noise=true , address=77.90.31.17:4801 , piece_id=DHPU2ISCQWL6TOZQED7BG6JJ5DYRJW5FAYO4MGLB3KEOLVNC3CFA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624347755 (331h53m41.39498909s) [noise=true , address=77.90.31.16:4751 , piece_id=DQNZ6VYCO2WPLAT7CGMQOTIRXLLJTYRCUCVLI3RJZCYUZT3F6YXQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624383835 (331h53m41.39502517s) [noise=true , address=104.36.82.14:4248 , piece_id=GQVC4QYUSXVHM3WZ3OT7XSB42HEOEWHYVBMVGQVSMDFINDON6BSA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624634515 (331h53m41.39527585s) [noise=true , address=45.91.116.9:4264 , piece_id=BAUPMJNTKX5S6NGVZYISJH5EJIVMVICZP4PNUKM6D525UNKAJBUA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624844035 (331h53m41.39548537s) [noise=true , address=104.36.82.45:4927 , piece_id=6ZFIELGIKBDL2IKSE7EQP25Z7HPBP4GRSF5Y2YXUWZX54RV3ZAFA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624903259 (331h53m41.395544594s) [noise=true , address=104.36.82.18:4397 , piece_id=VF4FXOENNLGT3N7ZJ3T7EPYEW6H3YS4ZKHHQJSNLJYOCMGFXVZDQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625117729 (331h53m41.395759064s) [noise=true , address=64.49.13.27:4966 , piece_id=HPG7X2LX5N5CJHAQAWM6JKYHAOPOWRPUXEVWT4SDGYJKPKN2TRKA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625170019 (331h53m41.395811354s) [noise=true , address=104.36.82.5:4855 , piece_id=5JPBSZRWWMGKSECM2XBHVQUT3F4U7JXCVXFKYKEJD27W3C5PCWNQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625343822 (331h53m41.395985157s) [noise=true , address=104.36.82.12:4173 , piece_id=5HUGZCEFE3JCGN4PUHPP4IGVCRN2R4KHPIBQJUUTAEGOLDISXF4Q, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625394227 (331h53m41.396035563s) [noise=true , address=64.49.13.154:4932 , piece_id=4CXUMWUQ37E5ATJKWKIABQKZID2G5PRB563D3LAQTIWCZOLYI76Q, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625563120 (331h53m41.396204456s) [noise=true , address=104.36.82.3:4773 , piece_id=I2XCDVOZ5RWEMWJCBM5FATOKDCUZJFC7G2KTFILU66LJU7NLC5RQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625612635 (331h53m41.39625397s) [noise=true , address=64.49.13.140:4510 , piece_id=SUB4NNB6ZG7TGV76LBI37SUS4FYVH2LBU4DXHPRESLBDDHZHHEPA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625788693 (331h53m41.396430028s) [noise=true , address=77.90.31.16:4748 , piece_id=DRUW5HWKQF3LY5AXUQBD4MC2K2TMHJHXBDOP5DRL5WCSIV6KZDHA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625854649 (331h53m41.396495984s) [noise=true , address=104.36.82.21:4479 , piece_id=56PCCZDSZH545QXGLGRZN2IUDPIF6MTHKAULXZYVAV6BOAE632YQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626075631 (331h53m41.396716966s) [noise=true , address=77.90.31.10:4540 , piece_id=3MKHY4HDZSK5YOPP5HYVMEOWWEGDCJUPYEUW2TFPOSATOT2FMWQA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626273520 (331h53m41.396914855s) [noise=true , address=104.36.82.23:4470 , piece_id=Y3NJ45DLDTZSHKMHTANQ6VTL3BX46Y2LD2QGBK5S5SLAFDJBGPSQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626467301 (331h53m41.397108636s) [noise=true , address=77.90.31.21:4903 , piece_id=JWQTRU7GLKHFXFBV2KYINTA2SEAUNDWTXER2XLNYIBXNC3KWF5ZA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:07.724567296 (331h53m42.495208631s) [upload=265483]: Next returned nil segment
Jul 7 05:04:07.724584218 (331h53m42.495225543s) [upload=265483]: Waiting for error group managing segments...
Jul 7 05:04:08.028542246 (331h53m42.799183581s) [noise=true , address=64.49.13.27:4966 , piece_id=HPG7X2LX5N5CJHAQAWM6JKYHAOPOWRPUXEVWT4SDGYJKPKN2TRKA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.070346103 (331h53m42.840987438s) [noise=true , address=64.49.13.140:4510 , piece_id=SUB4NNB6ZG7TGV76LBI37SUS4FYVH2LBU4DXHPRESLBDDHZHHEPA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.095032022 (331h53m42.865673367s) [noise=true , address=64.49.13.154:4932 , piece_id=4CXUMWUQ37E5ATJKWKIABQKZID2G5PRB563D3LAQTIWCZOLYI76Q, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.428652819 (331h53m43.199294155s) [noise=true , address=104.36.82.18:4397 , piece_id=VF4FXOENNLGT3N7ZJ3T7EPYEW6H3YS4ZKHHQJSNLJYOCMGFXVZDQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.448309175 (331h53m43.21895051s) [noise=true , address=104.36.82.3:4773 , piece_id=I2XCDVOZ5RWEMWJCBM5FATOKDCUZJFC7G2KTFILU66LJU7NLC5RQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.460440203 (331h53m43.231081538s) [noise=true , address=104.36.82.45:4927 , piece_id=6ZFIELGIKBDL2IKSE7EQP25Z7HPBP4GRSF5Y2YXUWZX54RV3ZAFA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.462441062 (331h53m43.233082407s) [noise=true , address=104.36.82.21:4479 , piece_id=56PCCZDSZH545QXGLGRZN2IUDPIF6MTHKAULXZYVAV6BOAE632YQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.479297731 (331h53m43.249939056s) [noise=true , address=104.36.82.23:4470 , piece_id=Y3NJ45DLDTZSHKMHTANQ6VTL3BX46Y2LD2QGBK5S5SLAFDJBGPSQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.505733477 (331h53m43.276374812s) [noise=true , address=104.36.82.12:4173 , piece_id=5HUGZCEFE3JCGN4PUHPP4IGVCRN2R4KHPIBQJUUTAEGOLDISXF4Q, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.574289655 (331h53m43.34493099s) [noise=true , address=104.36.82.14:4248 , piece_id=GQVC4QYUSXVHM3WZ3OT7XSB42HEOEWHYVBMVGQVSMDFINDON6BSA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.577275016 (331h53m43.347916351s) [noise=true , address=77.90.31.10:4540 , piece_id=3MKHY4HDZSK5YOPP5HYVMEOWWEGDCJUPYEUW2TFPOSATOT2FMWQA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.577418831 (331h53m43.348060166s) [noise=true , address=77.90.31.16:4751 , piece_id=DQNZ6VYCO2WPLAT7CGMQOTIRXLLJTYRCUCVLI3RJZCYUZT3F6YXQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.579017850 (331h53m43.349659185s) [noise=true , address=77.90.31.16:4748 , piece_id=DRUW5HWKQF3LY5AXUQBD4MC2K2TMHJHXBDOP5DRL5WCSIV6KZDHA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.580192378 (331h53m43.350833713s) [noise=true , address=77.90.31.14:4674 , piece_id=KUGSISFXDEFATV2BHKW34NREXENVYMNZRSM3VTXHCZOLBWYCO3IA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.580210843 (331h53m43.350852178s) [seg_pos={0 0}, upload=265483]: Segment reached optimal threshold of 14 pieces.
Jul 7 05:04:08.580342875 (331h53m43.35098421s) [noise=true , address=77.90.31.21:4903 , piece_id=JWQTRU7GLKHFXFBV2KYINTA2SEAUNDWTXER2XLNYIBXNC3KWF5ZA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZYWQ1a2sTKnFpF28iQVrem2s8nSpXkeJzZDaS7jvTZNANdfp): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580430292 (331h53m43.351071627s) [noise=true , address=45.91.116.9:4264 , piece_id=BAUPMJNTKX5S6NGVZYISJH5EJIVMVICZP4PNUKM6D525UNKAJBUA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128f6i7ALVXF3Vr8G8zsZXrNBFiT3cK8UAiic5XbFS1gRjZK86m): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580552847 (331h53m43.351194172s) [noise=true , address=77.90.31.17:4801 , piece_id=DHPU2ISCQWL6TOZQED7BG6JJ5DYRJW5FAYO4MGLB3KEOLVNC3CFA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127QRLNwZLcR5gnAgZrCjSUsH5T4jESmZ4kWeAnpj9YxaTSjoYe): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580638251 (331h53m43.351279586s) [noise=true , address=104.36.82.5:4855 , piece_id=5JPBSZRWWMGKSECM2XBHVQUT3F4U7JXCVXFKYKEJD27W3C5PCWNQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection; write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection
Jul 7 05:04:08.580668078 (331h53m43.351309413s) [seg_pos={0 0}, upload=265483]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 7 05:04:08.580803337 (331h53m43.351444672s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:04:08.580809508 (331h53m43.351450843s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:04:08.869629195 (331h53m43.64027053s) [upload=265483]: Done uploading segments...
Jul 7 05:04:08.869647730 (331h53m43.640289065s) [upload=265483]: Upload finished. err: <nil>
Duration: 5.53667694s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
5.671625868s
FAIL (2025-07-07 05:25:26 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 5.671649181s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
5.590418194s
FAIL (2025-07-07 05:25:04 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
65483]: Got next segment. Inline: false
Jul 7 05:04:06.097422800 (331h53m40.868064135s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:04:06.097428120 (331h53m40.868069445s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:04:06.623732228 (331h53m41.394373563s) [seg_pos={0 0}, upload=265483]: Begin upload segment...
Jul 7 05:04:06.623774189 (331h53m41.394415524s) [seg_pos={0 0}, upload=265483]: Done begin upload segment.
Jul 7 05:04:06.623795539 (331h53m41.394436874s) [noise=true , address=77.90.31.14:4674 , piece_id=KUGSISFXDEFATV2BHKW34NREXENVYMNZRSM3VTXHCZOLBWYCO3IA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.623850364 (331h53m41.394491699s) [noise=true , address=77.90.31.17:4801 , piece_id=DHPU2ISCQWL6TOZQED7BG6JJ5DYRJW5FAYO4MGLB3KEOLVNC3CFA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624347755 (331h53m41.39498909s) [noise=true , address=77.90.31.16:4751 , piece_id=DQNZ6VYCO2WPLAT7CGMQOTIRXLLJTYRCUCVLI3RJZCYUZT3F6YXQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624383835 (331h53m41.39502517s) [noise=true , address=104.36.82.14:4248 , piece_id=GQVC4QYUSXVHM3WZ3OT7XSB42HEOEWHYVBMVGQVSMDFINDON6BSA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624634515 (331h53m41.39527585s) [noise=true , address=45.91.116.9:4264 , piece_id=BAUPMJNTKX5S6NGVZYISJH5EJIVMVICZP4PNUKM6D525UNKAJBUA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624844035 (331h53m41.39548537s) [noise=true , address=104.36.82.45:4927 , piece_id=6ZFIELGIKBDL2IKSE7EQP25Z7HPBP4GRSF5Y2YXUWZX54RV3ZAFA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624903259 (331h53m41.395544594s) [noise=true , address=104.36.82.18:4397 , piece_id=VF4FXOENNLGT3N7ZJ3T7EPYEW6H3YS4ZKHHQJSNLJYOCMGFXVZDQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625117729 (331h53m41.395759064s) [noise=true , address=64.49.13.27:4966 , piece_id=HPG7X2LX5N5CJHAQAWM6JKYHAOPOWRPUXEVWT4SDGYJKPKN2TRKA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625170019 (331h53m41.395811354s) [noise=true , address=104.36.82.5:4855 , piece_id=5JPBSZRWWMGKSECM2XBHVQUT3F4U7JXCVXFKYKEJD27W3C5PCWNQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625343822 (331h53m41.395985157s) [noise=true , address=104.36.82.12:4173 , piece_id=5HUGZCEFE3JCGN4PUHPP4IGVCRN2R4KHPIBQJUUTAEGOLDISXF4Q, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625394227 (331h53m41.396035563s) [noise=true , address=64.49.13.154:4932 , piece_id=4CXUMWUQ37E5ATJKWKIABQKZID2G5PRB563D3LAQTIWCZOLYI76Q, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625563120 (331h53m41.396204456s) [noise=true , address=104.36.82.3:4773 , piece_id=I2XCDVOZ5RWEMWJCBM5FATOKDCUZJFC7G2KTFILU66LJU7NLC5RQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625612635 (331h53m41.39625397s) [noise=true , address=64.49.13.140:4510 , piece_id=SUB4NNB6ZG7TGV76LBI37SUS4FYVH2LBU4DXHPRESLBDDHZHHEPA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625788693 (331h53m41.396430028s) [noise=true , address=77.90.31.16:4748 , piece_id=DRUW5HWKQF3LY5AXUQBD4MC2K2TMHJHXBDOP5DRL5WCSIV6KZDHA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625854649 (331h53m41.396495984s) [noise=true , address=104.36.82.21:4479 , piece_id=56PCCZDSZH545QXGLGRZN2IUDPIF6MTHKAULXZYVAV6BOAE632YQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626075631 (331h53m41.396716966s) [noise=true , address=77.90.31.10:4540 , piece_id=3MKHY4HDZSK5YOPP5HYVMEOWWEGDCJUPYEUW2TFPOSATOT2FMWQA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626273520 (331h53m41.396914855s) [noise=true , address=104.36.82.23:4470 , piece_id=Y3NJ45DLDTZSHKMHTANQ6VTL3BX46Y2LD2QGBK5S5SLAFDJBGPSQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626467301 (331h53m41.397108636s) [noise=true , address=77.90.31.21:4903 , piece_id=JWQTRU7GLKHFXFBV2KYINTA2SEAUNDWTXER2XLNYIBXNC3KWF5ZA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:07.724567296 (331h53m42.495208631s) [upload=265483]: Next returned nil segment
Jul 7 05:04:07.724584218 (331h53m42.495225543s) [upload=265483]: Waiting for error group managing segments...
Jul 7 05:04:08.028542246 (331h53m42.799183581s) [noise=true , address=64.49.13.27:4966 , piece_id=HPG7X2LX5N5CJHAQAWM6JKYHAOPOWRPUXEVWT4SDGYJKPKN2TRKA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.070346103 (331h53m42.840987438s) [noise=true , address=64.49.13.140:4510 , piece_id=SUB4NNB6ZG7TGV76LBI37SUS4FYVH2LBU4DXHPRESLBDDHZHHEPA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.095032022 (331h53m42.865673367s) [noise=true , address=64.49.13.154:4932 , piece_id=4CXUMWUQ37E5ATJKWKIABQKZID2G5PRB563D3LAQTIWCZOLYI76Q, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.428652819 (331h53m43.199294155s) [noise=true , address=104.36.82.18:4397 , piece_id=VF4FXOENNLGT3N7ZJ3T7EPYEW6H3YS4ZKHHQJSNLJYOCMGFXVZDQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.448309175 (331h53m43.21895051s) [noise=true , address=104.36.82.3:4773 , piece_id=I2XCDVOZ5RWEMWJCBM5FATOKDCUZJFC7G2KTFILU66LJU7NLC5RQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.460440203 (331h53m43.231081538s) [noise=true , address=104.36.82.45:4927 , piece_id=6ZFIELGIKBDL2IKSE7EQP25Z7HPBP4GRSF5Y2YXUWZX54RV3ZAFA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.462441062 (331h53m43.233082407s) [noise=true , address=104.36.82.21:4479 , piece_id=56PCCZDSZH545QXGLGRZN2IUDPIF6MTHKAULXZYVAV6BOAE632YQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.479297731 (331h53m43.249939056s) [noise=true , address=104.36.82.23:4470 , piece_id=Y3NJ45DLDTZSHKMHTANQ6VTL3BX46Y2LD2QGBK5S5SLAFDJBGPSQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.505733477 (331h53m43.276374812s) [noise=true , address=104.36.82.12:4173 , piece_id=5HUGZCEFE3JCGN4PUHPP4IGVCRN2R4KHPIBQJUUTAEGOLDISXF4Q, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.574289655 (331h53m43.34493099s) [noise=true , address=104.36.82.14:4248 , piece_id=GQVC4QYUSXVHM3WZ3OT7XSB42HEOEWHYVBMVGQVSMDFINDON6BSA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.577275016 (331h53m43.347916351s) [noise=true , address=77.90.31.10:4540 , piece_id=3MKHY4HDZSK5YOPP5HYVMEOWWEGDCJUPYEUW2TFPOSATOT2FMWQA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.577418831 (331h53m43.348060166s) [noise=true , address=77.90.31.16:4751 , piece_id=DQNZ6VYCO2WPLAT7CGMQOTIRXLLJTYRCUCVLI3RJZCYUZT3F6YXQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.579017850 (331h53m43.349659185s) [noise=true , address=77.90.31.16:4748 , piece_id=DRUW5HWKQF3LY5AXUQBD4MC2K2TMHJHXBDOP5DRL5WCSIV6KZDHA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.580192378 (331h53m43.350833713s) [noise=true , address=77.90.31.14:4674 , piece_id=KUGSISFXDEFATV2BHKW34NREXENVYMNZRSM3VTXHCZOLBWYCO3IA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.580210843 (331h53m43.350852178s) [seg_pos={0 0}, upload=265483]: Segment reached optimal threshold of 14 pieces.
Jul 7 05:04:08.580342875 (331h53m43.35098421s) [noise=true , address=77.90.31.21:4903 , piece_id=JWQTRU7GLKHFXFBV2KYINTA2SEAUNDWTXER2XLNYIBXNC3KWF5ZA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZYWQ1a2sTKnFpF28iQVrem2s8nSpXkeJzZDaS7jvTZNANdfp): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580430292 (331h53m43.351071627s) [noise=true , address=45.91.116.9:4264 , piece_id=BAUPMJNTKX5S6NGVZYISJH5EJIVMVICZP4PNUKM6D525UNKAJBUA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128f6i7ALVXF3Vr8G8zsZXrNBFiT3cK8UAiic5XbFS1gRjZK86m): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580552847 (331h53m43.351194172s) [noise=true , address=77.90.31.17:4801 , piece_id=DHPU2ISCQWL6TOZQED7BG6JJ5DYRJW5FAYO4MGLB3KEOLVNC3CFA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127QRLNwZLcR5gnAgZrCjSUsH5T4jESmZ4kWeAnpj9YxaTSjoYe): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580638251 (331h53m43.351279586s) [noise=true , address=104.36.82.5:4855 , piece_id=5JPBSZRWWMGKSECM2XBHVQUT3F4U7JXCVXFKYKEJD27W3C5PCWNQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection; write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection
Jul 7 05:04:08.580668078 (331h53m43.351309413s) [seg_pos={0 0}, upload=265483]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 7 05:04:08.580803337 (331h53m43.351444672s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:04:08.580809508 (331h53m43.351450843s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:04:08.869629195 (331h53m43.64027053s) [upload=265483]: Done uploading segments...
Jul 7 05:04:08.869647730 (331h53m43.640289065s) [upload=265483]: Upload finished. err: <nil>
Duration: 5.590446016s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
5.526386813s
FAIL (2025-07-07 05:24:44 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
65483]: Got next segment. Inline: false
Jul 7 05:04:06.097422800 (331h53m40.868064135s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:04:06.097428120 (331h53m40.868069445s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:04:06.623732228 (331h53m41.394373563s) [seg_pos={0 0}, upload=265483]: Begin upload segment...
Jul 7 05:04:06.623774189 (331h53m41.394415524s) [seg_pos={0 0}, upload=265483]: Done begin upload segment.
Jul 7 05:04:06.623795539 (331h53m41.394436874s) [noise=true , address=77.90.31.14:4674 , piece_id=KUGSISFXDEFATV2BHKW34NREXENVYMNZRSM3VTXHCZOLBWYCO3IA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.623850364 (331h53m41.394491699s) [noise=true , address=77.90.31.17:4801 , piece_id=DHPU2ISCQWL6TOZQED7BG6JJ5DYRJW5FAYO4MGLB3KEOLVNC3CFA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624347755 (331h53m41.39498909s) [noise=true , address=77.90.31.16:4751 , piece_id=DQNZ6VYCO2WPLAT7CGMQOTIRXLLJTYRCUCVLI3RJZCYUZT3F6YXQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624383835 (331h53m41.39502517s) [noise=true , address=104.36.82.14:4248 , piece_id=GQVC4QYUSXVHM3WZ3OT7XSB42HEOEWHYVBMVGQVSMDFINDON6BSA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624634515 (331h53m41.39527585s) [noise=true , address=45.91.116.9:4264 , piece_id=BAUPMJNTKX5S6NGVZYISJH5EJIVMVICZP4PNUKM6D525UNKAJBUA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624844035 (331h53m41.39548537s) [noise=true , address=104.36.82.45:4927 , piece_id=6ZFIELGIKBDL2IKSE7EQP25Z7HPBP4GRSF5Y2YXUWZX54RV3ZAFA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624903259 (331h53m41.395544594s) [noise=true , address=104.36.82.18:4397 , piece_id=VF4FXOENNLGT3N7ZJ3T7EPYEW6H3YS4ZKHHQJSNLJYOCMGFXVZDQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625117729 (331h53m41.395759064s) [noise=true , address=64.49.13.27:4966 , piece_id=HPG7X2LX5N5CJHAQAWM6JKYHAOPOWRPUXEVWT4SDGYJKPKN2TRKA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625170019 (331h53m41.395811354s) [noise=true , address=104.36.82.5:4855 , piece_id=5JPBSZRWWMGKSECM2XBHVQUT3F4U7JXCVXFKYKEJD27W3C5PCWNQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625343822 (331h53m41.395985157s) [noise=true , address=104.36.82.12:4173 , piece_id=5HUGZCEFE3JCGN4PUHPP4IGVCRN2R4KHPIBQJUUTAEGOLDISXF4Q, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625394227 (331h53m41.396035563s) [noise=true , address=64.49.13.154:4932 , piece_id=4CXUMWUQ37E5ATJKWKIABQKZID2G5PRB563D3LAQTIWCZOLYI76Q, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625563120 (331h53m41.396204456s) [noise=true , address=104.36.82.3:4773 , piece_id=I2XCDVOZ5RWEMWJCBM5FATOKDCUZJFC7G2KTFILU66LJU7NLC5RQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625612635 (331h53m41.39625397s) [noise=true , address=64.49.13.140:4510 , piece_id=SUB4NNB6ZG7TGV76LBI37SUS4FYVH2LBU4DXHPRESLBDDHZHHEPA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625788693 (331h53m41.396430028s) [noise=true , address=77.90.31.16:4748 , piece_id=DRUW5HWKQF3LY5AXUQBD4MC2K2TMHJHXBDOP5DRL5WCSIV6KZDHA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625854649 (331h53m41.396495984s) [noise=true , address=104.36.82.21:4479 , piece_id=56PCCZDSZH545QXGLGRZN2IUDPIF6MTHKAULXZYVAV6BOAE632YQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626075631 (331h53m41.396716966s) [noise=true , address=77.90.31.10:4540 , piece_id=3MKHY4HDZSK5YOPP5HYVMEOWWEGDCJUPYEUW2TFPOSATOT2FMWQA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626273520 (331h53m41.396914855s) [noise=true , address=104.36.82.23:4470 , piece_id=Y3NJ45DLDTZSHKMHTANQ6VTL3BX46Y2LD2QGBK5S5SLAFDJBGPSQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626467301 (331h53m41.397108636s) [noise=true , address=77.90.31.21:4903 , piece_id=JWQTRU7GLKHFXFBV2KYINTA2SEAUNDWTXER2XLNYIBXNC3KWF5ZA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:07.724567296 (331h53m42.495208631s) [upload=265483]: Next returned nil segment
Jul 7 05:04:07.724584218 (331h53m42.495225543s) [upload=265483]: Waiting for error group managing segments...
Jul 7 05:04:08.028542246 (331h53m42.799183581s) [noise=true , address=64.49.13.27:4966 , piece_id=HPG7X2LX5N5CJHAQAWM6JKYHAOPOWRPUXEVWT4SDGYJKPKN2TRKA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.070346103 (331h53m42.840987438s) [noise=true , address=64.49.13.140:4510 , piece_id=SUB4NNB6ZG7TGV76LBI37SUS4FYVH2LBU4DXHPRESLBDDHZHHEPA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.095032022 (331h53m42.865673367s) [noise=true , address=64.49.13.154:4932 , piece_id=4CXUMWUQ37E5ATJKWKIABQKZID2G5PRB563D3LAQTIWCZOLYI76Q, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.428652819 (331h53m43.199294155s) [noise=true , address=104.36.82.18:4397 , piece_id=VF4FXOENNLGT3N7ZJ3T7EPYEW6H3YS4ZKHHQJSNLJYOCMGFXVZDQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.448309175 (331h53m43.21895051s) [noise=true , address=104.36.82.3:4773 , piece_id=I2XCDVOZ5RWEMWJCBM5FATOKDCUZJFC7G2KTFILU66LJU7NLC5RQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.460440203 (331h53m43.231081538s) [noise=true , address=104.36.82.45:4927 , piece_id=6ZFIELGIKBDL2IKSE7EQP25Z7HPBP4GRSF5Y2YXUWZX54RV3ZAFA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.462441062 (331h53m43.233082407s) [noise=true , address=104.36.82.21:4479 , piece_id=56PCCZDSZH545QXGLGRZN2IUDPIF6MTHKAULXZYVAV6BOAE632YQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.479297731 (331h53m43.249939056s) [noise=true , address=104.36.82.23:4470 , piece_id=Y3NJ45DLDTZSHKMHTANQ6VTL3BX46Y2LD2QGBK5S5SLAFDJBGPSQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.505733477 (331h53m43.276374812s) [noise=true , address=104.36.82.12:4173 , piece_id=5HUGZCEFE3JCGN4PUHPP4IGVCRN2R4KHPIBQJUUTAEGOLDISXF4Q, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.574289655 (331h53m43.34493099s) [noise=true , address=104.36.82.14:4248 , piece_id=GQVC4QYUSXVHM3WZ3OT7XSB42HEOEWHYVBMVGQVSMDFINDON6BSA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.577275016 (331h53m43.347916351s) [noise=true , address=77.90.31.10:4540 , piece_id=3MKHY4HDZSK5YOPP5HYVMEOWWEGDCJUPYEUW2TFPOSATOT2FMWQA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.577418831 (331h53m43.348060166s) [noise=true , address=77.90.31.16:4751 , piece_id=DQNZ6VYCO2WPLAT7CGMQOTIRXLLJTYRCUCVLI3RJZCYUZT3F6YXQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.579017850 (331h53m43.349659185s) [noise=true , address=77.90.31.16:4748 , piece_id=DRUW5HWKQF3LY5AXUQBD4MC2K2TMHJHXBDOP5DRL5WCSIV6KZDHA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.580192378 (331h53m43.350833713s) [noise=true , address=77.90.31.14:4674 , piece_id=KUGSISFXDEFATV2BHKW34NREXENVYMNZRSM3VTXHCZOLBWYCO3IA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.580210843 (331h53m43.350852178s) [seg_pos={0 0}, upload=265483]: Segment reached optimal threshold of 14 pieces.
Jul 7 05:04:08.580342875 (331h53m43.35098421s) [noise=true , address=77.90.31.21:4903 , piece_id=JWQTRU7GLKHFXFBV2KYINTA2SEAUNDWTXER2XLNYIBXNC3KWF5ZA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZYWQ1a2sTKnFpF28iQVrem2s8nSpXkeJzZDaS7jvTZNANdfp): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580430292 (331h53m43.351071627s) [noise=true , address=45.91.116.9:4264 , piece_id=BAUPMJNTKX5S6NGVZYISJH5EJIVMVICZP4PNUKM6D525UNKAJBUA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128f6i7ALVXF3Vr8G8zsZXrNBFiT3cK8UAiic5XbFS1gRjZK86m): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580552847 (331h53m43.351194172s) [noise=true , address=77.90.31.17:4801 , piece_id=DHPU2ISCQWL6TOZQED7BG6JJ5DYRJW5FAYO4MGLB3KEOLVNC3CFA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127QRLNwZLcR5gnAgZrCjSUsH5T4jESmZ4kWeAnpj9YxaTSjoYe): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580638251 (331h53m43.351279586s) [noise=true , address=104.36.82.5:4855 , piece_id=5JPBSZRWWMGKSECM2XBHVQUT3F4U7JXCVXFKYKEJD27W3C5PCWNQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection; write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection
Jul 7 05:04:08.580668078 (331h53m43.351309413s) [seg_pos={0 0}, upload=265483]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 7 05:04:08.580803337 (331h53m43.351444672s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:04:08.580809508 (331h53m43.351450843s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:04:08.869629195 (331h53m43.64027053s) [upload=265483]: Done uploading segments...
Jul 7 05:04:08.869647730 (331h53m43.640289065s) [upload=265483]: Upload finished. err: <nil>
Duration: 5.52641124s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
5.614209767s
FAIL (2025-07-07 05:24:39 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 5.614241828s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
5.708241664s
FAIL (2025-07-07 05:24:17 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 5.708266242s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
5.830723844s
FAIL (2025-07-07 05:23:45 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
65483]: Got next segment. Inline: false
Jul 7 05:04:06.097422800 (331h53m40.868064135s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:04:06.097428120 (331h53m40.868069445s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:04:06.623732228 (331h53m41.394373563s) [seg_pos={0 0}, upload=265483]: Begin upload segment...
Jul 7 05:04:06.623774189 (331h53m41.394415524s) [seg_pos={0 0}, upload=265483]: Done begin upload segment.
Jul 7 05:04:06.623795539 (331h53m41.394436874s) [noise=true , address=77.90.31.14:4674 , piece_id=KUGSISFXDEFATV2BHKW34NREXENVYMNZRSM3VTXHCZOLBWYCO3IA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.623850364 (331h53m41.394491699s) [noise=true , address=77.90.31.17:4801 , piece_id=DHPU2ISCQWL6TOZQED7BG6JJ5DYRJW5FAYO4MGLB3KEOLVNC3CFA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624347755 (331h53m41.39498909s) [noise=true , address=77.90.31.16:4751 , piece_id=DQNZ6VYCO2WPLAT7CGMQOTIRXLLJTYRCUCVLI3RJZCYUZT3F6YXQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624383835 (331h53m41.39502517s) [noise=true , address=104.36.82.14:4248 , piece_id=GQVC4QYUSXVHM3WZ3OT7XSB42HEOEWHYVBMVGQVSMDFINDON6BSA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624634515 (331h53m41.39527585s) [noise=true , address=45.91.116.9:4264 , piece_id=BAUPMJNTKX5S6NGVZYISJH5EJIVMVICZP4PNUKM6D525UNKAJBUA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624844035 (331h53m41.39548537s) [noise=true , address=104.36.82.45:4927 , piece_id=6ZFIELGIKBDL2IKSE7EQP25Z7HPBP4GRSF5Y2YXUWZX54RV3ZAFA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624903259 (331h53m41.395544594s) [noise=true , address=104.36.82.18:4397 , piece_id=VF4FXOENNLGT3N7ZJ3T7EPYEW6H3YS4ZKHHQJSNLJYOCMGFXVZDQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625117729 (331h53m41.395759064s) [noise=true , address=64.49.13.27:4966 , piece_id=HPG7X2LX5N5CJHAQAWM6JKYHAOPOWRPUXEVWT4SDGYJKPKN2TRKA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625170019 (331h53m41.395811354s) [noise=true , address=104.36.82.5:4855 , piece_id=5JPBSZRWWMGKSECM2XBHVQUT3F4U7JXCVXFKYKEJD27W3C5PCWNQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625343822 (331h53m41.395985157s) [noise=true , address=104.36.82.12:4173 , piece_id=5HUGZCEFE3JCGN4PUHPP4IGVCRN2R4KHPIBQJUUTAEGOLDISXF4Q, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625394227 (331h53m41.396035563s) [noise=true , address=64.49.13.154:4932 , piece_id=4CXUMWUQ37E5ATJKWKIABQKZID2G5PRB563D3LAQTIWCZOLYI76Q, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625563120 (331h53m41.396204456s) [noise=true , address=104.36.82.3:4773 , piece_id=I2XCDVOZ5RWEMWJCBM5FATOKDCUZJFC7G2KTFILU66LJU7NLC5RQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625612635 (331h53m41.39625397s) [noise=true , address=64.49.13.140:4510 , piece_id=SUB4NNB6ZG7TGV76LBI37SUS4FYVH2LBU4DXHPRESLBDDHZHHEPA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625788693 (331h53m41.396430028s) [noise=true , address=77.90.31.16:4748 , piece_id=DRUW5HWKQF3LY5AXUQBD4MC2K2TMHJHXBDOP5DRL5WCSIV6KZDHA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625854649 (331h53m41.396495984s) [noise=true , address=104.36.82.21:4479 , piece_id=56PCCZDSZH545QXGLGRZN2IUDPIF6MTHKAULXZYVAV6BOAE632YQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626075631 (331h53m41.396716966s) [noise=true , address=77.90.31.10:4540 , piece_id=3MKHY4HDZSK5YOPP5HYVMEOWWEGDCJUPYEUW2TFPOSATOT2FMWQA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626273520 (331h53m41.396914855s) [noise=true , address=104.36.82.23:4470 , piece_id=Y3NJ45DLDTZSHKMHTANQ6VTL3BX46Y2LD2QGBK5S5SLAFDJBGPSQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626467301 (331h53m41.397108636s) [noise=true , address=77.90.31.21:4903 , piece_id=JWQTRU7GLKHFXFBV2KYINTA2SEAUNDWTXER2XLNYIBXNC3KWF5ZA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:07.724567296 (331h53m42.495208631s) [upload=265483]: Next returned nil segment
Jul 7 05:04:07.724584218 (331h53m42.495225543s) [upload=265483]: Waiting for error group managing segments...
Jul 7 05:04:08.028542246 (331h53m42.799183581s) [noise=true , address=64.49.13.27:4966 , piece_id=HPG7X2LX5N5CJHAQAWM6JKYHAOPOWRPUXEVWT4SDGYJKPKN2TRKA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.070346103 (331h53m42.840987438s) [noise=true , address=64.49.13.140:4510 , piece_id=SUB4NNB6ZG7TGV76LBI37SUS4FYVH2LBU4DXHPRESLBDDHZHHEPA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.095032022 (331h53m42.865673367s) [noise=true , address=64.49.13.154:4932 , piece_id=4CXUMWUQ37E5ATJKWKIABQKZID2G5PRB563D3LAQTIWCZOLYI76Q, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.428652819 (331h53m43.199294155s) [noise=true , address=104.36.82.18:4397 , piece_id=VF4FXOENNLGT3N7ZJ3T7EPYEW6H3YS4ZKHHQJSNLJYOCMGFXVZDQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.448309175 (331h53m43.21895051s) [noise=true , address=104.36.82.3:4773 , piece_id=I2XCDVOZ5RWEMWJCBM5FATOKDCUZJFC7G2KTFILU66LJU7NLC5RQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.460440203 (331h53m43.231081538s) [noise=true , address=104.36.82.45:4927 , piece_id=6ZFIELGIKBDL2IKSE7EQP25Z7HPBP4GRSF5Y2YXUWZX54RV3ZAFA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.462441062 (331h53m43.233082407s) [noise=true , address=104.36.82.21:4479 , piece_id=56PCCZDSZH545QXGLGRZN2IUDPIF6MTHKAULXZYVAV6BOAE632YQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.479297731 (331h53m43.249939056s) [noise=true , address=104.36.82.23:4470 , piece_id=Y3NJ45DLDTZSHKMHTANQ6VTL3BX46Y2LD2QGBK5S5SLAFDJBGPSQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.505733477 (331h53m43.276374812s) [noise=true , address=104.36.82.12:4173 , piece_id=5HUGZCEFE3JCGN4PUHPP4IGVCRN2R4KHPIBQJUUTAEGOLDISXF4Q, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.574289655 (331h53m43.34493099s) [noise=true , address=104.36.82.14:4248 , piece_id=GQVC4QYUSXVHM3WZ3OT7XSB42HEOEWHYVBMVGQVSMDFINDON6BSA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.577275016 (331h53m43.347916351s) [noise=true , address=77.90.31.10:4540 , piece_id=3MKHY4HDZSK5YOPP5HYVMEOWWEGDCJUPYEUW2TFPOSATOT2FMWQA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.577418831 (331h53m43.348060166s) [noise=true , address=77.90.31.16:4751 , piece_id=DQNZ6VYCO2WPLAT7CGMQOTIRXLLJTYRCUCVLI3RJZCYUZT3F6YXQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.579017850 (331h53m43.349659185s) [noise=true , address=77.90.31.16:4748 , piece_id=DRUW5HWKQF3LY5AXUQBD4MC2K2TMHJHXBDOP5DRL5WCSIV6KZDHA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.580192378 (331h53m43.350833713s) [noise=true , address=77.90.31.14:4674 , piece_id=KUGSISFXDEFATV2BHKW34NREXENVYMNZRSM3VTXHCZOLBWYCO3IA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.580210843 (331h53m43.350852178s) [seg_pos={0 0}, upload=265483]: Segment reached optimal threshold of 14 pieces.
Jul 7 05:04:08.580342875 (331h53m43.35098421s) [noise=true , address=77.90.31.21:4903 , piece_id=JWQTRU7GLKHFXFBV2KYINTA2SEAUNDWTXER2XLNYIBXNC3KWF5ZA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZYWQ1a2sTKnFpF28iQVrem2s8nSpXkeJzZDaS7jvTZNANdfp): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580430292 (331h53m43.351071627s) [noise=true , address=45.91.116.9:4264 , piece_id=BAUPMJNTKX5S6NGVZYISJH5EJIVMVICZP4PNUKM6D525UNKAJBUA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128f6i7ALVXF3Vr8G8zsZXrNBFiT3cK8UAiic5XbFS1gRjZK86m): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580552847 (331h53m43.351194172s) [noise=true , address=77.90.31.17:4801 , piece_id=DHPU2ISCQWL6TOZQED7BG6JJ5DYRJW5FAYO4MGLB3KEOLVNC3CFA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127QRLNwZLcR5gnAgZrCjSUsH5T4jESmZ4kWeAnpj9YxaTSjoYe): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580638251 (331h53m43.351279586s) [noise=true , address=104.36.82.5:4855 , piece_id=5JPBSZRWWMGKSECM2XBHVQUT3F4U7JXCVXFKYKEJD27W3C5PCWNQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection; write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection
Jul 7 05:04:08.580668078 (331h53m43.351309413s) [seg_pos={0 0}, upload=265483]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 7 05:04:08.580803337 (331h53m43.351444672s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:04:08.580809508 (331h53m43.351450843s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:04:08.869629195 (331h53m43.64027053s) [upload=265483]: Done uploading segments...
Jul 7 05:04:08.869647730 (331h53m43.640289065s) [upload=265483]: Upload finished. err: <nil>
Duration: 5.830750264s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
5.929148918s
FAIL (2025-07-07 05:23:08 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 5.929179997s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
5.550491616s
FAIL (2025-07-07 05:23:05 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
65483]: Got next segment. Inline: false
Jul 7 05:04:06.097422800 (331h53m40.868064135s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:04:06.097428120 (331h53m40.868069445s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:04:06.623732228 (331h53m41.394373563s) [seg_pos={0 0}, upload=265483]: Begin upload segment...
Jul 7 05:04:06.623774189 (331h53m41.394415524s) [seg_pos={0 0}, upload=265483]: Done begin upload segment.
Jul 7 05:04:06.623795539 (331h53m41.394436874s) [noise=true , address=77.90.31.14:4674 , piece_id=KUGSISFXDEFATV2BHKW34NREXENVYMNZRSM3VTXHCZOLBWYCO3IA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.623850364 (331h53m41.394491699s) [noise=true , address=77.90.31.17:4801 , piece_id=DHPU2ISCQWL6TOZQED7BG6JJ5DYRJW5FAYO4MGLB3KEOLVNC3CFA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624347755 (331h53m41.39498909s) [noise=true , address=77.90.31.16:4751 , piece_id=DQNZ6VYCO2WPLAT7CGMQOTIRXLLJTYRCUCVLI3RJZCYUZT3F6YXQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624383835 (331h53m41.39502517s) [noise=true , address=104.36.82.14:4248 , piece_id=GQVC4QYUSXVHM3WZ3OT7XSB42HEOEWHYVBMVGQVSMDFINDON6BSA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624634515 (331h53m41.39527585s) [noise=true , address=45.91.116.9:4264 , piece_id=BAUPMJNTKX5S6NGVZYISJH5EJIVMVICZP4PNUKM6D525UNKAJBUA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624844035 (331h53m41.39548537s) [noise=true , address=104.36.82.45:4927 , piece_id=6ZFIELGIKBDL2IKSE7EQP25Z7HPBP4GRSF5Y2YXUWZX54RV3ZAFA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624903259 (331h53m41.395544594s) [noise=true , address=104.36.82.18:4397 , piece_id=VF4FXOENNLGT3N7ZJ3T7EPYEW6H3YS4ZKHHQJSNLJYOCMGFXVZDQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625117729 (331h53m41.395759064s) [noise=true , address=64.49.13.27:4966 , piece_id=HPG7X2LX5N5CJHAQAWM6JKYHAOPOWRPUXEVWT4SDGYJKPKN2TRKA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625170019 (331h53m41.395811354s) [noise=true , address=104.36.82.5:4855 , piece_id=5JPBSZRWWMGKSECM2XBHVQUT3F4U7JXCVXFKYKEJD27W3C5PCWNQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625343822 (331h53m41.395985157s) [noise=true , address=104.36.82.12:4173 , piece_id=5HUGZCEFE3JCGN4PUHPP4IGVCRN2R4KHPIBQJUUTAEGOLDISXF4Q, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625394227 (331h53m41.396035563s) [noise=true , address=64.49.13.154:4932 , piece_id=4CXUMWUQ37E5ATJKWKIABQKZID2G5PRB563D3LAQTIWCZOLYI76Q, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625563120 (331h53m41.396204456s) [noise=true , address=104.36.82.3:4773 , piece_id=I2XCDVOZ5RWEMWJCBM5FATOKDCUZJFC7G2KTFILU66LJU7NLC5RQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625612635 (331h53m41.39625397s) [noise=true , address=64.49.13.140:4510 , piece_id=SUB4NNB6ZG7TGV76LBI37SUS4FYVH2LBU4DXHPRESLBDDHZHHEPA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625788693 (331h53m41.396430028s) [noise=true , address=77.90.31.16:4748 , piece_id=DRUW5HWKQF3LY5AXUQBD4MC2K2TMHJHXBDOP5DRL5WCSIV6KZDHA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625854649 (331h53m41.396495984s) [noise=true , address=104.36.82.21:4479 , piece_id=56PCCZDSZH545QXGLGRZN2IUDPIF6MTHKAULXZYVAV6BOAE632YQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626075631 (331h53m41.396716966s) [noise=true , address=77.90.31.10:4540 , piece_id=3MKHY4HDZSK5YOPP5HYVMEOWWEGDCJUPYEUW2TFPOSATOT2FMWQA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626273520 (331h53m41.396914855s) [noise=true , address=104.36.82.23:4470 , piece_id=Y3NJ45DLDTZSHKMHTANQ6VTL3BX46Y2LD2QGBK5S5SLAFDJBGPSQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626467301 (331h53m41.397108636s) [noise=true , address=77.90.31.21:4903 , piece_id=JWQTRU7GLKHFXFBV2KYINTA2SEAUNDWTXER2XLNYIBXNC3KWF5ZA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:07.724567296 (331h53m42.495208631s) [upload=265483]: Next returned nil segment
Jul 7 05:04:07.724584218 (331h53m42.495225543s) [upload=265483]: Waiting for error group managing segments...
Jul 7 05:04:08.028542246 (331h53m42.799183581s) [noise=true , address=64.49.13.27:4966 , piece_id=HPG7X2LX5N5CJHAQAWM6JKYHAOPOWRPUXEVWT4SDGYJKPKN2TRKA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.070346103 (331h53m42.840987438s) [noise=true , address=64.49.13.140:4510 , piece_id=SUB4NNB6ZG7TGV76LBI37SUS4FYVH2LBU4DXHPRESLBDDHZHHEPA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.095032022 (331h53m42.865673367s) [noise=true , address=64.49.13.154:4932 , piece_id=4CXUMWUQ37E5ATJKWKIABQKZID2G5PRB563D3LAQTIWCZOLYI76Q, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.428652819 (331h53m43.199294155s) [noise=true , address=104.36.82.18:4397 , piece_id=VF4FXOENNLGT3N7ZJ3T7EPYEW6H3YS4ZKHHQJSNLJYOCMGFXVZDQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.448309175 (331h53m43.21895051s) [noise=true , address=104.36.82.3:4773 , piece_id=I2XCDVOZ5RWEMWJCBM5FATOKDCUZJFC7G2KTFILU66LJU7NLC5RQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.460440203 (331h53m43.231081538s) [noise=true , address=104.36.82.45:4927 , piece_id=6ZFIELGIKBDL2IKSE7EQP25Z7HPBP4GRSF5Y2YXUWZX54RV3ZAFA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.462441062 (331h53m43.233082407s) [noise=true , address=104.36.82.21:4479 , piece_id=56PCCZDSZH545QXGLGRZN2IUDPIF6MTHKAULXZYVAV6BOAE632YQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.479297731 (331h53m43.249939056s) [noise=true , address=104.36.82.23:4470 , piece_id=Y3NJ45DLDTZSHKMHTANQ6VTL3BX46Y2LD2QGBK5S5SLAFDJBGPSQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.505733477 (331h53m43.276374812s) [noise=true , address=104.36.82.12:4173 , piece_id=5HUGZCEFE3JCGN4PUHPP4IGVCRN2R4KHPIBQJUUTAEGOLDISXF4Q, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.574289655 (331h53m43.34493099s) [noise=true , address=104.36.82.14:4248 , piece_id=GQVC4QYUSXVHM3WZ3OT7XSB42HEOEWHYVBMVGQVSMDFINDON6BSA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.577275016 (331h53m43.347916351s) [noise=true , address=77.90.31.10:4540 , piece_id=3MKHY4HDZSK5YOPP5HYVMEOWWEGDCJUPYEUW2TFPOSATOT2FMWQA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.577418831 (331h53m43.348060166s) [noise=true , address=77.90.31.16:4751 , piece_id=DQNZ6VYCO2WPLAT7CGMQOTIRXLLJTYRCUCVLI3RJZCYUZT3F6YXQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.579017850 (331h53m43.349659185s) [noise=true , address=77.90.31.16:4748 , piece_id=DRUW5HWKQF3LY5AXUQBD4MC2K2TMHJHXBDOP5DRL5WCSIV6KZDHA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.580192378 (331h53m43.350833713s) [noise=true , address=77.90.31.14:4674 , piece_id=KUGSISFXDEFATV2BHKW34NREXENVYMNZRSM3VTXHCZOLBWYCO3IA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.580210843 (331h53m43.350852178s) [seg_pos={0 0}, upload=265483]: Segment reached optimal threshold of 14 pieces.
Jul 7 05:04:08.580342875 (331h53m43.35098421s) [noise=true , address=77.90.31.21:4903 , piece_id=JWQTRU7GLKHFXFBV2KYINTA2SEAUNDWTXER2XLNYIBXNC3KWF5ZA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZYWQ1a2sTKnFpF28iQVrem2s8nSpXkeJzZDaS7jvTZNANdfp): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580430292 (331h53m43.351071627s) [noise=true , address=45.91.116.9:4264 , piece_id=BAUPMJNTKX5S6NGVZYISJH5EJIVMVICZP4PNUKM6D525UNKAJBUA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128f6i7ALVXF3Vr8G8zsZXrNBFiT3cK8UAiic5XbFS1gRjZK86m): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580552847 (331h53m43.351194172s) [noise=true , address=77.90.31.17:4801 , piece_id=DHPU2ISCQWL6TOZQED7BG6JJ5DYRJW5FAYO4MGLB3KEOLVNC3CFA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127QRLNwZLcR5gnAgZrCjSUsH5T4jESmZ4kWeAnpj9YxaTSjoYe): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580638251 (331h53m43.351279586s) [noise=true , address=104.36.82.5:4855 , piece_id=5JPBSZRWWMGKSECM2XBHVQUT3F4U7JXCVXFKYKEJD27W3C5PCWNQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection; write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection
Jul 7 05:04:08.580668078 (331h53m43.351309413s) [seg_pos={0 0}, upload=265483]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 7 05:04:08.580803337 (331h53m43.351444672s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:04:08.580809508 (331h53m43.351450843s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:04:08.869629195 (331h53m43.64027053s) [upload=265483]: Done uploading segments...
Jul 7 05:04:08.869647730 (331h53m43.640289065s) [upload=265483]: Upload finished. err: <nil>
Duration: 5.550522435s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
5.650599229s
FAIL (2025-07-07 05:22:46 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 5.650628346s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
5.702786631s
FAIL (2025-07-07 05:22:28 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
65483]: Got next segment. Inline: false
Jul 7 05:04:06.097422800 (331h53m40.868064135s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:04:06.097428120 (331h53m40.868069445s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:04:06.623732228 (331h53m41.394373563s) [seg_pos={0 0}, upload=265483]: Begin upload segment...
Jul 7 05:04:06.623774189 (331h53m41.394415524s) [seg_pos={0 0}, upload=265483]: Done begin upload segment.
Jul 7 05:04:06.623795539 (331h53m41.394436874s) [noise=true , address=77.90.31.14:4674 , piece_id=KUGSISFXDEFATV2BHKW34NREXENVYMNZRSM3VTXHCZOLBWYCO3IA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.623850364 (331h53m41.394491699s) [noise=true , address=77.90.31.17:4801 , piece_id=DHPU2ISCQWL6TOZQED7BG6JJ5DYRJW5FAYO4MGLB3KEOLVNC3CFA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624347755 (331h53m41.39498909s) [noise=true , address=77.90.31.16:4751 , piece_id=DQNZ6VYCO2WPLAT7CGMQOTIRXLLJTYRCUCVLI3RJZCYUZT3F6YXQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624383835 (331h53m41.39502517s) [noise=true , address=104.36.82.14:4248 , piece_id=GQVC4QYUSXVHM3WZ3OT7XSB42HEOEWHYVBMVGQVSMDFINDON6BSA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624634515 (331h53m41.39527585s) [noise=true , address=45.91.116.9:4264 , piece_id=BAUPMJNTKX5S6NGVZYISJH5EJIVMVICZP4PNUKM6D525UNKAJBUA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624844035 (331h53m41.39548537s) [noise=true , address=104.36.82.45:4927 , piece_id=6ZFIELGIKBDL2IKSE7EQP25Z7HPBP4GRSF5Y2YXUWZX54RV3ZAFA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624903259 (331h53m41.395544594s) [noise=true , address=104.36.82.18:4397 , piece_id=VF4FXOENNLGT3N7ZJ3T7EPYEW6H3YS4ZKHHQJSNLJYOCMGFXVZDQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625117729 (331h53m41.395759064s) [noise=true , address=64.49.13.27:4966 , piece_id=HPG7X2LX5N5CJHAQAWM6JKYHAOPOWRPUXEVWT4SDGYJKPKN2TRKA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625170019 (331h53m41.395811354s) [noise=true , address=104.36.82.5:4855 , piece_id=5JPBSZRWWMGKSECM2XBHVQUT3F4U7JXCVXFKYKEJD27W3C5PCWNQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625343822 (331h53m41.395985157s) [noise=true , address=104.36.82.12:4173 , piece_id=5HUGZCEFE3JCGN4PUHPP4IGVCRN2R4KHPIBQJUUTAEGOLDISXF4Q, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625394227 (331h53m41.396035563s) [noise=true , address=64.49.13.154:4932 , piece_id=4CXUMWUQ37E5ATJKWKIABQKZID2G5PRB563D3LAQTIWCZOLYI76Q, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625563120 (331h53m41.396204456s) [noise=true , address=104.36.82.3:4773 , piece_id=I2XCDVOZ5RWEMWJCBM5FATOKDCUZJFC7G2KTFILU66LJU7NLC5RQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625612635 (331h53m41.39625397s) [noise=true , address=64.49.13.140:4510 , piece_id=SUB4NNB6ZG7TGV76LBI37SUS4FYVH2LBU4DXHPRESLBDDHZHHEPA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625788693 (331h53m41.396430028s) [noise=true , address=77.90.31.16:4748 , piece_id=DRUW5HWKQF3LY5AXUQBD4MC2K2TMHJHXBDOP5DRL5WCSIV6KZDHA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625854649 (331h53m41.396495984s) [noise=true , address=104.36.82.21:4479 , piece_id=56PCCZDSZH545QXGLGRZN2IUDPIF6MTHKAULXZYVAV6BOAE632YQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626075631 (331h53m41.396716966s) [noise=true , address=77.90.31.10:4540 , piece_id=3MKHY4HDZSK5YOPP5HYVMEOWWEGDCJUPYEUW2TFPOSATOT2FMWQA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626273520 (331h53m41.396914855s) [noise=true , address=104.36.82.23:4470 , piece_id=Y3NJ45DLDTZSHKMHTANQ6VTL3BX46Y2LD2QGBK5S5SLAFDJBGPSQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626467301 (331h53m41.397108636s) [noise=true , address=77.90.31.21:4903 , piece_id=JWQTRU7GLKHFXFBV2KYINTA2SEAUNDWTXER2XLNYIBXNC3KWF5ZA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:07.724567296 (331h53m42.495208631s) [upload=265483]: Next returned nil segment
Jul 7 05:04:07.724584218 (331h53m42.495225543s) [upload=265483]: Waiting for error group managing segments...
Jul 7 05:04:08.028542246 (331h53m42.799183581s) [noise=true , address=64.49.13.27:4966 , piece_id=HPG7X2LX5N5CJHAQAWM6JKYHAOPOWRPUXEVWT4SDGYJKPKN2TRKA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.070346103 (331h53m42.840987438s) [noise=true , address=64.49.13.140:4510 , piece_id=SUB4NNB6ZG7TGV76LBI37SUS4FYVH2LBU4DXHPRESLBDDHZHHEPA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.095032022 (331h53m42.865673367s) [noise=true , address=64.49.13.154:4932 , piece_id=4CXUMWUQ37E5ATJKWKIABQKZID2G5PRB563D3LAQTIWCZOLYI76Q, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.428652819 (331h53m43.199294155s) [noise=true , address=104.36.82.18:4397 , piece_id=VF4FXOENNLGT3N7ZJ3T7EPYEW6H3YS4ZKHHQJSNLJYOCMGFXVZDQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.448309175 (331h53m43.21895051s) [noise=true , address=104.36.82.3:4773 , piece_id=I2XCDVOZ5RWEMWJCBM5FATOKDCUZJFC7G2KTFILU66LJU7NLC5RQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.460440203 (331h53m43.231081538s) [noise=true , address=104.36.82.45:4927 , piece_id=6ZFIELGIKBDL2IKSE7EQP25Z7HPBP4GRSF5Y2YXUWZX54RV3ZAFA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.462441062 (331h53m43.233082407s) [noise=true , address=104.36.82.21:4479 , piece_id=56PCCZDSZH545QXGLGRZN2IUDPIF6MTHKAULXZYVAV6BOAE632YQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.479297731 (331h53m43.249939056s) [noise=true , address=104.36.82.23:4470 , piece_id=Y3NJ45DLDTZSHKMHTANQ6VTL3BX46Y2LD2QGBK5S5SLAFDJBGPSQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.505733477 (331h53m43.276374812s) [noise=true , address=104.36.82.12:4173 , piece_id=5HUGZCEFE3JCGN4PUHPP4IGVCRN2R4KHPIBQJUUTAEGOLDISXF4Q, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.574289655 (331h53m43.34493099s) [noise=true , address=104.36.82.14:4248 , piece_id=GQVC4QYUSXVHM3WZ3OT7XSB42HEOEWHYVBMVGQVSMDFINDON6BSA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.577275016 (331h53m43.347916351s) [noise=true , address=77.90.31.10:4540 , piece_id=3MKHY4HDZSK5YOPP5HYVMEOWWEGDCJUPYEUW2TFPOSATOT2FMWQA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.577418831 (331h53m43.348060166s) [noise=true , address=77.90.31.16:4751 , piece_id=DQNZ6VYCO2WPLAT7CGMQOTIRXLLJTYRCUCVLI3RJZCYUZT3F6YXQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.579017850 (331h53m43.349659185s) [noise=true , address=77.90.31.16:4748 , piece_id=DRUW5HWKQF3LY5AXUQBD4MC2K2TMHJHXBDOP5DRL5WCSIV6KZDHA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.580192378 (331h53m43.350833713s) [noise=true , address=77.90.31.14:4674 , piece_id=KUGSISFXDEFATV2BHKW34NREXENVYMNZRSM3VTXHCZOLBWYCO3IA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.580210843 (331h53m43.350852178s) [seg_pos={0 0}, upload=265483]: Segment reached optimal threshold of 14 pieces.
Jul 7 05:04:08.580342875 (331h53m43.35098421s) [noise=true , address=77.90.31.21:4903 , piece_id=JWQTRU7GLKHFXFBV2KYINTA2SEAUNDWTXER2XLNYIBXNC3KWF5ZA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZYWQ1a2sTKnFpF28iQVrem2s8nSpXkeJzZDaS7jvTZNANdfp): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580430292 (331h53m43.351071627s) [noise=true , address=45.91.116.9:4264 , piece_id=BAUPMJNTKX5S6NGVZYISJH5EJIVMVICZP4PNUKM6D525UNKAJBUA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128f6i7ALVXF3Vr8G8zsZXrNBFiT3cK8UAiic5XbFS1gRjZK86m): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580552847 (331h53m43.351194172s) [noise=true , address=77.90.31.17:4801 , piece_id=DHPU2ISCQWL6TOZQED7BG6JJ5DYRJW5FAYO4MGLB3KEOLVNC3CFA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127QRLNwZLcR5gnAgZrCjSUsH5T4jESmZ4kWeAnpj9YxaTSjoYe): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580638251 (331h53m43.351279586s) [noise=true , address=104.36.82.5:4855 , piece_id=5JPBSZRWWMGKSECM2XBHVQUT3F4U7JXCVXFKYKEJD27W3C5PCWNQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection; write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection
Jul 7 05:04:08.580668078 (331h53m43.351309413s) [seg_pos={0 0}, upload=265483]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 7 05:04:08.580803337 (331h53m43.351444672s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:04:08.580809508 (331h53m43.351450843s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:04:08.869629195 (331h53m43.64027053s) [upload=265483]: Done uploading segments...
Jul 7 05:04:08.869647730 (331h53m43.640289065s) [upload=265483]: Upload finished. err: <nil>
Duration: 5.70281212s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
5.907033275s
FAIL (2025-07-07 05:21:32 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 5.907061257s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
5.450008521s
FAIL (2025-07-07 05:21:26 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
65483]: Got next segment. Inline: false
Jul 7 05:04:06.097422800 (331h53m40.868064135s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:04:06.097428120 (331h53m40.868069445s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:04:06.623732228 (331h53m41.394373563s) [seg_pos={0 0}, upload=265483]: Begin upload segment...
Jul 7 05:04:06.623774189 (331h53m41.394415524s) [seg_pos={0 0}, upload=265483]: Done begin upload segment.
Jul 7 05:04:06.623795539 (331h53m41.394436874s) [noise=true , address=77.90.31.14:4674 , piece_id=KUGSISFXDEFATV2BHKW34NREXENVYMNZRSM3VTXHCZOLBWYCO3IA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.623850364 (331h53m41.394491699s) [noise=true , address=77.90.31.17:4801 , piece_id=DHPU2ISCQWL6TOZQED7BG6JJ5DYRJW5FAYO4MGLB3KEOLVNC3CFA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624347755 (331h53m41.39498909s) [noise=true , address=77.90.31.16:4751 , piece_id=DQNZ6VYCO2WPLAT7CGMQOTIRXLLJTYRCUCVLI3RJZCYUZT3F6YXQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624383835 (331h53m41.39502517s) [noise=true , address=104.36.82.14:4248 , piece_id=GQVC4QYUSXVHM3WZ3OT7XSB42HEOEWHYVBMVGQVSMDFINDON6BSA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624634515 (331h53m41.39527585s) [noise=true , address=45.91.116.9:4264 , piece_id=BAUPMJNTKX5S6NGVZYISJH5EJIVMVICZP4PNUKM6D525UNKAJBUA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624844035 (331h53m41.39548537s) [noise=true , address=104.36.82.45:4927 , piece_id=6ZFIELGIKBDL2IKSE7EQP25Z7HPBP4GRSF5Y2YXUWZX54RV3ZAFA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624903259 (331h53m41.395544594s) [noise=true , address=104.36.82.18:4397 , piece_id=VF4FXOENNLGT3N7ZJ3T7EPYEW6H3YS4ZKHHQJSNLJYOCMGFXVZDQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625117729 (331h53m41.395759064s) [noise=true , address=64.49.13.27:4966 , piece_id=HPG7X2LX5N5CJHAQAWM6JKYHAOPOWRPUXEVWT4SDGYJKPKN2TRKA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625170019 (331h53m41.395811354s) [noise=true , address=104.36.82.5:4855 , piece_id=5JPBSZRWWMGKSECM2XBHVQUT3F4U7JXCVXFKYKEJD27W3C5PCWNQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625343822 (331h53m41.395985157s) [noise=true , address=104.36.82.12:4173 , piece_id=5HUGZCEFE3JCGN4PUHPP4IGVCRN2R4KHPIBQJUUTAEGOLDISXF4Q, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625394227 (331h53m41.396035563s) [noise=true , address=64.49.13.154:4932 , piece_id=4CXUMWUQ37E5ATJKWKIABQKZID2G5PRB563D3LAQTIWCZOLYI76Q, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625563120 (331h53m41.396204456s) [noise=true , address=104.36.82.3:4773 , piece_id=I2XCDVOZ5RWEMWJCBM5FATOKDCUZJFC7G2KTFILU66LJU7NLC5RQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625612635 (331h53m41.39625397s) [noise=true , address=64.49.13.140:4510 , piece_id=SUB4NNB6ZG7TGV76LBI37SUS4FYVH2LBU4DXHPRESLBDDHZHHEPA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625788693 (331h53m41.396430028s) [noise=true , address=77.90.31.16:4748 , piece_id=DRUW5HWKQF3LY5AXUQBD4MC2K2TMHJHXBDOP5DRL5WCSIV6KZDHA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625854649 (331h53m41.396495984s) [noise=true , address=104.36.82.21:4479 , piece_id=56PCCZDSZH545QXGLGRZN2IUDPIF6MTHKAULXZYVAV6BOAE632YQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626075631 (331h53m41.396716966s) [noise=true , address=77.90.31.10:4540 , piece_id=3MKHY4HDZSK5YOPP5HYVMEOWWEGDCJUPYEUW2TFPOSATOT2FMWQA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626273520 (331h53m41.396914855s) [noise=true , address=104.36.82.23:4470 , piece_id=Y3NJ45DLDTZSHKMHTANQ6VTL3BX46Y2LD2QGBK5S5SLAFDJBGPSQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626467301 (331h53m41.397108636s) [noise=true , address=77.90.31.21:4903 , piece_id=JWQTRU7GLKHFXFBV2KYINTA2SEAUNDWTXER2XLNYIBXNC3KWF5ZA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:07.724567296 (331h53m42.495208631s) [upload=265483]: Next returned nil segment
Jul 7 05:04:07.724584218 (331h53m42.495225543s) [upload=265483]: Waiting for error group managing segments...
Jul 7 05:04:08.028542246 (331h53m42.799183581s) [noise=true , address=64.49.13.27:4966 , piece_id=HPG7X2LX5N5CJHAQAWM6JKYHAOPOWRPUXEVWT4SDGYJKPKN2TRKA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.070346103 (331h53m42.840987438s) [noise=true , address=64.49.13.140:4510 , piece_id=SUB4NNB6ZG7TGV76LBI37SUS4FYVH2LBU4DXHPRESLBDDHZHHEPA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.095032022 (331h53m42.865673367s) [noise=true , address=64.49.13.154:4932 , piece_id=4CXUMWUQ37E5ATJKWKIABQKZID2G5PRB563D3LAQTIWCZOLYI76Q, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.428652819 (331h53m43.199294155s) [noise=true , address=104.36.82.18:4397 , piece_id=VF4FXOENNLGT3N7ZJ3T7EPYEW6H3YS4ZKHHQJSNLJYOCMGFXVZDQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.448309175 (331h53m43.21895051s) [noise=true , address=104.36.82.3:4773 , piece_id=I2XCDVOZ5RWEMWJCBM5FATOKDCUZJFC7G2KTFILU66LJU7NLC5RQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.460440203 (331h53m43.231081538s) [noise=true , address=104.36.82.45:4927 , piece_id=6ZFIELGIKBDL2IKSE7EQP25Z7HPBP4GRSF5Y2YXUWZX54RV3ZAFA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.462441062 (331h53m43.233082407s) [noise=true , address=104.36.82.21:4479 , piece_id=56PCCZDSZH545QXGLGRZN2IUDPIF6MTHKAULXZYVAV6BOAE632YQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.479297731 (331h53m43.249939056s) [noise=true , address=104.36.82.23:4470 , piece_id=Y3NJ45DLDTZSHKMHTANQ6VTL3BX46Y2LD2QGBK5S5SLAFDJBGPSQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.505733477 (331h53m43.276374812s) [noise=true , address=104.36.82.12:4173 , piece_id=5HUGZCEFE3JCGN4PUHPP4IGVCRN2R4KHPIBQJUUTAEGOLDISXF4Q, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.574289655 (331h53m43.34493099s) [noise=true , address=104.36.82.14:4248 , piece_id=GQVC4QYUSXVHM3WZ3OT7XSB42HEOEWHYVBMVGQVSMDFINDON6BSA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.577275016 (331h53m43.347916351s) [noise=true , address=77.90.31.10:4540 , piece_id=3MKHY4HDZSK5YOPP5HYVMEOWWEGDCJUPYEUW2TFPOSATOT2FMWQA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.577418831 (331h53m43.348060166s) [noise=true , address=77.90.31.16:4751 , piece_id=DQNZ6VYCO2WPLAT7CGMQOTIRXLLJTYRCUCVLI3RJZCYUZT3F6YXQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.579017850 (331h53m43.349659185s) [noise=true , address=77.90.31.16:4748 , piece_id=DRUW5HWKQF3LY5AXUQBD4MC2K2TMHJHXBDOP5DRL5WCSIV6KZDHA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.580192378 (331h53m43.350833713s) [noise=true , address=77.90.31.14:4674 , piece_id=KUGSISFXDEFATV2BHKW34NREXENVYMNZRSM3VTXHCZOLBWYCO3IA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.580210843 (331h53m43.350852178s) [seg_pos={0 0}, upload=265483]: Segment reached optimal threshold of 14 pieces.
Jul 7 05:04:08.580342875 (331h53m43.35098421s) [noise=true , address=77.90.31.21:4903 , piece_id=JWQTRU7GLKHFXFBV2KYINTA2SEAUNDWTXER2XLNYIBXNC3KWF5ZA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZYWQ1a2sTKnFpF28iQVrem2s8nSpXkeJzZDaS7jvTZNANdfp): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580430292 (331h53m43.351071627s) [noise=true , address=45.91.116.9:4264 , piece_id=BAUPMJNTKX5S6NGVZYISJH5EJIVMVICZP4PNUKM6D525UNKAJBUA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128f6i7ALVXF3Vr8G8zsZXrNBFiT3cK8UAiic5XbFS1gRjZK86m): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580552847 (331h53m43.351194172s) [noise=true , address=77.90.31.17:4801 , piece_id=DHPU2ISCQWL6TOZQED7BG6JJ5DYRJW5FAYO4MGLB3KEOLVNC3CFA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127QRLNwZLcR5gnAgZrCjSUsH5T4jESmZ4kWeAnpj9YxaTSjoYe): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580638251 (331h53m43.351279586s) [noise=true , address=104.36.82.5:4855 , piece_id=5JPBSZRWWMGKSECM2XBHVQUT3F4U7JXCVXFKYKEJD27W3C5PCWNQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection; write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection
Jul 7 05:04:08.580668078 (331h53m43.351309413s) [seg_pos={0 0}, upload=265483]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 7 05:04:08.580803337 (331h53m43.351444672s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:04:08.580809508 (331h53m43.351450843s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:04:08.869629195 (331h53m43.64027053s) [upload=265483]: Done uploading segments...
Jul 7 05:04:08.869647730 (331h53m43.640289065s) [upload=265483]: Upload finished. err: <nil>
Duration: 5.450037585s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
5.634695899s
FAIL (2025-07-07 05:21:03 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 5.634713452s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
5.547280664s
FAIL (2025-07-07 05:20:24 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
65483]: Got next segment. Inline: false
Jul 7 05:04:06.097422800 (331h53m40.868064135s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:04:06.097428120 (331h53m40.868069445s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:04:06.623732228 (331h53m41.394373563s) [seg_pos={0 0}, upload=265483]: Begin upload segment...
Jul 7 05:04:06.623774189 (331h53m41.394415524s) [seg_pos={0 0}, upload=265483]: Done begin upload segment.
Jul 7 05:04:06.623795539 (331h53m41.394436874s) [noise=true , address=77.90.31.14:4674 , piece_id=KUGSISFXDEFATV2BHKW34NREXENVYMNZRSM3VTXHCZOLBWYCO3IA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.623850364 (331h53m41.394491699s) [noise=true , address=77.90.31.17:4801 , piece_id=DHPU2ISCQWL6TOZQED7BG6JJ5DYRJW5FAYO4MGLB3KEOLVNC3CFA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624347755 (331h53m41.39498909s) [noise=true , address=77.90.31.16:4751 , piece_id=DQNZ6VYCO2WPLAT7CGMQOTIRXLLJTYRCUCVLI3RJZCYUZT3F6YXQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624383835 (331h53m41.39502517s) [noise=true , address=104.36.82.14:4248 , piece_id=GQVC4QYUSXVHM3WZ3OT7XSB42HEOEWHYVBMVGQVSMDFINDON6BSA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624634515 (331h53m41.39527585s) [noise=true , address=45.91.116.9:4264 , piece_id=BAUPMJNTKX5S6NGVZYISJH5EJIVMVICZP4PNUKM6D525UNKAJBUA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624844035 (331h53m41.39548537s) [noise=true , address=104.36.82.45:4927 , piece_id=6ZFIELGIKBDL2IKSE7EQP25Z7HPBP4GRSF5Y2YXUWZX54RV3ZAFA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624903259 (331h53m41.395544594s) [noise=true , address=104.36.82.18:4397 , piece_id=VF4FXOENNLGT3N7ZJ3T7EPYEW6H3YS4ZKHHQJSNLJYOCMGFXVZDQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625117729 (331h53m41.395759064s) [noise=true , address=64.49.13.27:4966 , piece_id=HPG7X2LX5N5CJHAQAWM6JKYHAOPOWRPUXEVWT4SDGYJKPKN2TRKA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625170019 (331h53m41.395811354s) [noise=true , address=104.36.82.5:4855 , piece_id=5JPBSZRWWMGKSECM2XBHVQUT3F4U7JXCVXFKYKEJD27W3C5PCWNQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625343822 (331h53m41.395985157s) [noise=true , address=104.36.82.12:4173 , piece_id=5HUGZCEFE3JCGN4PUHPP4IGVCRN2R4KHPIBQJUUTAEGOLDISXF4Q, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625394227 (331h53m41.396035563s) [noise=true , address=64.49.13.154:4932 , piece_id=4CXUMWUQ37E5ATJKWKIABQKZID2G5PRB563D3LAQTIWCZOLYI76Q, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625563120 (331h53m41.396204456s) [noise=true , address=104.36.82.3:4773 , piece_id=I2XCDVOZ5RWEMWJCBM5FATOKDCUZJFC7G2KTFILU66LJU7NLC5RQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625612635 (331h53m41.39625397s) [noise=true , address=64.49.13.140:4510 , piece_id=SUB4NNB6ZG7TGV76LBI37SUS4FYVH2LBU4DXHPRESLBDDHZHHEPA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625788693 (331h53m41.396430028s) [noise=true , address=77.90.31.16:4748 , piece_id=DRUW5HWKQF3LY5AXUQBD4MC2K2TMHJHXBDOP5DRL5WCSIV6KZDHA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625854649 (331h53m41.396495984s) [noise=true , address=104.36.82.21:4479 , piece_id=56PCCZDSZH545QXGLGRZN2IUDPIF6MTHKAULXZYVAV6BOAE632YQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626075631 (331h53m41.396716966s) [noise=true , address=77.90.31.10:4540 , piece_id=3MKHY4HDZSK5YOPP5HYVMEOWWEGDCJUPYEUW2TFPOSATOT2FMWQA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626273520 (331h53m41.396914855s) [noise=true , address=104.36.82.23:4470 , piece_id=Y3NJ45DLDTZSHKMHTANQ6VTL3BX46Y2LD2QGBK5S5SLAFDJBGPSQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626467301 (331h53m41.397108636s) [noise=true , address=77.90.31.21:4903 , piece_id=JWQTRU7GLKHFXFBV2KYINTA2SEAUNDWTXER2XLNYIBXNC3KWF5ZA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:07.724567296 (331h53m42.495208631s) [upload=265483]: Next returned nil segment
Jul 7 05:04:07.724584218 (331h53m42.495225543s) [upload=265483]: Waiting for error group managing segments...
Jul 7 05:04:08.028542246 (331h53m42.799183581s) [noise=true , address=64.49.13.27:4966 , piece_id=HPG7X2LX5N5CJHAQAWM6JKYHAOPOWRPUXEVWT4SDGYJKPKN2TRKA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.070346103 (331h53m42.840987438s) [noise=true , address=64.49.13.140:4510 , piece_id=SUB4NNB6ZG7TGV76LBI37SUS4FYVH2LBU4DXHPRESLBDDHZHHEPA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.095032022 (331h53m42.865673367s) [noise=true , address=64.49.13.154:4932 , piece_id=4CXUMWUQ37E5ATJKWKIABQKZID2G5PRB563D3LAQTIWCZOLYI76Q, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.428652819 (331h53m43.199294155s) [noise=true , address=104.36.82.18:4397 , piece_id=VF4FXOENNLGT3N7ZJ3T7EPYEW6H3YS4ZKHHQJSNLJYOCMGFXVZDQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.448309175 (331h53m43.21895051s) [noise=true , address=104.36.82.3:4773 , piece_id=I2XCDVOZ5RWEMWJCBM5FATOKDCUZJFC7G2KTFILU66LJU7NLC5RQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.460440203 (331h53m43.231081538s) [noise=true , address=104.36.82.45:4927 , piece_id=6ZFIELGIKBDL2IKSE7EQP25Z7HPBP4GRSF5Y2YXUWZX54RV3ZAFA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.462441062 (331h53m43.233082407s) [noise=true , address=104.36.82.21:4479 , piece_id=56PCCZDSZH545QXGLGRZN2IUDPIF6MTHKAULXZYVAV6BOAE632YQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.479297731 (331h53m43.249939056s) [noise=true , address=104.36.82.23:4470 , piece_id=Y3NJ45DLDTZSHKMHTANQ6VTL3BX46Y2LD2QGBK5S5SLAFDJBGPSQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.505733477 (331h53m43.276374812s) [noise=true , address=104.36.82.12:4173 , piece_id=5HUGZCEFE3JCGN4PUHPP4IGVCRN2R4KHPIBQJUUTAEGOLDISXF4Q, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.574289655 (331h53m43.34493099s) [noise=true , address=104.36.82.14:4248 , piece_id=GQVC4QYUSXVHM3WZ3OT7XSB42HEOEWHYVBMVGQVSMDFINDON6BSA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.577275016 (331h53m43.347916351s) [noise=true , address=77.90.31.10:4540 , piece_id=3MKHY4HDZSK5YOPP5HYVMEOWWEGDCJUPYEUW2TFPOSATOT2FMWQA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.577418831 (331h53m43.348060166s) [noise=true , address=77.90.31.16:4751 , piece_id=DQNZ6VYCO2WPLAT7CGMQOTIRXLLJTYRCUCVLI3RJZCYUZT3F6YXQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.579017850 (331h53m43.349659185s) [noise=true , address=77.90.31.16:4748 , piece_id=DRUW5HWKQF3LY5AXUQBD4MC2K2TMHJHXBDOP5DRL5WCSIV6KZDHA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.580192378 (331h53m43.350833713s) [noise=true , address=77.90.31.14:4674 , piece_id=KUGSISFXDEFATV2BHKW34NREXENVYMNZRSM3VTXHCZOLBWYCO3IA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.580210843 (331h53m43.350852178s) [seg_pos={0 0}, upload=265483]: Segment reached optimal threshold of 14 pieces.
Jul 7 05:04:08.580342875 (331h53m43.35098421s) [noise=true , address=77.90.31.21:4903 , piece_id=JWQTRU7GLKHFXFBV2KYINTA2SEAUNDWTXER2XLNYIBXNC3KWF5ZA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZYWQ1a2sTKnFpF28iQVrem2s8nSpXkeJzZDaS7jvTZNANdfp): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580430292 (331h53m43.351071627s) [noise=true , address=45.91.116.9:4264 , piece_id=BAUPMJNTKX5S6NGVZYISJH5EJIVMVICZP4PNUKM6D525UNKAJBUA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128f6i7ALVXF3Vr8G8zsZXrNBFiT3cK8UAiic5XbFS1gRjZK86m): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580552847 (331h53m43.351194172s) [noise=true , address=77.90.31.17:4801 , piece_id=DHPU2ISCQWL6TOZQED7BG6JJ5DYRJW5FAYO4MGLB3KEOLVNC3CFA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127QRLNwZLcR5gnAgZrCjSUsH5T4jESmZ4kWeAnpj9YxaTSjoYe): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580638251 (331h53m43.351279586s) [noise=true , address=104.36.82.5:4855 , piece_id=5JPBSZRWWMGKSECM2XBHVQUT3F4U7JXCVXFKYKEJD27W3C5PCWNQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection; write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection
Jul 7 05:04:08.580668078 (331h53m43.351309413s) [seg_pos={0 0}, upload=265483]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 7 05:04:08.580803337 (331h53m43.351444672s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:04:08.580809508 (331h53m43.351450843s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:04:08.869629195 (331h53m43.64027053s) [upload=265483]: Done uploading segments...
Jul 7 05:04:08.869647730 (331h53m43.640289065s) [upload=265483]: Upload finished. err: <nil>
Duration: 5.547308418s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
5.76809425s
FAIL (2025-07-07 05:20:15 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 5.768129668s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
5.700128728s
FAIL (2025-07-07 05:19:40 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
65483]: Got next segment. Inline: false
Jul 7 05:04:06.097422800 (331h53m40.868064135s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:04:06.097428120 (331h53m40.868069445s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:04:06.623732228 (331h53m41.394373563s) [seg_pos={0 0}, upload=265483]: Begin upload segment...
Jul 7 05:04:06.623774189 (331h53m41.394415524s) [seg_pos={0 0}, upload=265483]: Done begin upload segment.
Jul 7 05:04:06.623795539 (331h53m41.394436874s) [noise=true , address=77.90.31.14:4674 , piece_id=KUGSISFXDEFATV2BHKW34NREXENVYMNZRSM3VTXHCZOLBWYCO3IA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.623850364 (331h53m41.394491699s) [noise=true , address=77.90.31.17:4801 , piece_id=DHPU2ISCQWL6TOZQED7BG6JJ5DYRJW5FAYO4MGLB3KEOLVNC3CFA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624347755 (331h53m41.39498909s) [noise=true , address=77.90.31.16:4751 , piece_id=DQNZ6VYCO2WPLAT7CGMQOTIRXLLJTYRCUCVLI3RJZCYUZT3F6YXQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624383835 (331h53m41.39502517s) [noise=true , address=104.36.82.14:4248 , piece_id=GQVC4QYUSXVHM3WZ3OT7XSB42HEOEWHYVBMVGQVSMDFINDON6BSA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624634515 (331h53m41.39527585s) [noise=true , address=45.91.116.9:4264 , piece_id=BAUPMJNTKX5S6NGVZYISJH5EJIVMVICZP4PNUKM6D525UNKAJBUA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624844035 (331h53m41.39548537s) [noise=true , address=104.36.82.45:4927 , piece_id=6ZFIELGIKBDL2IKSE7EQP25Z7HPBP4GRSF5Y2YXUWZX54RV3ZAFA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624903259 (331h53m41.395544594s) [noise=true , address=104.36.82.18:4397 , piece_id=VF4FXOENNLGT3N7ZJ3T7EPYEW6H3YS4ZKHHQJSNLJYOCMGFXVZDQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625117729 (331h53m41.395759064s) [noise=true , address=64.49.13.27:4966 , piece_id=HPG7X2LX5N5CJHAQAWM6JKYHAOPOWRPUXEVWT4SDGYJKPKN2TRKA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625170019 (331h53m41.395811354s) [noise=true , address=104.36.82.5:4855 , piece_id=5JPBSZRWWMGKSECM2XBHVQUT3F4U7JXCVXFKYKEJD27W3C5PCWNQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625343822 (331h53m41.395985157s) [noise=true , address=104.36.82.12:4173 , piece_id=5HUGZCEFE3JCGN4PUHPP4IGVCRN2R4KHPIBQJUUTAEGOLDISXF4Q, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625394227 (331h53m41.396035563s) [noise=true , address=64.49.13.154:4932 , piece_id=4CXUMWUQ37E5ATJKWKIABQKZID2G5PRB563D3LAQTIWCZOLYI76Q, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625563120 (331h53m41.396204456s) [noise=true , address=104.36.82.3:4773 , piece_id=I2XCDVOZ5RWEMWJCBM5FATOKDCUZJFC7G2KTFILU66LJU7NLC5RQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625612635 (331h53m41.39625397s) [noise=true , address=64.49.13.140:4510 , piece_id=SUB4NNB6ZG7TGV76LBI37SUS4FYVH2LBU4DXHPRESLBDDHZHHEPA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625788693 (331h53m41.396430028s) [noise=true , address=77.90.31.16:4748 , piece_id=DRUW5HWKQF3LY5AXUQBD4MC2K2TMHJHXBDOP5DRL5WCSIV6KZDHA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625854649 (331h53m41.396495984s) [noise=true , address=104.36.82.21:4479 , piece_id=56PCCZDSZH545QXGLGRZN2IUDPIF6MTHKAULXZYVAV6BOAE632YQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626075631 (331h53m41.396716966s) [noise=true , address=77.90.31.10:4540 , piece_id=3MKHY4HDZSK5YOPP5HYVMEOWWEGDCJUPYEUW2TFPOSATOT2FMWQA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626273520 (331h53m41.396914855s) [noise=true , address=104.36.82.23:4470 , piece_id=Y3NJ45DLDTZSHKMHTANQ6VTL3BX46Y2LD2QGBK5S5SLAFDJBGPSQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626467301 (331h53m41.397108636s) [noise=true , address=77.90.31.21:4903 , piece_id=JWQTRU7GLKHFXFBV2KYINTA2SEAUNDWTXER2XLNYIBXNC3KWF5ZA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:07.724567296 (331h53m42.495208631s) [upload=265483]: Next returned nil segment
Jul 7 05:04:07.724584218 (331h53m42.495225543s) [upload=265483]: Waiting for error group managing segments...
Jul 7 05:04:08.028542246 (331h53m42.799183581s) [noise=true , address=64.49.13.27:4966 , piece_id=HPG7X2LX5N5CJHAQAWM6JKYHAOPOWRPUXEVWT4SDGYJKPKN2TRKA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.070346103 (331h53m42.840987438s) [noise=true , address=64.49.13.140:4510 , piece_id=SUB4NNB6ZG7TGV76LBI37SUS4FYVH2LBU4DXHPRESLBDDHZHHEPA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.095032022 (331h53m42.865673367s) [noise=true , address=64.49.13.154:4932 , piece_id=4CXUMWUQ37E5ATJKWKIABQKZID2G5PRB563D3LAQTIWCZOLYI76Q, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.428652819 (331h53m43.199294155s) [noise=true , address=104.36.82.18:4397 , piece_id=VF4FXOENNLGT3N7ZJ3T7EPYEW6H3YS4ZKHHQJSNLJYOCMGFXVZDQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.448309175 (331h53m43.21895051s) [noise=true , address=104.36.82.3:4773 , piece_id=I2XCDVOZ5RWEMWJCBM5FATOKDCUZJFC7G2KTFILU66LJU7NLC5RQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.460440203 (331h53m43.231081538s) [noise=true , address=104.36.82.45:4927 , piece_id=6ZFIELGIKBDL2IKSE7EQP25Z7HPBP4GRSF5Y2YXUWZX54RV3ZAFA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.462441062 (331h53m43.233082407s) [noise=true , address=104.36.82.21:4479 , piece_id=56PCCZDSZH545QXGLGRZN2IUDPIF6MTHKAULXZYVAV6BOAE632YQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.479297731 (331h53m43.249939056s) [noise=true , address=104.36.82.23:4470 , piece_id=Y3NJ45DLDTZSHKMHTANQ6VTL3BX46Y2LD2QGBK5S5SLAFDJBGPSQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.505733477 (331h53m43.276374812s) [noise=true , address=104.36.82.12:4173 , piece_id=5HUGZCEFE3JCGN4PUHPP4IGVCRN2R4KHPIBQJUUTAEGOLDISXF4Q, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.574289655 (331h53m43.34493099s) [noise=true , address=104.36.82.14:4248 , piece_id=GQVC4QYUSXVHM3WZ3OT7XSB42HEOEWHYVBMVGQVSMDFINDON6BSA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.577275016 (331h53m43.347916351s) [noise=true , address=77.90.31.10:4540 , piece_id=3MKHY4HDZSK5YOPP5HYVMEOWWEGDCJUPYEUW2TFPOSATOT2FMWQA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.577418831 (331h53m43.348060166s) [noise=true , address=77.90.31.16:4751 , piece_id=DQNZ6VYCO2WPLAT7CGMQOTIRXLLJTYRCUCVLI3RJZCYUZT3F6YXQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.579017850 (331h53m43.349659185s) [noise=true , address=77.90.31.16:4748 , piece_id=DRUW5HWKQF3LY5AXUQBD4MC2K2TMHJHXBDOP5DRL5WCSIV6KZDHA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.580192378 (331h53m43.350833713s) [noise=true , address=77.90.31.14:4674 , piece_id=KUGSISFXDEFATV2BHKW34NREXENVYMNZRSM3VTXHCZOLBWYCO3IA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.580210843 (331h53m43.350852178s) [seg_pos={0 0}, upload=265483]: Segment reached optimal threshold of 14 pieces.
Jul 7 05:04:08.580342875 (331h53m43.35098421s) [noise=true , address=77.90.31.21:4903 , piece_id=JWQTRU7GLKHFXFBV2KYINTA2SEAUNDWTXER2XLNYIBXNC3KWF5ZA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZYWQ1a2sTKnFpF28iQVrem2s8nSpXkeJzZDaS7jvTZNANdfp): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580430292 (331h53m43.351071627s) [noise=true , address=45.91.116.9:4264 , piece_id=BAUPMJNTKX5S6NGVZYISJH5EJIVMVICZP4PNUKM6D525UNKAJBUA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128f6i7ALVXF3Vr8G8zsZXrNBFiT3cK8UAiic5XbFS1gRjZK86m): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580552847 (331h53m43.351194172s) [noise=true , address=77.90.31.17:4801 , piece_id=DHPU2ISCQWL6TOZQED7BG6JJ5DYRJW5FAYO4MGLB3KEOLVNC3CFA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127QRLNwZLcR5gnAgZrCjSUsH5T4jESmZ4kWeAnpj9YxaTSjoYe): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580638251 (331h53m43.351279586s) [noise=true , address=104.36.82.5:4855 , piece_id=5JPBSZRWWMGKSECM2XBHVQUT3F4U7JXCVXFKYKEJD27W3C5PCWNQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection; write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection
Jul 7 05:04:08.580668078 (331h53m43.351309413s) [seg_pos={0 0}, upload=265483]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 7 05:04:08.580803337 (331h53m43.351444672s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:04:08.580809508 (331h53m43.351450843s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:04:08.869629195 (331h53m43.64027053s) [upload=265483]: Done uploading segments...
Jul 7 05:04:08.869647730 (331h53m43.640289065s) [upload=265483]: Upload finished. err: <nil>
Duration: 5.70015649s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
5.733025481s
FAIL (2025-07-07 05:19:37 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 5.733052343s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
5.503640301s
FAIL (2025-07-07 05:18:51 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
65483]: Got next segment. Inline: false
Jul 7 05:04:06.097422800 (331h53m40.868064135s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:04:06.097428120 (331h53m40.868069445s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:04:06.623732228 (331h53m41.394373563s) [seg_pos={0 0}, upload=265483]: Begin upload segment...
Jul 7 05:04:06.623774189 (331h53m41.394415524s) [seg_pos={0 0}, upload=265483]: Done begin upload segment.
Jul 7 05:04:06.623795539 (331h53m41.394436874s) [noise=true , address=77.90.31.14:4674 , piece_id=KUGSISFXDEFATV2BHKW34NREXENVYMNZRSM3VTXHCZOLBWYCO3IA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.623850364 (331h53m41.394491699s) [noise=true , address=77.90.31.17:4801 , piece_id=DHPU2ISCQWL6TOZQED7BG6JJ5DYRJW5FAYO4MGLB3KEOLVNC3CFA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624347755 (331h53m41.39498909s) [noise=true , address=77.90.31.16:4751 , piece_id=DQNZ6VYCO2WPLAT7CGMQOTIRXLLJTYRCUCVLI3RJZCYUZT3F6YXQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624383835 (331h53m41.39502517s) [noise=true , address=104.36.82.14:4248 , piece_id=GQVC4QYUSXVHM3WZ3OT7XSB42HEOEWHYVBMVGQVSMDFINDON6BSA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624634515 (331h53m41.39527585s) [noise=true , address=45.91.116.9:4264 , piece_id=BAUPMJNTKX5S6NGVZYISJH5EJIVMVICZP4PNUKM6D525UNKAJBUA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624844035 (331h53m41.39548537s) [noise=true , address=104.36.82.45:4927 , piece_id=6ZFIELGIKBDL2IKSE7EQP25Z7HPBP4GRSF5Y2YXUWZX54RV3ZAFA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624903259 (331h53m41.395544594s) [noise=true , address=104.36.82.18:4397 , piece_id=VF4FXOENNLGT3N7ZJ3T7EPYEW6H3YS4ZKHHQJSNLJYOCMGFXVZDQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625117729 (331h53m41.395759064s) [noise=true , address=64.49.13.27:4966 , piece_id=HPG7X2LX5N5CJHAQAWM6JKYHAOPOWRPUXEVWT4SDGYJKPKN2TRKA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625170019 (331h53m41.395811354s) [noise=true , address=104.36.82.5:4855 , piece_id=5JPBSZRWWMGKSECM2XBHVQUT3F4U7JXCVXFKYKEJD27W3C5PCWNQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625343822 (331h53m41.395985157s) [noise=true , address=104.36.82.12:4173 , piece_id=5HUGZCEFE3JCGN4PUHPP4IGVCRN2R4KHPIBQJUUTAEGOLDISXF4Q, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625394227 (331h53m41.396035563s) [noise=true , address=64.49.13.154:4932 , piece_id=4CXUMWUQ37E5ATJKWKIABQKZID2G5PRB563D3LAQTIWCZOLYI76Q, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625563120 (331h53m41.396204456s) [noise=true , address=104.36.82.3:4773 , piece_id=I2XCDVOZ5RWEMWJCBM5FATOKDCUZJFC7G2KTFILU66LJU7NLC5RQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625612635 (331h53m41.39625397s) [noise=true , address=64.49.13.140:4510 , piece_id=SUB4NNB6ZG7TGV76LBI37SUS4FYVH2LBU4DXHPRESLBDDHZHHEPA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625788693 (331h53m41.396430028s) [noise=true , address=77.90.31.16:4748 , piece_id=DRUW5HWKQF3LY5AXUQBD4MC2K2TMHJHXBDOP5DRL5WCSIV6KZDHA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625854649 (331h53m41.396495984s) [noise=true , address=104.36.82.21:4479 , piece_id=56PCCZDSZH545QXGLGRZN2IUDPIF6MTHKAULXZYVAV6BOAE632YQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626075631 (331h53m41.396716966s) [noise=true , address=77.90.31.10:4540 , piece_id=3MKHY4HDZSK5YOPP5HYVMEOWWEGDCJUPYEUW2TFPOSATOT2FMWQA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626273520 (331h53m41.396914855s) [noise=true , address=104.36.82.23:4470 , piece_id=Y3NJ45DLDTZSHKMHTANQ6VTL3BX46Y2LD2QGBK5S5SLAFDJBGPSQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626467301 (331h53m41.397108636s) [noise=true , address=77.90.31.21:4903 , piece_id=JWQTRU7GLKHFXFBV2KYINTA2SEAUNDWTXER2XLNYIBXNC3KWF5ZA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:07.724567296 (331h53m42.495208631s) [upload=265483]: Next returned nil segment
Jul 7 05:04:07.724584218 (331h53m42.495225543s) [upload=265483]: Waiting for error group managing segments...
Jul 7 05:04:08.028542246 (331h53m42.799183581s) [noise=true , address=64.49.13.27:4966 , piece_id=HPG7X2LX5N5CJHAQAWM6JKYHAOPOWRPUXEVWT4SDGYJKPKN2TRKA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.070346103 (331h53m42.840987438s) [noise=true , address=64.49.13.140:4510 , piece_id=SUB4NNB6ZG7TGV76LBI37SUS4FYVH2LBU4DXHPRESLBDDHZHHEPA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.095032022 (331h53m42.865673367s) [noise=true , address=64.49.13.154:4932 , piece_id=4CXUMWUQ37E5ATJKWKIABQKZID2G5PRB563D3LAQTIWCZOLYI76Q, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.428652819 (331h53m43.199294155s) [noise=true , address=104.36.82.18:4397 , piece_id=VF4FXOENNLGT3N7ZJ3T7EPYEW6H3YS4ZKHHQJSNLJYOCMGFXVZDQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.448309175 (331h53m43.21895051s) [noise=true , address=104.36.82.3:4773 , piece_id=I2XCDVOZ5RWEMWJCBM5FATOKDCUZJFC7G2KTFILU66LJU7NLC5RQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.460440203 (331h53m43.231081538s) [noise=true , address=104.36.82.45:4927 , piece_id=6ZFIELGIKBDL2IKSE7EQP25Z7HPBP4GRSF5Y2YXUWZX54RV3ZAFA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.462441062 (331h53m43.233082407s) [noise=true , address=104.36.82.21:4479 , piece_id=56PCCZDSZH545QXGLGRZN2IUDPIF6MTHKAULXZYVAV6BOAE632YQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.479297731 (331h53m43.249939056s) [noise=true , address=104.36.82.23:4470 , piece_id=Y3NJ45DLDTZSHKMHTANQ6VTL3BX46Y2LD2QGBK5S5SLAFDJBGPSQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.505733477 (331h53m43.276374812s) [noise=true , address=104.36.82.12:4173 , piece_id=5HUGZCEFE3JCGN4PUHPP4IGVCRN2R4KHPIBQJUUTAEGOLDISXF4Q, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.574289655 (331h53m43.34493099s) [noise=true , address=104.36.82.14:4248 , piece_id=GQVC4QYUSXVHM3WZ3OT7XSB42HEOEWHYVBMVGQVSMDFINDON6BSA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.577275016 (331h53m43.347916351s) [noise=true , address=77.90.31.10:4540 , piece_id=3MKHY4HDZSK5YOPP5HYVMEOWWEGDCJUPYEUW2TFPOSATOT2FMWQA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.577418831 (331h53m43.348060166s) [noise=true , address=77.90.31.16:4751 , piece_id=DQNZ6VYCO2WPLAT7CGMQOTIRXLLJTYRCUCVLI3RJZCYUZT3F6YXQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.579017850 (331h53m43.349659185s) [noise=true , address=77.90.31.16:4748 , piece_id=DRUW5HWKQF3LY5AXUQBD4MC2K2TMHJHXBDOP5DRL5WCSIV6KZDHA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.580192378 (331h53m43.350833713s) [noise=true , address=77.90.31.14:4674 , piece_id=KUGSISFXDEFATV2BHKW34NREXENVYMNZRSM3VTXHCZOLBWYCO3IA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.580210843 (331h53m43.350852178s) [seg_pos={0 0}, upload=265483]: Segment reached optimal threshold of 14 pieces.
Jul 7 05:04:08.580342875 (331h53m43.35098421s) [noise=true , address=77.90.31.21:4903 , piece_id=JWQTRU7GLKHFXFBV2KYINTA2SEAUNDWTXER2XLNYIBXNC3KWF5ZA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZYWQ1a2sTKnFpF28iQVrem2s8nSpXkeJzZDaS7jvTZNANdfp): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580430292 (331h53m43.351071627s) [noise=true , address=45.91.116.9:4264 , piece_id=BAUPMJNTKX5S6NGVZYISJH5EJIVMVICZP4PNUKM6D525UNKAJBUA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128f6i7ALVXF3Vr8G8zsZXrNBFiT3cK8UAiic5XbFS1gRjZK86m): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580552847 (331h53m43.351194172s) [noise=true , address=77.90.31.17:4801 , piece_id=DHPU2ISCQWL6TOZQED7BG6JJ5DYRJW5FAYO4MGLB3KEOLVNC3CFA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127QRLNwZLcR5gnAgZrCjSUsH5T4jESmZ4kWeAnpj9YxaTSjoYe): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580638251 (331h53m43.351279586s) [noise=true , address=104.36.82.5:4855 , piece_id=5JPBSZRWWMGKSECM2XBHVQUT3F4U7JXCVXFKYKEJD27W3C5PCWNQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection; write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection
Jul 7 05:04:08.580668078 (331h53m43.351309413s) [seg_pos={0 0}, upload=265483]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 7 05:04:08.580803337 (331h53m43.351444672s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:04:08.580809508 (331h53m43.351450843s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:04:08.869629195 (331h53m43.64027053s) [upload=265483]: Done uploading segments...
Jul 7 05:04:08.869647730 (331h53m43.640289065s) [upload=265483]: Upload finished. err: <nil>
Duration: 5.503667724s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
5.702161454s
FAIL (2025-07-07 05:18:32 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
65483]: Got next segment. Inline: false
Jul 7 05:04:06.097422800 (331h53m40.868064135s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:04:06.097428120 (331h53m40.868069445s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:04:06.623732228 (331h53m41.394373563s) [seg_pos={0 0}, upload=265483]: Begin upload segment...
Jul 7 05:04:06.623774189 (331h53m41.394415524s) [seg_pos={0 0}, upload=265483]: Done begin upload segment.
Jul 7 05:04:06.623795539 (331h53m41.394436874s) [noise=true , address=77.90.31.14:4674 , piece_id=KUGSISFXDEFATV2BHKW34NREXENVYMNZRSM3VTXHCZOLBWYCO3IA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.623850364 (331h53m41.394491699s) [noise=true , address=77.90.31.17:4801 , piece_id=DHPU2ISCQWL6TOZQED7BG6JJ5DYRJW5FAYO4MGLB3KEOLVNC3CFA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624347755 (331h53m41.39498909s) [noise=true , address=77.90.31.16:4751 , piece_id=DQNZ6VYCO2WPLAT7CGMQOTIRXLLJTYRCUCVLI3RJZCYUZT3F6YXQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624383835 (331h53m41.39502517s) [noise=true , address=104.36.82.14:4248 , piece_id=GQVC4QYUSXVHM3WZ3OT7XSB42HEOEWHYVBMVGQVSMDFINDON6BSA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624634515 (331h53m41.39527585s) [noise=true , address=45.91.116.9:4264 , piece_id=BAUPMJNTKX5S6NGVZYISJH5EJIVMVICZP4PNUKM6D525UNKAJBUA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624844035 (331h53m41.39548537s) [noise=true , address=104.36.82.45:4927 , piece_id=6ZFIELGIKBDL2IKSE7EQP25Z7HPBP4GRSF5Y2YXUWZX54RV3ZAFA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624903259 (331h53m41.395544594s) [noise=true , address=104.36.82.18:4397 , piece_id=VF4FXOENNLGT3N7ZJ3T7EPYEW6H3YS4ZKHHQJSNLJYOCMGFXVZDQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625117729 (331h53m41.395759064s) [noise=true , address=64.49.13.27:4966 , piece_id=HPG7X2LX5N5CJHAQAWM6JKYHAOPOWRPUXEVWT4SDGYJKPKN2TRKA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625170019 (331h53m41.395811354s) [noise=true , address=104.36.82.5:4855 , piece_id=5JPBSZRWWMGKSECM2XBHVQUT3F4U7JXCVXFKYKEJD27W3C5PCWNQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625343822 (331h53m41.395985157s) [noise=true , address=104.36.82.12:4173 , piece_id=5HUGZCEFE3JCGN4PUHPP4IGVCRN2R4KHPIBQJUUTAEGOLDISXF4Q, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625394227 (331h53m41.396035563s) [noise=true , address=64.49.13.154:4932 , piece_id=4CXUMWUQ37E5ATJKWKIABQKZID2G5PRB563D3LAQTIWCZOLYI76Q, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625563120 (331h53m41.396204456s) [noise=true , address=104.36.82.3:4773 , piece_id=I2XCDVOZ5RWEMWJCBM5FATOKDCUZJFC7G2KTFILU66LJU7NLC5RQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625612635 (331h53m41.39625397s) [noise=true , address=64.49.13.140:4510 , piece_id=SUB4NNB6ZG7TGV76LBI37SUS4FYVH2LBU4DXHPRESLBDDHZHHEPA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625788693 (331h53m41.396430028s) [noise=true , address=77.90.31.16:4748 , piece_id=DRUW5HWKQF3LY5AXUQBD4MC2K2TMHJHXBDOP5DRL5WCSIV6KZDHA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625854649 (331h53m41.396495984s) [noise=true , address=104.36.82.21:4479 , piece_id=56PCCZDSZH545QXGLGRZN2IUDPIF6MTHKAULXZYVAV6BOAE632YQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626075631 (331h53m41.396716966s) [noise=true , address=77.90.31.10:4540 , piece_id=3MKHY4HDZSK5YOPP5HYVMEOWWEGDCJUPYEUW2TFPOSATOT2FMWQA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626273520 (331h53m41.396914855s) [noise=true , address=104.36.82.23:4470 , piece_id=Y3NJ45DLDTZSHKMHTANQ6VTL3BX46Y2LD2QGBK5S5SLAFDJBGPSQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626467301 (331h53m41.397108636s) [noise=true , address=77.90.31.21:4903 , piece_id=JWQTRU7GLKHFXFBV2KYINTA2SEAUNDWTXER2XLNYIBXNC3KWF5ZA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:07.724567296 (331h53m42.495208631s) [upload=265483]: Next returned nil segment
Jul 7 05:04:07.724584218 (331h53m42.495225543s) [upload=265483]: Waiting for error group managing segments...
Jul 7 05:04:08.028542246 (331h53m42.799183581s) [noise=true , address=64.49.13.27:4966 , piece_id=HPG7X2LX5N5CJHAQAWM6JKYHAOPOWRPUXEVWT4SDGYJKPKN2TRKA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.070346103 (331h53m42.840987438s) [noise=true , address=64.49.13.140:4510 , piece_id=SUB4NNB6ZG7TGV76LBI37SUS4FYVH2LBU4DXHPRESLBDDHZHHEPA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.095032022 (331h53m42.865673367s) [noise=true , address=64.49.13.154:4932 , piece_id=4CXUMWUQ37E5ATJKWKIABQKZID2G5PRB563D3LAQTIWCZOLYI76Q, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.428652819 (331h53m43.199294155s) [noise=true , address=104.36.82.18:4397 , piece_id=VF4FXOENNLGT3N7ZJ3T7EPYEW6H3YS4ZKHHQJSNLJYOCMGFXVZDQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.448309175 (331h53m43.21895051s) [noise=true , address=104.36.82.3:4773 , piece_id=I2XCDVOZ5RWEMWJCBM5FATOKDCUZJFC7G2KTFILU66LJU7NLC5RQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.460440203 (331h53m43.231081538s) [noise=true , address=104.36.82.45:4927 , piece_id=6ZFIELGIKBDL2IKSE7EQP25Z7HPBP4GRSF5Y2YXUWZX54RV3ZAFA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.462441062 (331h53m43.233082407s) [noise=true , address=104.36.82.21:4479 , piece_id=56PCCZDSZH545QXGLGRZN2IUDPIF6MTHKAULXZYVAV6BOAE632YQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.479297731 (331h53m43.249939056s) [noise=true , address=104.36.82.23:4470 , piece_id=Y3NJ45DLDTZSHKMHTANQ6VTL3BX46Y2LD2QGBK5S5SLAFDJBGPSQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.505733477 (331h53m43.276374812s) [noise=true , address=104.36.82.12:4173 , piece_id=5HUGZCEFE3JCGN4PUHPP4IGVCRN2R4KHPIBQJUUTAEGOLDISXF4Q, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.574289655 (331h53m43.34493099s) [noise=true , address=104.36.82.14:4248 , piece_id=GQVC4QYUSXVHM3WZ3OT7XSB42HEOEWHYVBMVGQVSMDFINDON6BSA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.577275016 (331h53m43.347916351s) [noise=true , address=77.90.31.10:4540 , piece_id=3MKHY4HDZSK5YOPP5HYVMEOWWEGDCJUPYEUW2TFPOSATOT2FMWQA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.577418831 (331h53m43.348060166s) [noise=true , address=77.90.31.16:4751 , piece_id=DQNZ6VYCO2WPLAT7CGMQOTIRXLLJTYRCUCVLI3RJZCYUZT3F6YXQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.579017850 (331h53m43.349659185s) [noise=true , address=77.90.31.16:4748 , piece_id=DRUW5HWKQF3LY5AXUQBD4MC2K2TMHJHXBDOP5DRL5WCSIV6KZDHA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.580192378 (331h53m43.350833713s) [noise=true , address=77.90.31.14:4674 , piece_id=KUGSISFXDEFATV2BHKW34NREXENVYMNZRSM3VTXHCZOLBWYCO3IA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.580210843 (331h53m43.350852178s) [seg_pos={0 0}, upload=265483]: Segment reached optimal threshold of 14 pieces.
Jul 7 05:04:08.580342875 (331h53m43.35098421s) [noise=true , address=77.90.31.21:4903 , piece_id=JWQTRU7GLKHFXFBV2KYINTA2SEAUNDWTXER2XLNYIBXNC3KWF5ZA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZYWQ1a2sTKnFpF28iQVrem2s8nSpXkeJzZDaS7jvTZNANdfp): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580430292 (331h53m43.351071627s) [noise=true , address=45.91.116.9:4264 , piece_id=BAUPMJNTKX5S6NGVZYISJH5EJIVMVICZP4PNUKM6D525UNKAJBUA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128f6i7ALVXF3Vr8G8zsZXrNBFiT3cK8UAiic5XbFS1gRjZK86m): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580552847 (331h53m43.351194172s) [noise=true , address=77.90.31.17:4801 , piece_id=DHPU2ISCQWL6TOZQED7BG6JJ5DYRJW5FAYO4MGLB3KEOLVNC3CFA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127QRLNwZLcR5gnAgZrCjSUsH5T4jESmZ4kWeAnpj9YxaTSjoYe): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580638251 (331h53m43.351279586s) [noise=true , address=104.36.82.5:4855 , piece_id=5JPBSZRWWMGKSECM2XBHVQUT3F4U7JXCVXFKYKEJD27W3C5PCWNQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection; write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection
Jul 7 05:04:08.580668078 (331h53m43.351309413s) [seg_pos={0 0}, upload=265483]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 7 05:04:08.580803337 (331h53m43.351444672s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:04:08.580809508 (331h53m43.351450843s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:04:08.869629195 (331h53m43.64027053s) [upload=265483]: Done uploading segments...
Jul 7 05:04:08.869647730 (331h53m43.640289065s) [upload=265483]: Upload finished. err: <nil>
Duration: 5.702183957s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
5.678435813s
FAIL (2025-07-07 05:18:30 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 5.678457816s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
5.496206883s
FAIL (2025-07-07 05:18:06 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 5.496234997s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
5.746327027s
FAIL (2025-07-07 05:17:40 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 5.746354339s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
5.47336658s
FAIL (2025-07-07 05:17:21 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
65483]: Got next segment. Inline: false
Jul 7 05:04:06.097422800 (331h53m40.868064135s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:04:06.097428120 (331h53m40.868069445s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:04:06.623732228 (331h53m41.394373563s) [seg_pos={0 0}, upload=265483]: Begin upload segment...
Jul 7 05:04:06.623774189 (331h53m41.394415524s) [seg_pos={0 0}, upload=265483]: Done begin upload segment.
Jul 7 05:04:06.623795539 (331h53m41.394436874s) [noise=true , address=77.90.31.14:4674 , piece_id=KUGSISFXDEFATV2BHKW34NREXENVYMNZRSM3VTXHCZOLBWYCO3IA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.623850364 (331h53m41.394491699s) [noise=true , address=77.90.31.17:4801 , piece_id=DHPU2ISCQWL6TOZQED7BG6JJ5DYRJW5FAYO4MGLB3KEOLVNC3CFA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624347755 (331h53m41.39498909s) [noise=true , address=77.90.31.16:4751 , piece_id=DQNZ6VYCO2WPLAT7CGMQOTIRXLLJTYRCUCVLI3RJZCYUZT3F6YXQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624383835 (331h53m41.39502517s) [noise=true , address=104.36.82.14:4248 , piece_id=GQVC4QYUSXVHM3WZ3OT7XSB42HEOEWHYVBMVGQVSMDFINDON6BSA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624634515 (331h53m41.39527585s) [noise=true , address=45.91.116.9:4264 , piece_id=BAUPMJNTKX5S6NGVZYISJH5EJIVMVICZP4PNUKM6D525UNKAJBUA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624844035 (331h53m41.39548537s) [noise=true , address=104.36.82.45:4927 , piece_id=6ZFIELGIKBDL2IKSE7EQP25Z7HPBP4GRSF5Y2YXUWZX54RV3ZAFA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624903259 (331h53m41.395544594s) [noise=true , address=104.36.82.18:4397 , piece_id=VF4FXOENNLGT3N7ZJ3T7EPYEW6H3YS4ZKHHQJSNLJYOCMGFXVZDQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625117729 (331h53m41.395759064s) [noise=true , address=64.49.13.27:4966 , piece_id=HPG7X2LX5N5CJHAQAWM6JKYHAOPOWRPUXEVWT4SDGYJKPKN2TRKA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625170019 (331h53m41.395811354s) [noise=true , address=104.36.82.5:4855 , piece_id=5JPBSZRWWMGKSECM2XBHVQUT3F4U7JXCVXFKYKEJD27W3C5PCWNQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625343822 (331h53m41.395985157s) [noise=true , address=104.36.82.12:4173 , piece_id=5HUGZCEFE3JCGN4PUHPP4IGVCRN2R4KHPIBQJUUTAEGOLDISXF4Q, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625394227 (331h53m41.396035563s) [noise=true , address=64.49.13.154:4932 , piece_id=4CXUMWUQ37E5ATJKWKIABQKZID2G5PRB563D3LAQTIWCZOLYI76Q, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625563120 (331h53m41.396204456s) [noise=true , address=104.36.82.3:4773 , piece_id=I2XCDVOZ5RWEMWJCBM5FATOKDCUZJFC7G2KTFILU66LJU7NLC5RQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625612635 (331h53m41.39625397s) [noise=true , address=64.49.13.140:4510 , piece_id=SUB4NNB6ZG7TGV76LBI37SUS4FYVH2LBU4DXHPRESLBDDHZHHEPA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625788693 (331h53m41.396430028s) [noise=true , address=77.90.31.16:4748 , piece_id=DRUW5HWKQF3LY5AXUQBD4MC2K2TMHJHXBDOP5DRL5WCSIV6KZDHA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625854649 (331h53m41.396495984s) [noise=true , address=104.36.82.21:4479 , piece_id=56PCCZDSZH545QXGLGRZN2IUDPIF6MTHKAULXZYVAV6BOAE632YQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626075631 (331h53m41.396716966s) [noise=true , address=77.90.31.10:4540 , piece_id=3MKHY4HDZSK5YOPP5HYVMEOWWEGDCJUPYEUW2TFPOSATOT2FMWQA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626273520 (331h53m41.396914855s) [noise=true , address=104.36.82.23:4470 , piece_id=Y3NJ45DLDTZSHKMHTANQ6VTL3BX46Y2LD2QGBK5S5SLAFDJBGPSQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626467301 (331h53m41.397108636s) [noise=true , address=77.90.31.21:4903 , piece_id=JWQTRU7GLKHFXFBV2KYINTA2SEAUNDWTXER2XLNYIBXNC3KWF5ZA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:07.724567296 (331h53m42.495208631s) [upload=265483]: Next returned nil segment
Jul 7 05:04:07.724584218 (331h53m42.495225543s) [upload=265483]: Waiting for error group managing segments...
Jul 7 05:04:08.028542246 (331h53m42.799183581s) [noise=true , address=64.49.13.27:4966 , piece_id=HPG7X2LX5N5CJHAQAWM6JKYHAOPOWRPUXEVWT4SDGYJKPKN2TRKA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.070346103 (331h53m42.840987438s) [noise=true , address=64.49.13.140:4510 , piece_id=SUB4NNB6ZG7TGV76LBI37SUS4FYVH2LBU4DXHPRESLBDDHZHHEPA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.095032022 (331h53m42.865673367s) [noise=true , address=64.49.13.154:4932 , piece_id=4CXUMWUQ37E5ATJKWKIABQKZID2G5PRB563D3LAQTIWCZOLYI76Q, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.428652819 (331h53m43.199294155s) [noise=true , address=104.36.82.18:4397 , piece_id=VF4FXOENNLGT3N7ZJ3T7EPYEW6H3YS4ZKHHQJSNLJYOCMGFXVZDQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.448309175 (331h53m43.21895051s) [noise=true , address=104.36.82.3:4773 , piece_id=I2XCDVOZ5RWEMWJCBM5FATOKDCUZJFC7G2KTFILU66LJU7NLC5RQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.460440203 (331h53m43.231081538s) [noise=true , address=104.36.82.45:4927 , piece_id=6ZFIELGIKBDL2IKSE7EQP25Z7HPBP4GRSF5Y2YXUWZX54RV3ZAFA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.462441062 (331h53m43.233082407s) [noise=true , address=104.36.82.21:4479 , piece_id=56PCCZDSZH545QXGLGRZN2IUDPIF6MTHKAULXZYVAV6BOAE632YQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.479297731 (331h53m43.249939056s) [noise=true , address=104.36.82.23:4470 , piece_id=Y3NJ45DLDTZSHKMHTANQ6VTL3BX46Y2LD2QGBK5S5SLAFDJBGPSQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.505733477 (331h53m43.276374812s) [noise=true , address=104.36.82.12:4173 , piece_id=5HUGZCEFE3JCGN4PUHPP4IGVCRN2R4KHPIBQJUUTAEGOLDISXF4Q, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.574289655 (331h53m43.34493099s) [noise=true , address=104.36.82.14:4248 , piece_id=GQVC4QYUSXVHM3WZ3OT7XSB42HEOEWHYVBMVGQVSMDFINDON6BSA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.577275016 (331h53m43.347916351s) [noise=true , address=77.90.31.10:4540 , piece_id=3MKHY4HDZSK5YOPP5HYVMEOWWEGDCJUPYEUW2TFPOSATOT2FMWQA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.577418831 (331h53m43.348060166s) [noise=true , address=77.90.31.16:4751 , piece_id=DQNZ6VYCO2WPLAT7CGMQOTIRXLLJTYRCUCVLI3RJZCYUZT3F6YXQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.579017850 (331h53m43.349659185s) [noise=true , address=77.90.31.16:4748 , piece_id=DRUW5HWKQF3LY5AXUQBD4MC2K2TMHJHXBDOP5DRL5WCSIV6KZDHA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.580192378 (331h53m43.350833713s) [noise=true , address=77.90.31.14:4674 , piece_id=KUGSISFXDEFATV2BHKW34NREXENVYMNZRSM3VTXHCZOLBWYCO3IA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.580210843 (331h53m43.350852178s) [seg_pos={0 0}, upload=265483]: Segment reached optimal threshold of 14 pieces.
Jul 7 05:04:08.580342875 (331h53m43.35098421s) [noise=true , address=77.90.31.21:4903 , piece_id=JWQTRU7GLKHFXFBV2KYINTA2SEAUNDWTXER2XLNYIBXNC3KWF5ZA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZYWQ1a2sTKnFpF28iQVrem2s8nSpXkeJzZDaS7jvTZNANdfp): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580430292 (331h53m43.351071627s) [noise=true , address=45.91.116.9:4264 , piece_id=BAUPMJNTKX5S6NGVZYISJH5EJIVMVICZP4PNUKM6D525UNKAJBUA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128f6i7ALVXF3Vr8G8zsZXrNBFiT3cK8UAiic5XbFS1gRjZK86m): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580552847 (331h53m43.351194172s) [noise=true , address=77.90.31.17:4801 , piece_id=DHPU2ISCQWL6TOZQED7BG6JJ5DYRJW5FAYO4MGLB3KEOLVNC3CFA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127QRLNwZLcR5gnAgZrCjSUsH5T4jESmZ4kWeAnpj9YxaTSjoYe): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580638251 (331h53m43.351279586s) [noise=true , address=104.36.82.5:4855 , piece_id=5JPBSZRWWMGKSECM2XBHVQUT3F4U7JXCVXFKYKEJD27W3C5PCWNQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection; write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection
Jul 7 05:04:08.580668078 (331h53m43.351309413s) [seg_pos={0 0}, upload=265483]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 7 05:04:08.580803337 (331h53m43.351444672s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:04:08.580809508 (331h53m43.351450843s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:04:08.869629195 (331h53m43.64027053s) [upload=265483]: Done uploading segments...
Jul 7 05:04:08.869647730 (331h53m43.640289065s) [upload=265483]: Upload finished. err: <nil>
Duration: 5.473394293s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
5.731299716s
FAIL (2025-07-07 05:17:04 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
65483]: Got next segment. Inline: false
Jul 7 05:04:06.097422800 (331h53m40.868064135s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:04:06.097428120 (331h53m40.868069445s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:04:06.623732228 (331h53m41.394373563s) [seg_pos={0 0}, upload=265483]: Begin upload segment...
Jul 7 05:04:06.623774189 (331h53m41.394415524s) [seg_pos={0 0}, upload=265483]: Done begin upload segment.
Jul 7 05:04:06.623795539 (331h53m41.394436874s) [noise=true , address=77.90.31.14:4674 , piece_id=KUGSISFXDEFATV2BHKW34NREXENVYMNZRSM3VTXHCZOLBWYCO3IA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.623850364 (331h53m41.394491699s) [noise=true , address=77.90.31.17:4801 , piece_id=DHPU2ISCQWL6TOZQED7BG6JJ5DYRJW5FAYO4MGLB3KEOLVNC3CFA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624347755 (331h53m41.39498909s) [noise=true , address=77.90.31.16:4751 , piece_id=DQNZ6VYCO2WPLAT7CGMQOTIRXLLJTYRCUCVLI3RJZCYUZT3F6YXQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624383835 (331h53m41.39502517s) [noise=true , address=104.36.82.14:4248 , piece_id=GQVC4QYUSXVHM3WZ3OT7XSB42HEOEWHYVBMVGQVSMDFINDON6BSA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624634515 (331h53m41.39527585s) [noise=true , address=45.91.116.9:4264 , piece_id=BAUPMJNTKX5S6NGVZYISJH5EJIVMVICZP4PNUKM6D525UNKAJBUA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624844035 (331h53m41.39548537s) [noise=true , address=104.36.82.45:4927 , piece_id=6ZFIELGIKBDL2IKSE7EQP25Z7HPBP4GRSF5Y2YXUWZX54RV3ZAFA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624903259 (331h53m41.395544594s) [noise=true , address=104.36.82.18:4397 , piece_id=VF4FXOENNLGT3N7ZJ3T7EPYEW6H3YS4ZKHHQJSNLJYOCMGFXVZDQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625117729 (331h53m41.395759064s) [noise=true , address=64.49.13.27:4966 , piece_id=HPG7X2LX5N5CJHAQAWM6JKYHAOPOWRPUXEVWT4SDGYJKPKN2TRKA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625170019 (331h53m41.395811354s) [noise=true , address=104.36.82.5:4855 , piece_id=5JPBSZRWWMGKSECM2XBHVQUT3F4U7JXCVXFKYKEJD27W3C5PCWNQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625343822 (331h53m41.395985157s) [noise=true , address=104.36.82.12:4173 , piece_id=5HUGZCEFE3JCGN4PUHPP4IGVCRN2R4KHPIBQJUUTAEGOLDISXF4Q, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625394227 (331h53m41.396035563s) [noise=true , address=64.49.13.154:4932 , piece_id=4CXUMWUQ37E5ATJKWKIABQKZID2G5PRB563D3LAQTIWCZOLYI76Q, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625563120 (331h53m41.396204456s) [noise=true , address=104.36.82.3:4773 , piece_id=I2XCDVOZ5RWEMWJCBM5FATOKDCUZJFC7G2KTFILU66LJU7NLC5RQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625612635 (331h53m41.39625397s) [noise=true , address=64.49.13.140:4510 , piece_id=SUB4NNB6ZG7TGV76LBI37SUS4FYVH2LBU4DXHPRESLBDDHZHHEPA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625788693 (331h53m41.396430028s) [noise=true , address=77.90.31.16:4748 , piece_id=DRUW5HWKQF3LY5AXUQBD4MC2K2TMHJHXBDOP5DRL5WCSIV6KZDHA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625854649 (331h53m41.396495984s) [noise=true , address=104.36.82.21:4479 , piece_id=56PCCZDSZH545QXGLGRZN2IUDPIF6MTHKAULXZYVAV6BOAE632YQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626075631 (331h53m41.396716966s) [noise=true , address=77.90.31.10:4540 , piece_id=3MKHY4HDZSK5YOPP5HYVMEOWWEGDCJUPYEUW2TFPOSATOT2FMWQA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626273520 (331h53m41.396914855s) [noise=true , address=104.36.82.23:4470 , piece_id=Y3NJ45DLDTZSHKMHTANQ6VTL3BX46Y2LD2QGBK5S5SLAFDJBGPSQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626467301 (331h53m41.397108636s) [noise=true , address=77.90.31.21:4903 , piece_id=JWQTRU7GLKHFXFBV2KYINTA2SEAUNDWTXER2XLNYIBXNC3KWF5ZA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:07.724567296 (331h53m42.495208631s) [upload=265483]: Next returned nil segment
Jul 7 05:04:07.724584218 (331h53m42.495225543s) [upload=265483]: Waiting for error group managing segments...
Jul 7 05:04:08.028542246 (331h53m42.799183581s) [noise=true , address=64.49.13.27:4966 , piece_id=HPG7X2LX5N5CJHAQAWM6JKYHAOPOWRPUXEVWT4SDGYJKPKN2TRKA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.070346103 (331h53m42.840987438s) [noise=true , address=64.49.13.140:4510 , piece_id=SUB4NNB6ZG7TGV76LBI37SUS4FYVH2LBU4DXHPRESLBDDHZHHEPA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.095032022 (331h53m42.865673367s) [noise=true , address=64.49.13.154:4932 , piece_id=4CXUMWUQ37E5ATJKWKIABQKZID2G5PRB563D3LAQTIWCZOLYI76Q, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.428652819 (331h53m43.199294155s) [noise=true , address=104.36.82.18:4397 , piece_id=VF4FXOENNLGT3N7ZJ3T7EPYEW6H3YS4ZKHHQJSNLJYOCMGFXVZDQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.448309175 (331h53m43.21895051s) [noise=true , address=104.36.82.3:4773 , piece_id=I2XCDVOZ5RWEMWJCBM5FATOKDCUZJFC7G2KTFILU66LJU7NLC5RQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.460440203 (331h53m43.231081538s) [noise=true , address=104.36.82.45:4927 , piece_id=6ZFIELGIKBDL2IKSE7EQP25Z7HPBP4GRSF5Y2YXUWZX54RV3ZAFA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.462441062 (331h53m43.233082407s) [noise=true , address=104.36.82.21:4479 , piece_id=56PCCZDSZH545QXGLGRZN2IUDPIF6MTHKAULXZYVAV6BOAE632YQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.479297731 (331h53m43.249939056s) [noise=true , address=104.36.82.23:4470 , piece_id=Y3NJ45DLDTZSHKMHTANQ6VTL3BX46Y2LD2QGBK5S5SLAFDJBGPSQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.505733477 (331h53m43.276374812s) [noise=true , address=104.36.82.12:4173 , piece_id=5HUGZCEFE3JCGN4PUHPP4IGVCRN2R4KHPIBQJUUTAEGOLDISXF4Q, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.574289655 (331h53m43.34493099s) [noise=true , address=104.36.82.14:4248 , piece_id=GQVC4QYUSXVHM3WZ3OT7XSB42HEOEWHYVBMVGQVSMDFINDON6BSA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.577275016 (331h53m43.347916351s) [noise=true , address=77.90.31.10:4540 , piece_id=3MKHY4HDZSK5YOPP5HYVMEOWWEGDCJUPYEUW2TFPOSATOT2FMWQA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.577418831 (331h53m43.348060166s) [noise=true , address=77.90.31.16:4751 , piece_id=DQNZ6VYCO2WPLAT7CGMQOTIRXLLJTYRCUCVLI3RJZCYUZT3F6YXQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.579017850 (331h53m43.349659185s) [noise=true , address=77.90.31.16:4748 , piece_id=DRUW5HWKQF3LY5AXUQBD4MC2K2TMHJHXBDOP5DRL5WCSIV6KZDHA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.580192378 (331h53m43.350833713s) [noise=true , address=77.90.31.14:4674 , piece_id=KUGSISFXDEFATV2BHKW34NREXENVYMNZRSM3VTXHCZOLBWYCO3IA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.580210843 (331h53m43.350852178s) [seg_pos={0 0}, upload=265483]: Segment reached optimal threshold of 14 pieces.
Jul 7 05:04:08.580342875 (331h53m43.35098421s) [noise=true , address=77.90.31.21:4903 , piece_id=JWQTRU7GLKHFXFBV2KYINTA2SEAUNDWTXER2XLNYIBXNC3KWF5ZA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZYWQ1a2sTKnFpF28iQVrem2s8nSpXkeJzZDaS7jvTZNANdfp): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580430292 (331h53m43.351071627s) [noise=true , address=45.91.116.9:4264 , piece_id=BAUPMJNTKX5S6NGVZYISJH5EJIVMVICZP4PNUKM6D525UNKAJBUA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128f6i7ALVXF3Vr8G8zsZXrNBFiT3cK8UAiic5XbFS1gRjZK86m): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580552847 (331h53m43.351194172s) [noise=true , address=77.90.31.17:4801 , piece_id=DHPU2ISCQWL6TOZQED7BG6JJ5DYRJW5FAYO4MGLB3KEOLVNC3CFA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127QRLNwZLcR5gnAgZrCjSUsH5T4jESmZ4kWeAnpj9YxaTSjoYe): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580638251 (331h53m43.351279586s) [noise=true , address=104.36.82.5:4855 , piece_id=5JPBSZRWWMGKSECM2XBHVQUT3F4U7JXCVXFKYKEJD27W3C5PCWNQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection; write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection
Jul 7 05:04:08.580668078 (331h53m43.351309413s) [seg_pos={0 0}, upload=265483]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 7 05:04:08.580803337 (331h53m43.351444672s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:04:08.580809508 (331h53m43.351450843s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:04:08.869629195 (331h53m43.64027053s) [upload=265483]: Done uploading segments...
Jul 7 05:04:08.869647730 (331h53m43.640289065s) [upload=265483]: Upload finished. err: <nil>
Duration: 5.731341206s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
5.745224607s
FAIL (2025-07-07 05:16:37 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 5.745256177s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
5.86711123s
FAIL (2025-07-07 05:16:13 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 5.86714364s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
5.661790088s
FAIL (2025-07-07 05:16:01 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
65483]: Got next segment. Inline: false
Jul 7 05:04:06.097422800 (331h53m40.868064135s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:04:06.097428120 (331h53m40.868069445s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:04:06.623732228 (331h53m41.394373563s) [seg_pos={0 0}, upload=265483]: Begin upload segment...
Jul 7 05:04:06.623774189 (331h53m41.394415524s) [seg_pos={0 0}, upload=265483]: Done begin upload segment.
Jul 7 05:04:06.623795539 (331h53m41.394436874s) [noise=true , address=77.90.31.14:4674 , piece_id=KUGSISFXDEFATV2BHKW34NREXENVYMNZRSM3VTXHCZOLBWYCO3IA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.623850364 (331h53m41.394491699s) [noise=true , address=77.90.31.17:4801 , piece_id=DHPU2ISCQWL6TOZQED7BG6JJ5DYRJW5FAYO4MGLB3KEOLVNC3CFA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624347755 (331h53m41.39498909s) [noise=true , address=77.90.31.16:4751 , piece_id=DQNZ6VYCO2WPLAT7CGMQOTIRXLLJTYRCUCVLI3RJZCYUZT3F6YXQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624383835 (331h53m41.39502517s) [noise=true , address=104.36.82.14:4248 , piece_id=GQVC4QYUSXVHM3WZ3OT7XSB42HEOEWHYVBMVGQVSMDFINDON6BSA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624634515 (331h53m41.39527585s) [noise=true , address=45.91.116.9:4264 , piece_id=BAUPMJNTKX5S6NGVZYISJH5EJIVMVICZP4PNUKM6D525UNKAJBUA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624844035 (331h53m41.39548537s) [noise=true , address=104.36.82.45:4927 , piece_id=6ZFIELGIKBDL2IKSE7EQP25Z7HPBP4GRSF5Y2YXUWZX54RV3ZAFA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624903259 (331h53m41.395544594s) [noise=true , address=104.36.82.18:4397 , piece_id=VF4FXOENNLGT3N7ZJ3T7EPYEW6H3YS4ZKHHQJSNLJYOCMGFXVZDQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625117729 (331h53m41.395759064s) [noise=true , address=64.49.13.27:4966 , piece_id=HPG7X2LX5N5CJHAQAWM6JKYHAOPOWRPUXEVWT4SDGYJKPKN2TRKA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625170019 (331h53m41.395811354s) [noise=true , address=104.36.82.5:4855 , piece_id=5JPBSZRWWMGKSECM2XBHVQUT3F4U7JXCVXFKYKEJD27W3C5PCWNQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625343822 (331h53m41.395985157s) [noise=true , address=104.36.82.12:4173 , piece_id=5HUGZCEFE3JCGN4PUHPP4IGVCRN2R4KHPIBQJUUTAEGOLDISXF4Q, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625394227 (331h53m41.396035563s) [noise=true , address=64.49.13.154:4932 , piece_id=4CXUMWUQ37E5ATJKWKIABQKZID2G5PRB563D3LAQTIWCZOLYI76Q, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625563120 (331h53m41.396204456s) [noise=true , address=104.36.82.3:4773 , piece_id=I2XCDVOZ5RWEMWJCBM5FATOKDCUZJFC7G2KTFILU66LJU7NLC5RQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625612635 (331h53m41.39625397s) [noise=true , address=64.49.13.140:4510 , piece_id=SUB4NNB6ZG7TGV76LBI37SUS4FYVH2LBU4DXHPRESLBDDHZHHEPA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625788693 (331h53m41.396430028s) [noise=true , address=77.90.31.16:4748 , piece_id=DRUW5HWKQF3LY5AXUQBD4MC2K2TMHJHXBDOP5DRL5WCSIV6KZDHA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625854649 (331h53m41.396495984s) [noise=true , address=104.36.82.21:4479 , piece_id=56PCCZDSZH545QXGLGRZN2IUDPIF6MTHKAULXZYVAV6BOAE632YQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626075631 (331h53m41.396716966s) [noise=true , address=77.90.31.10:4540 , piece_id=3MKHY4HDZSK5YOPP5HYVMEOWWEGDCJUPYEUW2TFPOSATOT2FMWQA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626273520 (331h53m41.396914855s) [noise=true , address=104.36.82.23:4470 , piece_id=Y3NJ45DLDTZSHKMHTANQ6VTL3BX46Y2LD2QGBK5S5SLAFDJBGPSQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626467301 (331h53m41.397108636s) [noise=true , address=77.90.31.21:4903 , piece_id=JWQTRU7GLKHFXFBV2KYINTA2SEAUNDWTXER2XLNYIBXNC3KWF5ZA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:07.724567296 (331h53m42.495208631s) [upload=265483]: Next returned nil segment
Jul 7 05:04:07.724584218 (331h53m42.495225543s) [upload=265483]: Waiting for error group managing segments...
Jul 7 05:04:08.028542246 (331h53m42.799183581s) [noise=true , address=64.49.13.27:4966 , piece_id=HPG7X2LX5N5CJHAQAWM6JKYHAOPOWRPUXEVWT4SDGYJKPKN2TRKA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.070346103 (331h53m42.840987438s) [noise=true , address=64.49.13.140:4510 , piece_id=SUB4NNB6ZG7TGV76LBI37SUS4FYVH2LBU4DXHPRESLBDDHZHHEPA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.095032022 (331h53m42.865673367s) [noise=true , address=64.49.13.154:4932 , piece_id=4CXUMWUQ37E5ATJKWKIABQKZID2G5PRB563D3LAQTIWCZOLYI76Q, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.428652819 (331h53m43.199294155s) [noise=true , address=104.36.82.18:4397 , piece_id=VF4FXOENNLGT3N7ZJ3T7EPYEW6H3YS4ZKHHQJSNLJYOCMGFXVZDQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.448309175 (331h53m43.21895051s) [noise=true , address=104.36.82.3:4773 , piece_id=I2XCDVOZ5RWEMWJCBM5FATOKDCUZJFC7G2KTFILU66LJU7NLC5RQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.460440203 (331h53m43.231081538s) [noise=true , address=104.36.82.45:4927 , piece_id=6ZFIELGIKBDL2IKSE7EQP25Z7HPBP4GRSF5Y2YXUWZX54RV3ZAFA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.462441062 (331h53m43.233082407s) [noise=true , address=104.36.82.21:4479 , piece_id=56PCCZDSZH545QXGLGRZN2IUDPIF6MTHKAULXZYVAV6BOAE632YQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.479297731 (331h53m43.249939056s) [noise=true , address=104.36.82.23:4470 , piece_id=Y3NJ45DLDTZSHKMHTANQ6VTL3BX46Y2LD2QGBK5S5SLAFDJBGPSQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.505733477 (331h53m43.276374812s) [noise=true , address=104.36.82.12:4173 , piece_id=5HUGZCEFE3JCGN4PUHPP4IGVCRN2R4KHPIBQJUUTAEGOLDISXF4Q, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.574289655 (331h53m43.34493099s) [noise=true , address=104.36.82.14:4248 , piece_id=GQVC4QYUSXVHM3WZ3OT7XSB42HEOEWHYVBMVGQVSMDFINDON6BSA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.577275016 (331h53m43.347916351s) [noise=true , address=77.90.31.10:4540 , piece_id=3MKHY4HDZSK5YOPP5HYVMEOWWEGDCJUPYEUW2TFPOSATOT2FMWQA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.577418831 (331h53m43.348060166s) [noise=true , address=77.90.31.16:4751 , piece_id=DQNZ6VYCO2WPLAT7CGMQOTIRXLLJTYRCUCVLI3RJZCYUZT3F6YXQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.579017850 (331h53m43.349659185s) [noise=true , address=77.90.31.16:4748 , piece_id=DRUW5HWKQF3LY5AXUQBD4MC2K2TMHJHXBDOP5DRL5WCSIV6KZDHA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.580192378 (331h53m43.350833713s) [noise=true , address=77.90.31.14:4674 , piece_id=KUGSISFXDEFATV2BHKW34NREXENVYMNZRSM3VTXHCZOLBWYCO3IA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.580210843 (331h53m43.350852178s) [seg_pos={0 0}, upload=265483]: Segment reached optimal threshold of 14 pieces.
Jul 7 05:04:08.580342875 (331h53m43.35098421s) [noise=true , address=77.90.31.21:4903 , piece_id=JWQTRU7GLKHFXFBV2KYINTA2SEAUNDWTXER2XLNYIBXNC3KWF5ZA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZYWQ1a2sTKnFpF28iQVrem2s8nSpXkeJzZDaS7jvTZNANdfp): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580430292 (331h53m43.351071627s) [noise=true , address=45.91.116.9:4264 , piece_id=BAUPMJNTKX5S6NGVZYISJH5EJIVMVICZP4PNUKM6D525UNKAJBUA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128f6i7ALVXF3Vr8G8zsZXrNBFiT3cK8UAiic5XbFS1gRjZK86m): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580552847 (331h53m43.351194172s) [noise=true , address=77.90.31.17:4801 , piece_id=DHPU2ISCQWL6TOZQED7BG6JJ5DYRJW5FAYO4MGLB3KEOLVNC3CFA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127QRLNwZLcR5gnAgZrCjSUsH5T4jESmZ4kWeAnpj9YxaTSjoYe): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580638251 (331h53m43.351279586s) [noise=true , address=104.36.82.5:4855 , piece_id=5JPBSZRWWMGKSECM2XBHVQUT3F4U7JXCVXFKYKEJD27W3C5PCWNQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection; write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection
Jul 7 05:04:08.580668078 (331h53m43.351309413s) [seg_pos={0 0}, upload=265483]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 7 05:04:08.580803337 (331h53m43.351444672s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:04:08.580809508 (331h53m43.351450843s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:04:08.869629195 (331h53m43.64027053s) [upload=265483]: Done uploading segments...
Jul 7 05:04:08.869647730 (331h53m43.640289065s) [upload=265483]: Upload finished. err: <nil>
Duration: 5.661815967s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
5.726249245s
FAIL (2025-07-07 05:15:57 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 5.726311974s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
5.659316827s
FAIL (2025-07-07 05:15:43 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
65483]: Got next segment. Inline: false
Jul 7 05:04:06.097422800 (331h53m40.868064135s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:04:06.097428120 (331h53m40.868069445s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:04:06.623732228 (331h53m41.394373563s) [seg_pos={0 0}, upload=265483]: Begin upload segment...
Jul 7 05:04:06.623774189 (331h53m41.394415524s) [seg_pos={0 0}, upload=265483]: Done begin upload segment.
Jul 7 05:04:06.623795539 (331h53m41.394436874s) [noise=true , address=77.90.31.14:4674 , piece_id=KUGSISFXDEFATV2BHKW34NREXENVYMNZRSM3VTXHCZOLBWYCO3IA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.623850364 (331h53m41.394491699s) [noise=true , address=77.90.31.17:4801 , piece_id=DHPU2ISCQWL6TOZQED7BG6JJ5DYRJW5FAYO4MGLB3KEOLVNC3CFA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624347755 (331h53m41.39498909s) [noise=true , address=77.90.31.16:4751 , piece_id=DQNZ6VYCO2WPLAT7CGMQOTIRXLLJTYRCUCVLI3RJZCYUZT3F6YXQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624383835 (331h53m41.39502517s) [noise=true , address=104.36.82.14:4248 , piece_id=GQVC4QYUSXVHM3WZ3OT7XSB42HEOEWHYVBMVGQVSMDFINDON6BSA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624634515 (331h53m41.39527585s) [noise=true , address=45.91.116.9:4264 , piece_id=BAUPMJNTKX5S6NGVZYISJH5EJIVMVICZP4PNUKM6D525UNKAJBUA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624844035 (331h53m41.39548537s) [noise=true , address=104.36.82.45:4927 , piece_id=6ZFIELGIKBDL2IKSE7EQP25Z7HPBP4GRSF5Y2YXUWZX54RV3ZAFA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624903259 (331h53m41.395544594s) [noise=true , address=104.36.82.18:4397 , piece_id=VF4FXOENNLGT3N7ZJ3T7EPYEW6H3YS4ZKHHQJSNLJYOCMGFXVZDQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625117729 (331h53m41.395759064s) [noise=true , address=64.49.13.27:4966 , piece_id=HPG7X2LX5N5CJHAQAWM6JKYHAOPOWRPUXEVWT4SDGYJKPKN2TRKA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625170019 (331h53m41.395811354s) [noise=true , address=104.36.82.5:4855 , piece_id=5JPBSZRWWMGKSECM2XBHVQUT3F4U7JXCVXFKYKEJD27W3C5PCWNQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625343822 (331h53m41.395985157s) [noise=true , address=104.36.82.12:4173 , piece_id=5HUGZCEFE3JCGN4PUHPP4IGVCRN2R4KHPIBQJUUTAEGOLDISXF4Q, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625394227 (331h53m41.396035563s) [noise=true , address=64.49.13.154:4932 , piece_id=4CXUMWUQ37E5ATJKWKIABQKZID2G5PRB563D3LAQTIWCZOLYI76Q, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625563120 (331h53m41.396204456s) [noise=true , address=104.36.82.3:4773 , piece_id=I2XCDVOZ5RWEMWJCBM5FATOKDCUZJFC7G2KTFILU66LJU7NLC5RQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625612635 (331h53m41.39625397s) [noise=true , address=64.49.13.140:4510 , piece_id=SUB4NNB6ZG7TGV76LBI37SUS4FYVH2LBU4DXHPRESLBDDHZHHEPA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625788693 (331h53m41.396430028s) [noise=true , address=77.90.31.16:4748 , piece_id=DRUW5HWKQF3LY5AXUQBD4MC2K2TMHJHXBDOP5DRL5WCSIV6KZDHA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625854649 (331h53m41.396495984s) [noise=true , address=104.36.82.21:4479 , piece_id=56PCCZDSZH545QXGLGRZN2IUDPIF6MTHKAULXZYVAV6BOAE632YQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626075631 (331h53m41.396716966s) [noise=true , address=77.90.31.10:4540 , piece_id=3MKHY4HDZSK5YOPP5HYVMEOWWEGDCJUPYEUW2TFPOSATOT2FMWQA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626273520 (331h53m41.396914855s) [noise=true , address=104.36.82.23:4470 , piece_id=Y3NJ45DLDTZSHKMHTANQ6VTL3BX46Y2LD2QGBK5S5SLAFDJBGPSQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626467301 (331h53m41.397108636s) [noise=true , address=77.90.31.21:4903 , piece_id=JWQTRU7GLKHFXFBV2KYINTA2SEAUNDWTXER2XLNYIBXNC3KWF5ZA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:07.724567296 (331h53m42.495208631s) [upload=265483]: Next returned nil segment
Jul 7 05:04:07.724584218 (331h53m42.495225543s) [upload=265483]: Waiting for error group managing segments...
Jul 7 05:04:08.028542246 (331h53m42.799183581s) [noise=true , address=64.49.13.27:4966 , piece_id=HPG7X2LX5N5CJHAQAWM6JKYHAOPOWRPUXEVWT4SDGYJKPKN2TRKA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.070346103 (331h53m42.840987438s) [noise=true , address=64.49.13.140:4510 , piece_id=SUB4NNB6ZG7TGV76LBI37SUS4FYVH2LBU4DXHPRESLBDDHZHHEPA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.095032022 (331h53m42.865673367s) [noise=true , address=64.49.13.154:4932 , piece_id=4CXUMWUQ37E5ATJKWKIABQKZID2G5PRB563D3LAQTIWCZOLYI76Q, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.428652819 (331h53m43.199294155s) [noise=true , address=104.36.82.18:4397 , piece_id=VF4FXOENNLGT3N7ZJ3T7EPYEW6H3YS4ZKHHQJSNLJYOCMGFXVZDQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.448309175 (331h53m43.21895051s) [noise=true , address=104.36.82.3:4773 , piece_id=I2XCDVOZ5RWEMWJCBM5FATOKDCUZJFC7G2KTFILU66LJU7NLC5RQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.460440203 (331h53m43.231081538s) [noise=true , address=104.36.82.45:4927 , piece_id=6ZFIELGIKBDL2IKSE7EQP25Z7HPBP4GRSF5Y2YXUWZX54RV3ZAFA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.462441062 (331h53m43.233082407s) [noise=true , address=104.36.82.21:4479 , piece_id=56PCCZDSZH545QXGLGRZN2IUDPIF6MTHKAULXZYVAV6BOAE632YQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.479297731 (331h53m43.249939056s) [noise=true , address=104.36.82.23:4470 , piece_id=Y3NJ45DLDTZSHKMHTANQ6VTL3BX46Y2LD2QGBK5S5SLAFDJBGPSQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.505733477 (331h53m43.276374812s) [noise=true , address=104.36.82.12:4173 , piece_id=5HUGZCEFE3JCGN4PUHPP4IGVCRN2R4KHPIBQJUUTAEGOLDISXF4Q, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.574289655 (331h53m43.34493099s) [noise=true , address=104.36.82.14:4248 , piece_id=GQVC4QYUSXVHM3WZ3OT7XSB42HEOEWHYVBMVGQVSMDFINDON6BSA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.577275016 (331h53m43.347916351s) [noise=true , address=77.90.31.10:4540 , piece_id=3MKHY4HDZSK5YOPP5HYVMEOWWEGDCJUPYEUW2TFPOSATOT2FMWQA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.577418831 (331h53m43.348060166s) [noise=true , address=77.90.31.16:4751 , piece_id=DQNZ6VYCO2WPLAT7CGMQOTIRXLLJTYRCUCVLI3RJZCYUZT3F6YXQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.579017850 (331h53m43.349659185s) [noise=true , address=77.90.31.16:4748 , piece_id=DRUW5HWKQF3LY5AXUQBD4MC2K2TMHJHXBDOP5DRL5WCSIV6KZDHA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.580192378 (331h53m43.350833713s) [noise=true , address=77.90.31.14:4674 , piece_id=KUGSISFXDEFATV2BHKW34NREXENVYMNZRSM3VTXHCZOLBWYCO3IA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.580210843 (331h53m43.350852178s) [seg_pos={0 0}, upload=265483]: Segment reached optimal threshold of 14 pieces.
Jul 7 05:04:08.580342875 (331h53m43.35098421s) [noise=true , address=77.90.31.21:4903 , piece_id=JWQTRU7GLKHFXFBV2KYINTA2SEAUNDWTXER2XLNYIBXNC3KWF5ZA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZYWQ1a2sTKnFpF28iQVrem2s8nSpXkeJzZDaS7jvTZNANdfp): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580430292 (331h53m43.351071627s) [noise=true , address=45.91.116.9:4264 , piece_id=BAUPMJNTKX5S6NGVZYISJH5EJIVMVICZP4PNUKM6D525UNKAJBUA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128f6i7ALVXF3Vr8G8zsZXrNBFiT3cK8UAiic5XbFS1gRjZK86m): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580552847 (331h53m43.351194172s) [noise=true , address=77.90.31.17:4801 , piece_id=DHPU2ISCQWL6TOZQED7BG6JJ5DYRJW5FAYO4MGLB3KEOLVNC3CFA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127QRLNwZLcR5gnAgZrCjSUsH5T4jESmZ4kWeAnpj9YxaTSjoYe): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580638251 (331h53m43.351279586s) [noise=true , address=104.36.82.5:4855 , piece_id=5JPBSZRWWMGKSECM2XBHVQUT3F4U7JXCVXFKYKEJD27W3C5PCWNQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection; write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection
Jul 7 05:04:08.580668078 (331h53m43.351309413s) [seg_pos={0 0}, upload=265483]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 7 05:04:08.580803337 (331h53m43.351444672s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:04:08.580809508 (331h53m43.351450843s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:04:08.869629195 (331h53m43.64027053s) [upload=265483]: Done uploading segments...
Jul 7 05:04:08.869647730 (331h53m43.640289065s) [upload=265483]: Upload finished. err: <nil>
Duration: 5.659342686s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
5.823999909s
FAIL (2025-07-07 05:15:30 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 5.824033854s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
5.674788372s
FAIL (2025-07-07 05:14:55 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 5.67481424s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
5.750785965s
FAIL (2025-07-07 05:14:55 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
65483]: Got next segment. Inline: false
Jul 7 05:04:06.097422800 (331h53m40.868064135s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:04:06.097428120 (331h53m40.868069445s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:04:06.623732228 (331h53m41.394373563s) [seg_pos={0 0}, upload=265483]: Begin upload segment...
Jul 7 05:04:06.623774189 (331h53m41.394415524s) [seg_pos={0 0}, upload=265483]: Done begin upload segment.
Jul 7 05:04:06.623795539 (331h53m41.394436874s) [noise=true , address=77.90.31.14:4674 , piece_id=KUGSISFXDEFATV2BHKW34NREXENVYMNZRSM3VTXHCZOLBWYCO3IA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.623850364 (331h53m41.394491699s) [noise=true , address=77.90.31.17:4801 , piece_id=DHPU2ISCQWL6TOZQED7BG6JJ5DYRJW5FAYO4MGLB3KEOLVNC3CFA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624347755 (331h53m41.39498909s) [noise=true , address=77.90.31.16:4751 , piece_id=DQNZ6VYCO2WPLAT7CGMQOTIRXLLJTYRCUCVLI3RJZCYUZT3F6YXQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624383835 (331h53m41.39502517s) [noise=true , address=104.36.82.14:4248 , piece_id=GQVC4QYUSXVHM3WZ3OT7XSB42HEOEWHYVBMVGQVSMDFINDON6BSA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624634515 (331h53m41.39527585s) [noise=true , address=45.91.116.9:4264 , piece_id=BAUPMJNTKX5S6NGVZYISJH5EJIVMVICZP4PNUKM6D525UNKAJBUA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624844035 (331h53m41.39548537s) [noise=true , address=104.36.82.45:4927 , piece_id=6ZFIELGIKBDL2IKSE7EQP25Z7HPBP4GRSF5Y2YXUWZX54RV3ZAFA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624903259 (331h53m41.395544594s) [noise=true , address=104.36.82.18:4397 , piece_id=VF4FXOENNLGT3N7ZJ3T7EPYEW6H3YS4ZKHHQJSNLJYOCMGFXVZDQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625117729 (331h53m41.395759064s) [noise=true , address=64.49.13.27:4966 , piece_id=HPG7X2LX5N5CJHAQAWM6JKYHAOPOWRPUXEVWT4SDGYJKPKN2TRKA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625170019 (331h53m41.395811354s) [noise=true , address=104.36.82.5:4855 , piece_id=5JPBSZRWWMGKSECM2XBHVQUT3F4U7JXCVXFKYKEJD27W3C5PCWNQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625343822 (331h53m41.395985157s) [noise=true , address=104.36.82.12:4173 , piece_id=5HUGZCEFE3JCGN4PUHPP4IGVCRN2R4KHPIBQJUUTAEGOLDISXF4Q, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625394227 (331h53m41.396035563s) [noise=true , address=64.49.13.154:4932 , piece_id=4CXUMWUQ37E5ATJKWKIABQKZID2G5PRB563D3LAQTIWCZOLYI76Q, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625563120 (331h53m41.396204456s) [noise=true , address=104.36.82.3:4773 , piece_id=I2XCDVOZ5RWEMWJCBM5FATOKDCUZJFC7G2KTFILU66LJU7NLC5RQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625612635 (331h53m41.39625397s) [noise=true , address=64.49.13.140:4510 , piece_id=SUB4NNB6ZG7TGV76LBI37SUS4FYVH2LBU4DXHPRESLBDDHZHHEPA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625788693 (331h53m41.396430028s) [noise=true , address=77.90.31.16:4748 , piece_id=DRUW5HWKQF3LY5AXUQBD4MC2K2TMHJHXBDOP5DRL5WCSIV6KZDHA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625854649 (331h53m41.396495984s) [noise=true , address=104.36.82.21:4479 , piece_id=56PCCZDSZH545QXGLGRZN2IUDPIF6MTHKAULXZYVAV6BOAE632YQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626075631 (331h53m41.396716966s) [noise=true , address=77.90.31.10:4540 , piece_id=3MKHY4HDZSK5YOPP5HYVMEOWWEGDCJUPYEUW2TFPOSATOT2FMWQA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626273520 (331h53m41.396914855s) [noise=true , address=104.36.82.23:4470 , piece_id=Y3NJ45DLDTZSHKMHTANQ6VTL3BX46Y2LD2QGBK5S5SLAFDJBGPSQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626467301 (331h53m41.397108636s) [noise=true , address=77.90.31.21:4903 , piece_id=JWQTRU7GLKHFXFBV2KYINTA2SEAUNDWTXER2XLNYIBXNC3KWF5ZA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:07.724567296 (331h53m42.495208631s) [upload=265483]: Next returned nil segment
Jul 7 05:04:07.724584218 (331h53m42.495225543s) [upload=265483]: Waiting for error group managing segments...
Jul 7 05:04:08.028542246 (331h53m42.799183581s) [noise=true , address=64.49.13.27:4966 , piece_id=HPG7X2LX5N5CJHAQAWM6JKYHAOPOWRPUXEVWT4SDGYJKPKN2TRKA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.070346103 (331h53m42.840987438s) [noise=true , address=64.49.13.140:4510 , piece_id=SUB4NNB6ZG7TGV76LBI37SUS4FYVH2LBU4DXHPRESLBDDHZHHEPA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.095032022 (331h53m42.865673367s) [noise=true , address=64.49.13.154:4932 , piece_id=4CXUMWUQ37E5ATJKWKIABQKZID2G5PRB563D3LAQTIWCZOLYI76Q, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.428652819 (331h53m43.199294155s) [noise=true , address=104.36.82.18:4397 , piece_id=VF4FXOENNLGT3N7ZJ3T7EPYEW6H3YS4ZKHHQJSNLJYOCMGFXVZDQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.448309175 (331h53m43.21895051s) [noise=true , address=104.36.82.3:4773 , piece_id=I2XCDVOZ5RWEMWJCBM5FATOKDCUZJFC7G2KTFILU66LJU7NLC5RQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.460440203 (331h53m43.231081538s) [noise=true , address=104.36.82.45:4927 , piece_id=6ZFIELGIKBDL2IKSE7EQP25Z7HPBP4GRSF5Y2YXUWZX54RV3ZAFA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.462441062 (331h53m43.233082407s) [noise=true , address=104.36.82.21:4479 , piece_id=56PCCZDSZH545QXGLGRZN2IUDPIF6MTHKAULXZYVAV6BOAE632YQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.479297731 (331h53m43.249939056s) [noise=true , address=104.36.82.23:4470 , piece_id=Y3NJ45DLDTZSHKMHTANQ6VTL3BX46Y2LD2QGBK5S5SLAFDJBGPSQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.505733477 (331h53m43.276374812s) [noise=true , address=104.36.82.12:4173 , piece_id=5HUGZCEFE3JCGN4PUHPP4IGVCRN2R4KHPIBQJUUTAEGOLDISXF4Q, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.574289655 (331h53m43.34493099s) [noise=true , address=104.36.82.14:4248 , piece_id=GQVC4QYUSXVHM3WZ3OT7XSB42HEOEWHYVBMVGQVSMDFINDON6BSA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.577275016 (331h53m43.347916351s) [noise=true , address=77.90.31.10:4540 , piece_id=3MKHY4HDZSK5YOPP5HYVMEOWWEGDCJUPYEUW2TFPOSATOT2FMWQA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.577418831 (331h53m43.348060166s) [noise=true , address=77.90.31.16:4751 , piece_id=DQNZ6VYCO2WPLAT7CGMQOTIRXLLJTYRCUCVLI3RJZCYUZT3F6YXQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.579017850 (331h53m43.349659185s) [noise=true , address=77.90.31.16:4748 , piece_id=DRUW5HWKQF3LY5AXUQBD4MC2K2TMHJHXBDOP5DRL5WCSIV6KZDHA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.580192378 (331h53m43.350833713s) [noise=true , address=77.90.31.14:4674 , piece_id=KUGSISFXDEFATV2BHKW34NREXENVYMNZRSM3VTXHCZOLBWYCO3IA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.580210843 (331h53m43.350852178s) [seg_pos={0 0}, upload=265483]: Segment reached optimal threshold of 14 pieces.
Jul 7 05:04:08.580342875 (331h53m43.35098421s) [noise=true , address=77.90.31.21:4903 , piece_id=JWQTRU7GLKHFXFBV2KYINTA2SEAUNDWTXER2XLNYIBXNC3KWF5ZA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZYWQ1a2sTKnFpF28iQVrem2s8nSpXkeJzZDaS7jvTZNANdfp): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580430292 (331h53m43.351071627s) [noise=true , address=45.91.116.9:4264 , piece_id=BAUPMJNTKX5S6NGVZYISJH5EJIVMVICZP4PNUKM6D525UNKAJBUA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128f6i7ALVXF3Vr8G8zsZXrNBFiT3cK8UAiic5XbFS1gRjZK86m): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580552847 (331h53m43.351194172s) [noise=true , address=77.90.31.17:4801 , piece_id=DHPU2ISCQWL6TOZQED7BG6JJ5DYRJW5FAYO4MGLB3KEOLVNC3CFA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127QRLNwZLcR5gnAgZrCjSUsH5T4jESmZ4kWeAnpj9YxaTSjoYe): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580638251 (331h53m43.351279586s) [noise=true , address=104.36.82.5:4855 , piece_id=5JPBSZRWWMGKSECM2XBHVQUT3F4U7JXCVXFKYKEJD27W3C5PCWNQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection; write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection
Jul 7 05:04:08.580668078 (331h53m43.351309413s) [seg_pos={0 0}, upload=265483]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 7 05:04:08.580803337 (331h53m43.351444672s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:04:08.580809508 (331h53m43.351450843s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:04:08.869629195 (331h53m43.64027053s) [upload=265483]: Done uploading segments...
Jul 7 05:04:08.869647730 (331h53m43.640289065s) [upload=265483]: Upload finished. err: <nil>
Duration: 5.750812104s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
5.732393271s
FAIL (2025-07-07 05:14:32 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 5.732435543s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
5.756486724s
FAIL (2025-07-07 05:14:30 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
65483]: Got next segment. Inline: false
Jul 7 05:04:06.097422800 (331h53m40.868064135s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:04:06.097428120 (331h53m40.868069445s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:04:06.623732228 (331h53m41.394373563s) [seg_pos={0 0}, upload=265483]: Begin upload segment...
Jul 7 05:04:06.623774189 (331h53m41.394415524s) [seg_pos={0 0}, upload=265483]: Done begin upload segment.
Jul 7 05:04:06.623795539 (331h53m41.394436874s) [noise=true , address=77.90.31.14:4674 , piece_id=KUGSISFXDEFATV2BHKW34NREXENVYMNZRSM3VTXHCZOLBWYCO3IA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.623850364 (331h53m41.394491699s) [noise=true , address=77.90.31.17:4801 , piece_id=DHPU2ISCQWL6TOZQED7BG6JJ5DYRJW5FAYO4MGLB3KEOLVNC3CFA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624347755 (331h53m41.39498909s) [noise=true , address=77.90.31.16:4751 , piece_id=DQNZ6VYCO2WPLAT7CGMQOTIRXLLJTYRCUCVLI3RJZCYUZT3F6YXQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624383835 (331h53m41.39502517s) [noise=true , address=104.36.82.14:4248 , piece_id=GQVC4QYUSXVHM3WZ3OT7XSB42HEOEWHYVBMVGQVSMDFINDON6BSA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624634515 (331h53m41.39527585s) [noise=true , address=45.91.116.9:4264 , piece_id=BAUPMJNTKX5S6NGVZYISJH5EJIVMVICZP4PNUKM6D525UNKAJBUA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624844035 (331h53m41.39548537s) [noise=true , address=104.36.82.45:4927 , piece_id=6ZFIELGIKBDL2IKSE7EQP25Z7HPBP4GRSF5Y2YXUWZX54RV3ZAFA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624903259 (331h53m41.395544594s) [noise=true , address=104.36.82.18:4397 , piece_id=VF4FXOENNLGT3N7ZJ3T7EPYEW6H3YS4ZKHHQJSNLJYOCMGFXVZDQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625117729 (331h53m41.395759064s) [noise=true , address=64.49.13.27:4966 , piece_id=HPG7X2LX5N5CJHAQAWM6JKYHAOPOWRPUXEVWT4SDGYJKPKN2TRKA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625170019 (331h53m41.395811354s) [noise=true , address=104.36.82.5:4855 , piece_id=5JPBSZRWWMGKSECM2XBHVQUT3F4U7JXCVXFKYKEJD27W3C5PCWNQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625343822 (331h53m41.395985157s) [noise=true , address=104.36.82.12:4173 , piece_id=5HUGZCEFE3JCGN4PUHPP4IGVCRN2R4KHPIBQJUUTAEGOLDISXF4Q, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625394227 (331h53m41.396035563s) [noise=true , address=64.49.13.154:4932 , piece_id=4CXUMWUQ37E5ATJKWKIABQKZID2G5PRB563D3LAQTIWCZOLYI76Q, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625563120 (331h53m41.396204456s) [noise=true , address=104.36.82.3:4773 , piece_id=I2XCDVOZ5RWEMWJCBM5FATOKDCUZJFC7G2KTFILU66LJU7NLC5RQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625612635 (331h53m41.39625397s) [noise=true , address=64.49.13.140:4510 , piece_id=SUB4NNB6ZG7TGV76LBI37SUS4FYVH2LBU4DXHPRESLBDDHZHHEPA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625788693 (331h53m41.396430028s) [noise=true , address=77.90.31.16:4748 , piece_id=DRUW5HWKQF3LY5AXUQBD4MC2K2TMHJHXBDOP5DRL5WCSIV6KZDHA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625854649 (331h53m41.396495984s) [noise=true , address=104.36.82.21:4479 , piece_id=56PCCZDSZH545QXGLGRZN2IUDPIF6MTHKAULXZYVAV6BOAE632YQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626075631 (331h53m41.396716966s) [noise=true , address=77.90.31.10:4540 , piece_id=3MKHY4HDZSK5YOPP5HYVMEOWWEGDCJUPYEUW2TFPOSATOT2FMWQA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626273520 (331h53m41.396914855s) [noise=true , address=104.36.82.23:4470 , piece_id=Y3NJ45DLDTZSHKMHTANQ6VTL3BX46Y2LD2QGBK5S5SLAFDJBGPSQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626467301 (331h53m41.397108636s) [noise=true , address=77.90.31.21:4903 , piece_id=JWQTRU7GLKHFXFBV2KYINTA2SEAUNDWTXER2XLNYIBXNC3KWF5ZA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:07.724567296 (331h53m42.495208631s) [upload=265483]: Next returned nil segment
Jul 7 05:04:07.724584218 (331h53m42.495225543s) [upload=265483]: Waiting for error group managing segments...
Jul 7 05:04:08.028542246 (331h53m42.799183581s) [noise=true , address=64.49.13.27:4966 , piece_id=HPG7X2LX5N5CJHAQAWM6JKYHAOPOWRPUXEVWT4SDGYJKPKN2TRKA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.070346103 (331h53m42.840987438s) [noise=true , address=64.49.13.140:4510 , piece_id=SUB4NNB6ZG7TGV76LBI37SUS4FYVH2LBU4DXHPRESLBDDHZHHEPA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.095032022 (331h53m42.865673367s) [noise=true , address=64.49.13.154:4932 , piece_id=4CXUMWUQ37E5ATJKWKIABQKZID2G5PRB563D3LAQTIWCZOLYI76Q, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.428652819 (331h53m43.199294155s) [noise=true , address=104.36.82.18:4397 , piece_id=VF4FXOENNLGT3N7ZJ3T7EPYEW6H3YS4ZKHHQJSNLJYOCMGFXVZDQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.448309175 (331h53m43.21895051s) [noise=true , address=104.36.82.3:4773 , piece_id=I2XCDVOZ5RWEMWJCBM5FATOKDCUZJFC7G2KTFILU66LJU7NLC5RQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.460440203 (331h53m43.231081538s) [noise=true , address=104.36.82.45:4927 , piece_id=6ZFIELGIKBDL2IKSE7EQP25Z7HPBP4GRSF5Y2YXUWZX54RV3ZAFA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.462441062 (331h53m43.233082407s) [noise=true , address=104.36.82.21:4479 , piece_id=56PCCZDSZH545QXGLGRZN2IUDPIF6MTHKAULXZYVAV6BOAE632YQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.479297731 (331h53m43.249939056s) [noise=true , address=104.36.82.23:4470 , piece_id=Y3NJ45DLDTZSHKMHTANQ6VTL3BX46Y2LD2QGBK5S5SLAFDJBGPSQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.505733477 (331h53m43.276374812s) [noise=true , address=104.36.82.12:4173 , piece_id=5HUGZCEFE3JCGN4PUHPP4IGVCRN2R4KHPIBQJUUTAEGOLDISXF4Q, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.574289655 (331h53m43.34493099s) [noise=true , address=104.36.82.14:4248 , piece_id=GQVC4QYUSXVHM3WZ3OT7XSB42HEOEWHYVBMVGQVSMDFINDON6BSA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.577275016 (331h53m43.347916351s) [noise=true , address=77.90.31.10:4540 , piece_id=3MKHY4HDZSK5YOPP5HYVMEOWWEGDCJUPYEUW2TFPOSATOT2FMWQA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.577418831 (331h53m43.348060166s) [noise=true , address=77.90.31.16:4751 , piece_id=DQNZ6VYCO2WPLAT7CGMQOTIRXLLJTYRCUCVLI3RJZCYUZT3F6YXQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.579017850 (331h53m43.349659185s) [noise=true , address=77.90.31.16:4748 , piece_id=DRUW5HWKQF3LY5AXUQBD4MC2K2TMHJHXBDOP5DRL5WCSIV6KZDHA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.580192378 (331h53m43.350833713s) [noise=true , address=77.90.31.14:4674 , piece_id=KUGSISFXDEFATV2BHKW34NREXENVYMNZRSM3VTXHCZOLBWYCO3IA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.580210843 (331h53m43.350852178s) [seg_pos={0 0}, upload=265483]: Segment reached optimal threshold of 14 pieces.
Jul 7 05:04:08.580342875 (331h53m43.35098421s) [noise=true , address=77.90.31.21:4903 , piece_id=JWQTRU7GLKHFXFBV2KYINTA2SEAUNDWTXER2XLNYIBXNC3KWF5ZA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZYWQ1a2sTKnFpF28iQVrem2s8nSpXkeJzZDaS7jvTZNANdfp): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580430292 (331h53m43.351071627s) [noise=true , address=45.91.116.9:4264 , piece_id=BAUPMJNTKX5S6NGVZYISJH5EJIVMVICZP4PNUKM6D525UNKAJBUA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128f6i7ALVXF3Vr8G8zsZXrNBFiT3cK8UAiic5XbFS1gRjZK86m): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580552847 (331h53m43.351194172s) [noise=true , address=77.90.31.17:4801 , piece_id=DHPU2ISCQWL6TOZQED7BG6JJ5DYRJW5FAYO4MGLB3KEOLVNC3CFA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127QRLNwZLcR5gnAgZrCjSUsH5T4jESmZ4kWeAnpj9YxaTSjoYe): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580638251 (331h53m43.351279586s) [noise=true , address=104.36.82.5:4855 , piece_id=5JPBSZRWWMGKSECM2XBHVQUT3F4U7JXCVXFKYKEJD27W3C5PCWNQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection; write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection
Jul 7 05:04:08.580668078 (331h53m43.351309413s) [seg_pos={0 0}, upload=265483]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 7 05:04:08.580803337 (331h53m43.351444672s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:04:08.580809508 (331h53m43.351450843s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:04:08.869629195 (331h53m43.64027053s) [upload=265483]: Done uploading segments...
Jul 7 05:04:08.869647730 (331h53m43.640289065s) [upload=265483]: Upload finished. err: <nil>
Duration: 5.756505039s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
5.713838148s
FAIL (2025-07-07 05:13:50 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
65483]: Got next segment. Inline: false
Jul 7 05:04:06.097422800 (331h53m40.868064135s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:04:06.097428120 (331h53m40.868069445s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:04:06.623732228 (331h53m41.394373563s) [seg_pos={0 0}, upload=265483]: Begin upload segment...
Jul 7 05:04:06.623774189 (331h53m41.394415524s) [seg_pos={0 0}, upload=265483]: Done begin upload segment.
Jul 7 05:04:06.623795539 (331h53m41.394436874s) [noise=true , address=77.90.31.14:4674 , piece_id=KUGSISFXDEFATV2BHKW34NREXENVYMNZRSM3VTXHCZOLBWYCO3IA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.623850364 (331h53m41.394491699s) [noise=true , address=77.90.31.17:4801 , piece_id=DHPU2ISCQWL6TOZQED7BG6JJ5DYRJW5FAYO4MGLB3KEOLVNC3CFA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624347755 (331h53m41.39498909s) [noise=true , address=77.90.31.16:4751 , piece_id=DQNZ6VYCO2WPLAT7CGMQOTIRXLLJTYRCUCVLI3RJZCYUZT3F6YXQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624383835 (331h53m41.39502517s) [noise=true , address=104.36.82.14:4248 , piece_id=GQVC4QYUSXVHM3WZ3OT7XSB42HEOEWHYVBMVGQVSMDFINDON6BSA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624634515 (331h53m41.39527585s) [noise=true , address=45.91.116.9:4264 , piece_id=BAUPMJNTKX5S6NGVZYISJH5EJIVMVICZP4PNUKM6D525UNKAJBUA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624844035 (331h53m41.39548537s) [noise=true , address=104.36.82.45:4927 , piece_id=6ZFIELGIKBDL2IKSE7EQP25Z7HPBP4GRSF5Y2YXUWZX54RV3ZAFA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624903259 (331h53m41.395544594s) [noise=true , address=104.36.82.18:4397 , piece_id=VF4FXOENNLGT3N7ZJ3T7EPYEW6H3YS4ZKHHQJSNLJYOCMGFXVZDQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625117729 (331h53m41.395759064s) [noise=true , address=64.49.13.27:4966 , piece_id=HPG7X2LX5N5CJHAQAWM6JKYHAOPOWRPUXEVWT4SDGYJKPKN2TRKA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625170019 (331h53m41.395811354s) [noise=true , address=104.36.82.5:4855 , piece_id=5JPBSZRWWMGKSECM2XBHVQUT3F4U7JXCVXFKYKEJD27W3C5PCWNQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625343822 (331h53m41.395985157s) [noise=true , address=104.36.82.12:4173 , piece_id=5HUGZCEFE3JCGN4PUHPP4IGVCRN2R4KHPIBQJUUTAEGOLDISXF4Q, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625394227 (331h53m41.396035563s) [noise=true , address=64.49.13.154:4932 , piece_id=4CXUMWUQ37E5ATJKWKIABQKZID2G5PRB563D3LAQTIWCZOLYI76Q, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625563120 (331h53m41.396204456s) [noise=true , address=104.36.82.3:4773 , piece_id=I2XCDVOZ5RWEMWJCBM5FATOKDCUZJFC7G2KTFILU66LJU7NLC5RQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625612635 (331h53m41.39625397s) [noise=true , address=64.49.13.140:4510 , piece_id=SUB4NNB6ZG7TGV76LBI37SUS4FYVH2LBU4DXHPRESLBDDHZHHEPA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625788693 (331h53m41.396430028s) [noise=true , address=77.90.31.16:4748 , piece_id=DRUW5HWKQF3LY5AXUQBD4MC2K2TMHJHXBDOP5DRL5WCSIV6KZDHA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625854649 (331h53m41.396495984s) [noise=true , address=104.36.82.21:4479 , piece_id=56PCCZDSZH545QXGLGRZN2IUDPIF6MTHKAULXZYVAV6BOAE632YQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626075631 (331h53m41.396716966s) [noise=true , address=77.90.31.10:4540 , piece_id=3MKHY4HDZSK5YOPP5HYVMEOWWEGDCJUPYEUW2TFPOSATOT2FMWQA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626273520 (331h53m41.396914855s) [noise=true , address=104.36.82.23:4470 , piece_id=Y3NJ45DLDTZSHKMHTANQ6VTL3BX46Y2LD2QGBK5S5SLAFDJBGPSQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626467301 (331h53m41.397108636s) [noise=true , address=77.90.31.21:4903 , piece_id=JWQTRU7GLKHFXFBV2KYINTA2SEAUNDWTXER2XLNYIBXNC3KWF5ZA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:07.724567296 (331h53m42.495208631s) [upload=265483]: Next returned nil segment
Jul 7 05:04:07.724584218 (331h53m42.495225543s) [upload=265483]: Waiting for error group managing segments...
Jul 7 05:04:08.028542246 (331h53m42.799183581s) [noise=true , address=64.49.13.27:4966 , piece_id=HPG7X2LX5N5CJHAQAWM6JKYHAOPOWRPUXEVWT4SDGYJKPKN2TRKA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.070346103 (331h53m42.840987438s) [noise=true , address=64.49.13.140:4510 , piece_id=SUB4NNB6ZG7TGV76LBI37SUS4FYVH2LBU4DXHPRESLBDDHZHHEPA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.095032022 (331h53m42.865673367s) [noise=true , address=64.49.13.154:4932 , piece_id=4CXUMWUQ37E5ATJKWKIABQKZID2G5PRB563D3LAQTIWCZOLYI76Q, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.428652819 (331h53m43.199294155s) [noise=true , address=104.36.82.18:4397 , piece_id=VF4FXOENNLGT3N7ZJ3T7EPYEW6H3YS4ZKHHQJSNLJYOCMGFXVZDQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.448309175 (331h53m43.21895051s) [noise=true , address=104.36.82.3:4773 , piece_id=I2XCDVOZ5RWEMWJCBM5FATOKDCUZJFC7G2KTFILU66LJU7NLC5RQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.460440203 (331h53m43.231081538s) [noise=true , address=104.36.82.45:4927 , piece_id=6ZFIELGIKBDL2IKSE7EQP25Z7HPBP4GRSF5Y2YXUWZX54RV3ZAFA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.462441062 (331h53m43.233082407s) [noise=true , address=104.36.82.21:4479 , piece_id=56PCCZDSZH545QXGLGRZN2IUDPIF6MTHKAULXZYVAV6BOAE632YQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.479297731 (331h53m43.249939056s) [noise=true , address=104.36.82.23:4470 , piece_id=Y3NJ45DLDTZSHKMHTANQ6VTL3BX46Y2LD2QGBK5S5SLAFDJBGPSQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.505733477 (331h53m43.276374812s) [noise=true , address=104.36.82.12:4173 , piece_id=5HUGZCEFE3JCGN4PUHPP4IGVCRN2R4KHPIBQJUUTAEGOLDISXF4Q, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.574289655 (331h53m43.34493099s) [noise=true , address=104.36.82.14:4248 , piece_id=GQVC4QYUSXVHM3WZ3OT7XSB42HEOEWHYVBMVGQVSMDFINDON6BSA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.577275016 (331h53m43.347916351s) [noise=true , address=77.90.31.10:4540 , piece_id=3MKHY4HDZSK5YOPP5HYVMEOWWEGDCJUPYEUW2TFPOSATOT2FMWQA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.577418831 (331h53m43.348060166s) [noise=true , address=77.90.31.16:4751 , piece_id=DQNZ6VYCO2WPLAT7CGMQOTIRXLLJTYRCUCVLI3RJZCYUZT3F6YXQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.579017850 (331h53m43.349659185s) [noise=true , address=77.90.31.16:4748 , piece_id=DRUW5HWKQF3LY5AXUQBD4MC2K2TMHJHXBDOP5DRL5WCSIV6KZDHA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.580192378 (331h53m43.350833713s) [noise=true , address=77.90.31.14:4674 , piece_id=KUGSISFXDEFATV2BHKW34NREXENVYMNZRSM3VTXHCZOLBWYCO3IA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.580210843 (331h53m43.350852178s) [seg_pos={0 0}, upload=265483]: Segment reached optimal threshold of 14 pieces.
Jul 7 05:04:08.580342875 (331h53m43.35098421s) [noise=true , address=77.90.31.21:4903 , piece_id=JWQTRU7GLKHFXFBV2KYINTA2SEAUNDWTXER2XLNYIBXNC3KWF5ZA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZYWQ1a2sTKnFpF28iQVrem2s8nSpXkeJzZDaS7jvTZNANdfp): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580430292 (331h53m43.351071627s) [noise=true , address=45.91.116.9:4264 , piece_id=BAUPMJNTKX5S6NGVZYISJH5EJIVMVICZP4PNUKM6D525UNKAJBUA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128f6i7ALVXF3Vr8G8zsZXrNBFiT3cK8UAiic5XbFS1gRjZK86m): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580552847 (331h53m43.351194172s) [noise=true , address=77.90.31.17:4801 , piece_id=DHPU2ISCQWL6TOZQED7BG6JJ5DYRJW5FAYO4MGLB3KEOLVNC3CFA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127QRLNwZLcR5gnAgZrCjSUsH5T4jESmZ4kWeAnpj9YxaTSjoYe): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580638251 (331h53m43.351279586s) [noise=true , address=104.36.82.5:4855 , piece_id=5JPBSZRWWMGKSECM2XBHVQUT3F4U7JXCVXFKYKEJD27W3C5PCWNQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection; write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection
Jul 7 05:04:08.580668078 (331h53m43.351309413s) [seg_pos={0 0}, upload=265483]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 7 05:04:08.580803337 (331h53m43.351444672s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:04:08.580809508 (331h53m43.351450843s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:04:08.869629195 (331h53m43.64027053s) [upload=265483]: Done uploading segments...
Jul 7 05:04:08.869647730 (331h53m43.640289065s) [upload=265483]: Upload finished. err: <nil>
Duration: 5.713864868s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
6.113897591s
FAIL (2025-07-07 05:13:42 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 6.113927338s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
5.448102575s
FAIL (2025-07-07 05:13:20 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
65483]: Got next segment. Inline: false
Jul 7 05:04:06.097422800 (331h53m40.868064135s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:04:06.097428120 (331h53m40.868069445s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:04:06.623732228 (331h53m41.394373563s) [seg_pos={0 0}, upload=265483]: Begin upload segment...
Jul 7 05:04:06.623774189 (331h53m41.394415524s) [seg_pos={0 0}, upload=265483]: Done begin upload segment.
Jul 7 05:04:06.623795539 (331h53m41.394436874s) [noise=true , address=77.90.31.14:4674 , piece_id=KUGSISFXDEFATV2BHKW34NREXENVYMNZRSM3VTXHCZOLBWYCO3IA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.623850364 (331h53m41.394491699s) [noise=true , address=77.90.31.17:4801 , piece_id=DHPU2ISCQWL6TOZQED7BG6JJ5DYRJW5FAYO4MGLB3KEOLVNC3CFA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624347755 (331h53m41.39498909s) [noise=true , address=77.90.31.16:4751 , piece_id=DQNZ6VYCO2WPLAT7CGMQOTIRXLLJTYRCUCVLI3RJZCYUZT3F6YXQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624383835 (331h53m41.39502517s) [noise=true , address=104.36.82.14:4248 , piece_id=GQVC4QYUSXVHM3WZ3OT7XSB42HEOEWHYVBMVGQVSMDFINDON6BSA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624634515 (331h53m41.39527585s) [noise=true , address=45.91.116.9:4264 , piece_id=BAUPMJNTKX5S6NGVZYISJH5EJIVMVICZP4PNUKM6D525UNKAJBUA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624844035 (331h53m41.39548537s) [noise=true , address=104.36.82.45:4927 , piece_id=6ZFIELGIKBDL2IKSE7EQP25Z7HPBP4GRSF5Y2YXUWZX54RV3ZAFA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624903259 (331h53m41.395544594s) [noise=true , address=104.36.82.18:4397 , piece_id=VF4FXOENNLGT3N7ZJ3T7EPYEW6H3YS4ZKHHQJSNLJYOCMGFXVZDQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625117729 (331h53m41.395759064s) [noise=true , address=64.49.13.27:4966 , piece_id=HPG7X2LX5N5CJHAQAWM6JKYHAOPOWRPUXEVWT4SDGYJKPKN2TRKA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625170019 (331h53m41.395811354s) [noise=true , address=104.36.82.5:4855 , piece_id=5JPBSZRWWMGKSECM2XBHVQUT3F4U7JXCVXFKYKEJD27W3C5PCWNQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625343822 (331h53m41.395985157s) [noise=true , address=104.36.82.12:4173 , piece_id=5HUGZCEFE3JCGN4PUHPP4IGVCRN2R4KHPIBQJUUTAEGOLDISXF4Q, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625394227 (331h53m41.396035563s) [noise=true , address=64.49.13.154:4932 , piece_id=4CXUMWUQ37E5ATJKWKIABQKZID2G5PRB563D3LAQTIWCZOLYI76Q, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625563120 (331h53m41.396204456s) [noise=true , address=104.36.82.3:4773 , piece_id=I2XCDVOZ5RWEMWJCBM5FATOKDCUZJFC7G2KTFILU66LJU7NLC5RQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625612635 (331h53m41.39625397s) [noise=true , address=64.49.13.140:4510 , piece_id=SUB4NNB6ZG7TGV76LBI37SUS4FYVH2LBU4DXHPRESLBDDHZHHEPA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625788693 (331h53m41.396430028s) [noise=true , address=77.90.31.16:4748 , piece_id=DRUW5HWKQF3LY5AXUQBD4MC2K2TMHJHXBDOP5DRL5WCSIV6KZDHA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625854649 (331h53m41.396495984s) [noise=true , address=104.36.82.21:4479 , piece_id=56PCCZDSZH545QXGLGRZN2IUDPIF6MTHKAULXZYVAV6BOAE632YQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626075631 (331h53m41.396716966s) [noise=true , address=77.90.31.10:4540 , piece_id=3MKHY4HDZSK5YOPP5HYVMEOWWEGDCJUPYEUW2TFPOSATOT2FMWQA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626273520 (331h53m41.396914855s) [noise=true , address=104.36.82.23:4470 , piece_id=Y3NJ45DLDTZSHKMHTANQ6VTL3BX46Y2LD2QGBK5S5SLAFDJBGPSQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626467301 (331h53m41.397108636s) [noise=true , address=77.90.31.21:4903 , piece_id=JWQTRU7GLKHFXFBV2KYINTA2SEAUNDWTXER2XLNYIBXNC3KWF5ZA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:07.724567296 (331h53m42.495208631s) [upload=265483]: Next returned nil segment
Jul 7 05:04:07.724584218 (331h53m42.495225543s) [upload=265483]: Waiting for error group managing segments...
Jul 7 05:04:08.028542246 (331h53m42.799183581s) [noise=true , address=64.49.13.27:4966 , piece_id=HPG7X2LX5N5CJHAQAWM6JKYHAOPOWRPUXEVWT4SDGYJKPKN2TRKA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.070346103 (331h53m42.840987438s) [noise=true , address=64.49.13.140:4510 , piece_id=SUB4NNB6ZG7TGV76LBI37SUS4FYVH2LBU4DXHPRESLBDDHZHHEPA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.095032022 (331h53m42.865673367s) [noise=true , address=64.49.13.154:4932 , piece_id=4CXUMWUQ37E5ATJKWKIABQKZID2G5PRB563D3LAQTIWCZOLYI76Q, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.428652819 (331h53m43.199294155s) [noise=true , address=104.36.82.18:4397 , piece_id=VF4FXOENNLGT3N7ZJ3T7EPYEW6H3YS4ZKHHQJSNLJYOCMGFXVZDQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.448309175 (331h53m43.21895051s) [noise=true , address=104.36.82.3:4773 , piece_id=I2XCDVOZ5RWEMWJCBM5FATOKDCUZJFC7G2KTFILU66LJU7NLC5RQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.460440203 (331h53m43.231081538s) [noise=true , address=104.36.82.45:4927 , piece_id=6ZFIELGIKBDL2IKSE7EQP25Z7HPBP4GRSF5Y2YXUWZX54RV3ZAFA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.462441062 (331h53m43.233082407s) [noise=true , address=104.36.82.21:4479 , piece_id=56PCCZDSZH545QXGLGRZN2IUDPIF6MTHKAULXZYVAV6BOAE632YQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.479297731 (331h53m43.249939056s) [noise=true , address=104.36.82.23:4470 , piece_id=Y3NJ45DLDTZSHKMHTANQ6VTL3BX46Y2LD2QGBK5S5SLAFDJBGPSQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.505733477 (331h53m43.276374812s) [noise=true , address=104.36.82.12:4173 , piece_id=5HUGZCEFE3JCGN4PUHPP4IGVCRN2R4KHPIBQJUUTAEGOLDISXF4Q, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.574289655 (331h53m43.34493099s) [noise=true , address=104.36.82.14:4248 , piece_id=GQVC4QYUSXVHM3WZ3OT7XSB42HEOEWHYVBMVGQVSMDFINDON6BSA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.577275016 (331h53m43.347916351s) [noise=true , address=77.90.31.10:4540 , piece_id=3MKHY4HDZSK5YOPP5HYVMEOWWEGDCJUPYEUW2TFPOSATOT2FMWQA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.577418831 (331h53m43.348060166s) [noise=true , address=77.90.31.16:4751 , piece_id=DQNZ6VYCO2WPLAT7CGMQOTIRXLLJTYRCUCVLI3RJZCYUZT3F6YXQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.579017850 (331h53m43.349659185s) [noise=true , address=77.90.31.16:4748 , piece_id=DRUW5HWKQF3LY5AXUQBD4MC2K2TMHJHXBDOP5DRL5WCSIV6KZDHA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.580192378 (331h53m43.350833713s) [noise=true , address=77.90.31.14:4674 , piece_id=KUGSISFXDEFATV2BHKW34NREXENVYMNZRSM3VTXHCZOLBWYCO3IA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.580210843 (331h53m43.350852178s) [seg_pos={0 0}, upload=265483]: Segment reached optimal threshold of 14 pieces.
Jul 7 05:04:08.580342875 (331h53m43.35098421s) [noise=true , address=77.90.31.21:4903 , piece_id=JWQTRU7GLKHFXFBV2KYINTA2SEAUNDWTXER2XLNYIBXNC3KWF5ZA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZYWQ1a2sTKnFpF28iQVrem2s8nSpXkeJzZDaS7jvTZNANdfp): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580430292 (331h53m43.351071627s) [noise=true , address=45.91.116.9:4264 , piece_id=BAUPMJNTKX5S6NGVZYISJH5EJIVMVICZP4PNUKM6D525UNKAJBUA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128f6i7ALVXF3Vr8G8zsZXrNBFiT3cK8UAiic5XbFS1gRjZK86m): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580552847 (331h53m43.351194172s) [noise=true , address=77.90.31.17:4801 , piece_id=DHPU2ISCQWL6TOZQED7BG6JJ5DYRJW5FAYO4MGLB3KEOLVNC3CFA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127QRLNwZLcR5gnAgZrCjSUsH5T4jESmZ4kWeAnpj9YxaTSjoYe): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580638251 (331h53m43.351279586s) [noise=true , address=104.36.82.5:4855 , piece_id=5JPBSZRWWMGKSECM2XBHVQUT3F4U7JXCVXFKYKEJD27W3C5PCWNQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection; write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection
Jul 7 05:04:08.580668078 (331h53m43.351309413s) [seg_pos={0 0}, upload=265483]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 7 05:04:08.580803337 (331h53m43.351444672s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:04:08.580809508 (331h53m43.351450843s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:04:08.869629195 (331h53m43.64027053s) [upload=265483]: Done uploading segments...
Jul 7 05:04:08.869647730 (331h53m43.640289065s) [upload=265483]: Upload finished. err: <nil>
Duration: 5.448127132s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
5.575349528s
FAIL (2025-07-07 05:12:57 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 5.57538197s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
5.489200712s
FAIL (2025-07-07 05:12:19 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
65483]: Got next segment. Inline: false
Jul 7 05:04:06.097422800 (331h53m40.868064135s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:04:06.097428120 (331h53m40.868069445s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:04:06.623732228 (331h53m41.394373563s) [seg_pos={0 0}, upload=265483]: Begin upload segment...
Jul 7 05:04:06.623774189 (331h53m41.394415524s) [seg_pos={0 0}, upload=265483]: Done begin upload segment.
Jul 7 05:04:06.623795539 (331h53m41.394436874s) [noise=true , address=77.90.31.14:4674 , piece_id=KUGSISFXDEFATV2BHKW34NREXENVYMNZRSM3VTXHCZOLBWYCO3IA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.623850364 (331h53m41.394491699s) [noise=true , address=77.90.31.17:4801 , piece_id=DHPU2ISCQWL6TOZQED7BG6JJ5DYRJW5FAYO4MGLB3KEOLVNC3CFA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624347755 (331h53m41.39498909s) [noise=true , address=77.90.31.16:4751 , piece_id=DQNZ6VYCO2WPLAT7CGMQOTIRXLLJTYRCUCVLI3RJZCYUZT3F6YXQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624383835 (331h53m41.39502517s) [noise=true , address=104.36.82.14:4248 , piece_id=GQVC4QYUSXVHM3WZ3OT7XSB42HEOEWHYVBMVGQVSMDFINDON6BSA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624634515 (331h53m41.39527585s) [noise=true , address=45.91.116.9:4264 , piece_id=BAUPMJNTKX5S6NGVZYISJH5EJIVMVICZP4PNUKM6D525UNKAJBUA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624844035 (331h53m41.39548537s) [noise=true , address=104.36.82.45:4927 , piece_id=6ZFIELGIKBDL2IKSE7EQP25Z7HPBP4GRSF5Y2YXUWZX54RV3ZAFA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624903259 (331h53m41.395544594s) [noise=true , address=104.36.82.18:4397 , piece_id=VF4FXOENNLGT3N7ZJ3T7EPYEW6H3YS4ZKHHQJSNLJYOCMGFXVZDQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625117729 (331h53m41.395759064s) [noise=true , address=64.49.13.27:4966 , piece_id=HPG7X2LX5N5CJHAQAWM6JKYHAOPOWRPUXEVWT4SDGYJKPKN2TRKA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625170019 (331h53m41.395811354s) [noise=true , address=104.36.82.5:4855 , piece_id=5JPBSZRWWMGKSECM2XBHVQUT3F4U7JXCVXFKYKEJD27W3C5PCWNQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625343822 (331h53m41.395985157s) [noise=true , address=104.36.82.12:4173 , piece_id=5HUGZCEFE3JCGN4PUHPP4IGVCRN2R4KHPIBQJUUTAEGOLDISXF4Q, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625394227 (331h53m41.396035563s) [noise=true , address=64.49.13.154:4932 , piece_id=4CXUMWUQ37E5ATJKWKIABQKZID2G5PRB563D3LAQTIWCZOLYI76Q, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625563120 (331h53m41.396204456s) [noise=true , address=104.36.82.3:4773 , piece_id=I2XCDVOZ5RWEMWJCBM5FATOKDCUZJFC7G2KTFILU66LJU7NLC5RQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625612635 (331h53m41.39625397s) [noise=true , address=64.49.13.140:4510 , piece_id=SUB4NNB6ZG7TGV76LBI37SUS4FYVH2LBU4DXHPRESLBDDHZHHEPA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625788693 (331h53m41.396430028s) [noise=true , address=77.90.31.16:4748 , piece_id=DRUW5HWKQF3LY5AXUQBD4MC2K2TMHJHXBDOP5DRL5WCSIV6KZDHA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625854649 (331h53m41.396495984s) [noise=true , address=104.36.82.21:4479 , piece_id=56PCCZDSZH545QXGLGRZN2IUDPIF6MTHKAULXZYVAV6BOAE632YQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626075631 (331h53m41.396716966s) [noise=true , address=77.90.31.10:4540 , piece_id=3MKHY4HDZSK5YOPP5HYVMEOWWEGDCJUPYEUW2TFPOSATOT2FMWQA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626273520 (331h53m41.396914855s) [noise=true , address=104.36.82.23:4470 , piece_id=Y3NJ45DLDTZSHKMHTANQ6VTL3BX46Y2LD2QGBK5S5SLAFDJBGPSQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626467301 (331h53m41.397108636s) [noise=true , address=77.90.31.21:4903 , piece_id=JWQTRU7GLKHFXFBV2KYINTA2SEAUNDWTXER2XLNYIBXNC3KWF5ZA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:07.724567296 (331h53m42.495208631s) [upload=265483]: Next returned nil segment
Jul 7 05:04:07.724584218 (331h53m42.495225543s) [upload=265483]: Waiting for error group managing segments...
Jul 7 05:04:08.028542246 (331h53m42.799183581s) [noise=true , address=64.49.13.27:4966 , piece_id=HPG7X2LX5N5CJHAQAWM6JKYHAOPOWRPUXEVWT4SDGYJKPKN2TRKA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.070346103 (331h53m42.840987438s) [noise=true , address=64.49.13.140:4510 , piece_id=SUB4NNB6ZG7TGV76LBI37SUS4FYVH2LBU4DXHPRESLBDDHZHHEPA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.095032022 (331h53m42.865673367s) [noise=true , address=64.49.13.154:4932 , piece_id=4CXUMWUQ37E5ATJKWKIABQKZID2G5PRB563D3LAQTIWCZOLYI76Q, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.428652819 (331h53m43.199294155s) [noise=true , address=104.36.82.18:4397 , piece_id=VF4FXOENNLGT3N7ZJ3T7EPYEW6H3YS4ZKHHQJSNLJYOCMGFXVZDQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.448309175 (331h53m43.21895051s) [noise=true , address=104.36.82.3:4773 , piece_id=I2XCDVOZ5RWEMWJCBM5FATOKDCUZJFC7G2KTFILU66LJU7NLC5RQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.460440203 (331h53m43.231081538s) [noise=true , address=104.36.82.45:4927 , piece_id=6ZFIELGIKBDL2IKSE7EQP25Z7HPBP4GRSF5Y2YXUWZX54RV3ZAFA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.462441062 (331h53m43.233082407s) [noise=true , address=104.36.82.21:4479 , piece_id=56PCCZDSZH545QXGLGRZN2IUDPIF6MTHKAULXZYVAV6BOAE632YQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.479297731 (331h53m43.249939056s) [noise=true , address=104.36.82.23:4470 , piece_id=Y3NJ45DLDTZSHKMHTANQ6VTL3BX46Y2LD2QGBK5S5SLAFDJBGPSQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.505733477 (331h53m43.276374812s) [noise=true , address=104.36.82.12:4173 , piece_id=5HUGZCEFE3JCGN4PUHPP4IGVCRN2R4KHPIBQJUUTAEGOLDISXF4Q, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.574289655 (331h53m43.34493099s) [noise=true , address=104.36.82.14:4248 , piece_id=GQVC4QYUSXVHM3WZ3OT7XSB42HEOEWHYVBMVGQVSMDFINDON6BSA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.577275016 (331h53m43.347916351s) [noise=true , address=77.90.31.10:4540 , piece_id=3MKHY4HDZSK5YOPP5HYVMEOWWEGDCJUPYEUW2TFPOSATOT2FMWQA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.577418831 (331h53m43.348060166s) [noise=true , address=77.90.31.16:4751 , piece_id=DQNZ6VYCO2WPLAT7CGMQOTIRXLLJTYRCUCVLI3RJZCYUZT3F6YXQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.579017850 (331h53m43.349659185s) [noise=true , address=77.90.31.16:4748 , piece_id=DRUW5HWKQF3LY5AXUQBD4MC2K2TMHJHXBDOP5DRL5WCSIV6KZDHA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.580192378 (331h53m43.350833713s) [noise=true , address=77.90.31.14:4674 , piece_id=KUGSISFXDEFATV2BHKW34NREXENVYMNZRSM3VTXHCZOLBWYCO3IA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.580210843 (331h53m43.350852178s) [seg_pos={0 0}, upload=265483]: Segment reached optimal threshold of 14 pieces.
Jul 7 05:04:08.580342875 (331h53m43.35098421s) [noise=true , address=77.90.31.21:4903 , piece_id=JWQTRU7GLKHFXFBV2KYINTA2SEAUNDWTXER2XLNYIBXNC3KWF5ZA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZYWQ1a2sTKnFpF28iQVrem2s8nSpXkeJzZDaS7jvTZNANdfp): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580430292 (331h53m43.351071627s) [noise=true , address=45.91.116.9:4264 , piece_id=BAUPMJNTKX5S6NGVZYISJH5EJIVMVICZP4PNUKM6D525UNKAJBUA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128f6i7ALVXF3Vr8G8zsZXrNBFiT3cK8UAiic5XbFS1gRjZK86m): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580552847 (331h53m43.351194172s) [noise=true , address=77.90.31.17:4801 , piece_id=DHPU2ISCQWL6TOZQED7BG6JJ5DYRJW5FAYO4MGLB3KEOLVNC3CFA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127QRLNwZLcR5gnAgZrCjSUsH5T4jESmZ4kWeAnpj9YxaTSjoYe): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580638251 (331h53m43.351279586s) [noise=true , address=104.36.82.5:4855 , piece_id=5JPBSZRWWMGKSECM2XBHVQUT3F4U7JXCVXFKYKEJD27W3C5PCWNQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection; write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection
Jul 7 05:04:08.580668078 (331h53m43.351309413s) [seg_pos={0 0}, upload=265483]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 7 05:04:08.580803337 (331h53m43.351444672s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:04:08.580809508 (331h53m43.351450843s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:04:08.869629195 (331h53m43.64027053s) [upload=265483]: Done uploading segments...
Jul 7 05:04:08.869647730 (331h53m43.640289065s) [upload=265483]: Upload finished. err: <nil>
Duration: 5.48923612s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
5.938353639s
FAIL (2025-07-07 05:11:44 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 5.938377064s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
5.599617258s
FAIL (2025-07-07 05:11:39 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
65483]: Got next segment. Inline: false
Jul 7 05:04:06.097422800 (331h53m40.868064135s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:04:06.097428120 (331h53m40.868069445s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:04:06.623732228 (331h53m41.394373563s) [seg_pos={0 0}, upload=265483]: Begin upload segment...
Jul 7 05:04:06.623774189 (331h53m41.394415524s) [seg_pos={0 0}, upload=265483]: Done begin upload segment.
Jul 7 05:04:06.623795539 (331h53m41.394436874s) [noise=true , address=77.90.31.14:4674 , piece_id=KUGSISFXDEFATV2BHKW34NREXENVYMNZRSM3VTXHCZOLBWYCO3IA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.623850364 (331h53m41.394491699s) [noise=true , address=77.90.31.17:4801 , piece_id=DHPU2ISCQWL6TOZQED7BG6JJ5DYRJW5FAYO4MGLB3KEOLVNC3CFA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624347755 (331h53m41.39498909s) [noise=true , address=77.90.31.16:4751 , piece_id=DQNZ6VYCO2WPLAT7CGMQOTIRXLLJTYRCUCVLI3RJZCYUZT3F6YXQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624383835 (331h53m41.39502517s) [noise=true , address=104.36.82.14:4248 , piece_id=GQVC4QYUSXVHM3WZ3OT7XSB42HEOEWHYVBMVGQVSMDFINDON6BSA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624634515 (331h53m41.39527585s) [noise=true , address=45.91.116.9:4264 , piece_id=BAUPMJNTKX5S6NGVZYISJH5EJIVMVICZP4PNUKM6D525UNKAJBUA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624844035 (331h53m41.39548537s) [noise=true , address=104.36.82.45:4927 , piece_id=6ZFIELGIKBDL2IKSE7EQP25Z7HPBP4GRSF5Y2YXUWZX54RV3ZAFA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624903259 (331h53m41.395544594s) [noise=true , address=104.36.82.18:4397 , piece_id=VF4FXOENNLGT3N7ZJ3T7EPYEW6H3YS4ZKHHQJSNLJYOCMGFXVZDQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625117729 (331h53m41.395759064s) [noise=true , address=64.49.13.27:4966 , piece_id=HPG7X2LX5N5CJHAQAWM6JKYHAOPOWRPUXEVWT4SDGYJKPKN2TRKA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625170019 (331h53m41.395811354s) [noise=true , address=104.36.82.5:4855 , piece_id=5JPBSZRWWMGKSECM2XBHVQUT3F4U7JXCVXFKYKEJD27W3C5PCWNQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625343822 (331h53m41.395985157s) [noise=true , address=104.36.82.12:4173 , piece_id=5HUGZCEFE3JCGN4PUHPP4IGVCRN2R4KHPIBQJUUTAEGOLDISXF4Q, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625394227 (331h53m41.396035563s) [noise=true , address=64.49.13.154:4932 , piece_id=4CXUMWUQ37E5ATJKWKIABQKZID2G5PRB563D3LAQTIWCZOLYI76Q, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625563120 (331h53m41.396204456s) [noise=true , address=104.36.82.3:4773 , piece_id=I2XCDVOZ5RWEMWJCBM5FATOKDCUZJFC7G2KTFILU66LJU7NLC5RQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625612635 (331h53m41.39625397s) [noise=true , address=64.49.13.140:4510 , piece_id=SUB4NNB6ZG7TGV76LBI37SUS4FYVH2LBU4DXHPRESLBDDHZHHEPA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625788693 (331h53m41.396430028s) [noise=true , address=77.90.31.16:4748 , piece_id=DRUW5HWKQF3LY5AXUQBD4MC2K2TMHJHXBDOP5DRL5WCSIV6KZDHA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625854649 (331h53m41.396495984s) [noise=true , address=104.36.82.21:4479 , piece_id=56PCCZDSZH545QXGLGRZN2IUDPIF6MTHKAULXZYVAV6BOAE632YQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626075631 (331h53m41.396716966s) [noise=true , address=77.90.31.10:4540 , piece_id=3MKHY4HDZSK5YOPP5HYVMEOWWEGDCJUPYEUW2TFPOSATOT2FMWQA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626273520 (331h53m41.396914855s) [noise=true , address=104.36.82.23:4470 , piece_id=Y3NJ45DLDTZSHKMHTANQ6VTL3BX46Y2LD2QGBK5S5SLAFDJBGPSQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626467301 (331h53m41.397108636s) [noise=true , address=77.90.31.21:4903 , piece_id=JWQTRU7GLKHFXFBV2KYINTA2SEAUNDWTXER2XLNYIBXNC3KWF5ZA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:07.724567296 (331h53m42.495208631s) [upload=265483]: Next returned nil segment
Jul 7 05:04:07.724584218 (331h53m42.495225543s) [upload=265483]: Waiting for error group managing segments...
Jul 7 05:04:08.028542246 (331h53m42.799183581s) [noise=true , address=64.49.13.27:4966 , piece_id=HPG7X2LX5N5CJHAQAWM6JKYHAOPOWRPUXEVWT4SDGYJKPKN2TRKA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.070346103 (331h53m42.840987438s) [noise=true , address=64.49.13.140:4510 , piece_id=SUB4NNB6ZG7TGV76LBI37SUS4FYVH2LBU4DXHPRESLBDDHZHHEPA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.095032022 (331h53m42.865673367s) [noise=true , address=64.49.13.154:4932 , piece_id=4CXUMWUQ37E5ATJKWKIABQKZID2G5PRB563D3LAQTIWCZOLYI76Q, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.428652819 (331h53m43.199294155s) [noise=true , address=104.36.82.18:4397 , piece_id=VF4FXOENNLGT3N7ZJ3T7EPYEW6H3YS4ZKHHQJSNLJYOCMGFXVZDQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.448309175 (331h53m43.21895051s) [noise=true , address=104.36.82.3:4773 , piece_id=I2XCDVOZ5RWEMWJCBM5FATOKDCUZJFC7G2KTFILU66LJU7NLC5RQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.460440203 (331h53m43.231081538s) [noise=true , address=104.36.82.45:4927 , piece_id=6ZFIELGIKBDL2IKSE7EQP25Z7HPBP4GRSF5Y2YXUWZX54RV3ZAFA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.462441062 (331h53m43.233082407s) [noise=true , address=104.36.82.21:4479 , piece_id=56PCCZDSZH545QXGLGRZN2IUDPIF6MTHKAULXZYVAV6BOAE632YQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.479297731 (331h53m43.249939056s) [noise=true , address=104.36.82.23:4470 , piece_id=Y3NJ45DLDTZSHKMHTANQ6VTL3BX46Y2LD2QGBK5S5SLAFDJBGPSQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.505733477 (331h53m43.276374812s) [noise=true , address=104.36.82.12:4173 , piece_id=5HUGZCEFE3JCGN4PUHPP4IGVCRN2R4KHPIBQJUUTAEGOLDISXF4Q, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.574289655 (331h53m43.34493099s) [noise=true , address=104.36.82.14:4248 , piece_id=GQVC4QYUSXVHM3WZ3OT7XSB42HEOEWHYVBMVGQVSMDFINDON6BSA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.577275016 (331h53m43.347916351s) [noise=true , address=77.90.31.10:4540 , piece_id=3MKHY4HDZSK5YOPP5HYVMEOWWEGDCJUPYEUW2TFPOSATOT2FMWQA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.577418831 (331h53m43.348060166s) [noise=true , address=77.90.31.16:4751 , piece_id=DQNZ6VYCO2WPLAT7CGMQOTIRXLLJTYRCUCVLI3RJZCYUZT3F6YXQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.579017850 (331h53m43.349659185s) [noise=true , address=77.90.31.16:4748 , piece_id=DRUW5HWKQF3LY5AXUQBD4MC2K2TMHJHXBDOP5DRL5WCSIV6KZDHA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.580192378 (331h53m43.350833713s) [noise=true , address=77.90.31.14:4674 , piece_id=KUGSISFXDEFATV2BHKW34NREXENVYMNZRSM3VTXHCZOLBWYCO3IA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.580210843 (331h53m43.350852178s) [seg_pos={0 0}, upload=265483]: Segment reached optimal threshold of 14 pieces.
Jul 7 05:04:08.580342875 (331h53m43.35098421s) [noise=true , address=77.90.31.21:4903 , piece_id=JWQTRU7GLKHFXFBV2KYINTA2SEAUNDWTXER2XLNYIBXNC3KWF5ZA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZYWQ1a2sTKnFpF28iQVrem2s8nSpXkeJzZDaS7jvTZNANdfp): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580430292 (331h53m43.351071627s) [noise=true , address=45.91.116.9:4264 , piece_id=BAUPMJNTKX5S6NGVZYISJH5EJIVMVICZP4PNUKM6D525UNKAJBUA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128f6i7ALVXF3Vr8G8zsZXrNBFiT3cK8UAiic5XbFS1gRjZK86m): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580552847 (331h53m43.351194172s) [noise=true , address=77.90.31.17:4801 , piece_id=DHPU2ISCQWL6TOZQED7BG6JJ5DYRJW5FAYO4MGLB3KEOLVNC3CFA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127QRLNwZLcR5gnAgZrCjSUsH5T4jESmZ4kWeAnpj9YxaTSjoYe): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580638251 (331h53m43.351279586s) [noise=true , address=104.36.82.5:4855 , piece_id=5JPBSZRWWMGKSECM2XBHVQUT3F4U7JXCVXFKYKEJD27W3C5PCWNQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection; write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection
Jul 7 05:04:08.580668078 (331h53m43.351309413s) [seg_pos={0 0}, upload=265483]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 7 05:04:08.580803337 (331h53m43.351444672s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:04:08.580809508 (331h53m43.351450843s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:04:08.869629195 (331h53m43.64027053s) [upload=265483]: Done uploading segments...
Jul 7 05:04:08.869647730 (331h53m43.640289065s) [upload=265483]: Upload finished. err: <nil>
Duration: 5.599645242s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.001055745s
FAIL (2025-07-07 05:11:13 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 30.001081453s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
5.699374558s
FAIL (2025-07-07 05:10:48 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
65483]: Got next segment. Inline: false
Jul 7 05:04:06.097422800 (331h53m40.868064135s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:04:06.097428120 (331h53m40.868069445s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:04:06.623732228 (331h53m41.394373563s) [seg_pos={0 0}, upload=265483]: Begin upload segment...
Jul 7 05:04:06.623774189 (331h53m41.394415524s) [seg_pos={0 0}, upload=265483]: Done begin upload segment.
Jul 7 05:04:06.623795539 (331h53m41.394436874s) [noise=true , address=77.90.31.14:4674 , piece_id=KUGSISFXDEFATV2BHKW34NREXENVYMNZRSM3VTXHCZOLBWYCO3IA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.623850364 (331h53m41.394491699s) [noise=true , address=77.90.31.17:4801 , piece_id=DHPU2ISCQWL6TOZQED7BG6JJ5DYRJW5FAYO4MGLB3KEOLVNC3CFA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624347755 (331h53m41.39498909s) [noise=true , address=77.90.31.16:4751 , piece_id=DQNZ6VYCO2WPLAT7CGMQOTIRXLLJTYRCUCVLI3RJZCYUZT3F6YXQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624383835 (331h53m41.39502517s) [noise=true , address=104.36.82.14:4248 , piece_id=GQVC4QYUSXVHM3WZ3OT7XSB42HEOEWHYVBMVGQVSMDFINDON6BSA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624634515 (331h53m41.39527585s) [noise=true , address=45.91.116.9:4264 , piece_id=BAUPMJNTKX5S6NGVZYISJH5EJIVMVICZP4PNUKM6D525UNKAJBUA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624844035 (331h53m41.39548537s) [noise=true , address=104.36.82.45:4927 , piece_id=6ZFIELGIKBDL2IKSE7EQP25Z7HPBP4GRSF5Y2YXUWZX54RV3ZAFA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624903259 (331h53m41.395544594s) [noise=true , address=104.36.82.18:4397 , piece_id=VF4FXOENNLGT3N7ZJ3T7EPYEW6H3YS4ZKHHQJSNLJYOCMGFXVZDQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625117729 (331h53m41.395759064s) [noise=true , address=64.49.13.27:4966 , piece_id=HPG7X2LX5N5CJHAQAWM6JKYHAOPOWRPUXEVWT4SDGYJKPKN2TRKA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625170019 (331h53m41.395811354s) [noise=true , address=104.36.82.5:4855 , piece_id=5JPBSZRWWMGKSECM2XBHVQUT3F4U7JXCVXFKYKEJD27W3C5PCWNQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625343822 (331h53m41.395985157s) [noise=true , address=104.36.82.12:4173 , piece_id=5HUGZCEFE3JCGN4PUHPP4IGVCRN2R4KHPIBQJUUTAEGOLDISXF4Q, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625394227 (331h53m41.396035563s) [noise=true , address=64.49.13.154:4932 , piece_id=4CXUMWUQ37E5ATJKWKIABQKZID2G5PRB563D3LAQTIWCZOLYI76Q, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625563120 (331h53m41.396204456s) [noise=true , address=104.36.82.3:4773 , piece_id=I2XCDVOZ5RWEMWJCBM5FATOKDCUZJFC7G2KTFILU66LJU7NLC5RQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625612635 (331h53m41.39625397s) [noise=true , address=64.49.13.140:4510 , piece_id=SUB4NNB6ZG7TGV76LBI37SUS4FYVH2LBU4DXHPRESLBDDHZHHEPA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625788693 (331h53m41.396430028s) [noise=true , address=77.90.31.16:4748 , piece_id=DRUW5HWKQF3LY5AXUQBD4MC2K2TMHJHXBDOP5DRL5WCSIV6KZDHA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625854649 (331h53m41.396495984s) [noise=true , address=104.36.82.21:4479 , piece_id=56PCCZDSZH545QXGLGRZN2IUDPIF6MTHKAULXZYVAV6BOAE632YQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626075631 (331h53m41.396716966s) [noise=true , address=77.90.31.10:4540 , piece_id=3MKHY4HDZSK5YOPP5HYVMEOWWEGDCJUPYEUW2TFPOSATOT2FMWQA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626273520 (331h53m41.396914855s) [noise=true , address=104.36.82.23:4470 , piece_id=Y3NJ45DLDTZSHKMHTANQ6VTL3BX46Y2LD2QGBK5S5SLAFDJBGPSQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626467301 (331h53m41.397108636s) [noise=true , address=77.90.31.21:4903 , piece_id=JWQTRU7GLKHFXFBV2KYINTA2SEAUNDWTXER2XLNYIBXNC3KWF5ZA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:07.724567296 (331h53m42.495208631s) [upload=265483]: Next returned nil segment
Jul 7 05:04:07.724584218 (331h53m42.495225543s) [upload=265483]: Waiting for error group managing segments...
Jul 7 05:04:08.028542246 (331h53m42.799183581s) [noise=true , address=64.49.13.27:4966 , piece_id=HPG7X2LX5N5CJHAQAWM6JKYHAOPOWRPUXEVWT4SDGYJKPKN2TRKA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.070346103 (331h53m42.840987438s) [noise=true , address=64.49.13.140:4510 , piece_id=SUB4NNB6ZG7TGV76LBI37SUS4FYVH2LBU4DXHPRESLBDDHZHHEPA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.095032022 (331h53m42.865673367s) [noise=true , address=64.49.13.154:4932 , piece_id=4CXUMWUQ37E5ATJKWKIABQKZID2G5PRB563D3LAQTIWCZOLYI76Q, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.428652819 (331h53m43.199294155s) [noise=true , address=104.36.82.18:4397 , piece_id=VF4FXOENNLGT3N7ZJ3T7EPYEW6H3YS4ZKHHQJSNLJYOCMGFXVZDQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.448309175 (331h53m43.21895051s) [noise=true , address=104.36.82.3:4773 , piece_id=I2XCDVOZ5RWEMWJCBM5FATOKDCUZJFC7G2KTFILU66LJU7NLC5RQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.460440203 (331h53m43.231081538s) [noise=true , address=104.36.82.45:4927 , piece_id=6ZFIELGIKBDL2IKSE7EQP25Z7HPBP4GRSF5Y2YXUWZX54RV3ZAFA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.462441062 (331h53m43.233082407s) [noise=true , address=104.36.82.21:4479 , piece_id=56PCCZDSZH545QXGLGRZN2IUDPIF6MTHKAULXZYVAV6BOAE632YQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.479297731 (331h53m43.249939056s) [noise=true , address=104.36.82.23:4470 , piece_id=Y3NJ45DLDTZSHKMHTANQ6VTL3BX46Y2LD2QGBK5S5SLAFDJBGPSQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.505733477 (331h53m43.276374812s) [noise=true , address=104.36.82.12:4173 , piece_id=5HUGZCEFE3JCGN4PUHPP4IGVCRN2R4KHPIBQJUUTAEGOLDISXF4Q, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.574289655 (331h53m43.34493099s) [noise=true , address=104.36.82.14:4248 , piece_id=GQVC4QYUSXVHM3WZ3OT7XSB42HEOEWHYVBMVGQVSMDFINDON6BSA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.577275016 (331h53m43.347916351s) [noise=true , address=77.90.31.10:4540 , piece_id=3MKHY4HDZSK5YOPP5HYVMEOWWEGDCJUPYEUW2TFPOSATOT2FMWQA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.577418831 (331h53m43.348060166s) [noise=true , address=77.90.31.16:4751 , piece_id=DQNZ6VYCO2WPLAT7CGMQOTIRXLLJTYRCUCVLI3RJZCYUZT3F6YXQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.579017850 (331h53m43.349659185s) [noise=true , address=77.90.31.16:4748 , piece_id=DRUW5HWKQF3LY5AXUQBD4MC2K2TMHJHXBDOP5DRL5WCSIV6KZDHA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.580192378 (331h53m43.350833713s) [noise=true , address=77.90.31.14:4674 , piece_id=KUGSISFXDEFATV2BHKW34NREXENVYMNZRSM3VTXHCZOLBWYCO3IA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.580210843 (331h53m43.350852178s) [seg_pos={0 0}, upload=265483]: Segment reached optimal threshold of 14 pieces.
Jul 7 05:04:08.580342875 (331h53m43.35098421s) [noise=true , address=77.90.31.21:4903 , piece_id=JWQTRU7GLKHFXFBV2KYINTA2SEAUNDWTXER2XLNYIBXNC3KWF5ZA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZYWQ1a2sTKnFpF28iQVrem2s8nSpXkeJzZDaS7jvTZNANdfp): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580430292 (331h53m43.351071627s) [noise=true , address=45.91.116.9:4264 , piece_id=BAUPMJNTKX5S6NGVZYISJH5EJIVMVICZP4PNUKM6D525UNKAJBUA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128f6i7ALVXF3Vr8G8zsZXrNBFiT3cK8UAiic5XbFS1gRjZK86m): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580552847 (331h53m43.351194172s) [noise=true , address=77.90.31.17:4801 , piece_id=DHPU2ISCQWL6TOZQED7BG6JJ5DYRJW5FAYO4MGLB3KEOLVNC3CFA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127QRLNwZLcR5gnAgZrCjSUsH5T4jESmZ4kWeAnpj9YxaTSjoYe): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580638251 (331h53m43.351279586s) [noise=true , address=104.36.82.5:4855 , piece_id=5JPBSZRWWMGKSECM2XBHVQUT3F4U7JXCVXFKYKEJD27W3C5PCWNQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection; write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection
Jul 7 05:04:08.580668078 (331h53m43.351309413s) [seg_pos={0 0}, upload=265483]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 7 05:04:08.580803337 (331h53m43.351444672s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:04:08.580809508 (331h53m43.351450843s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:04:08.869629195 (331h53m43.64027053s) [upload=265483]: Done uploading segments...
Jul 7 05:04:08.869647730 (331h53m43.640289065s) [upload=265483]: Upload finished. err: <nil>
Duration: 5.69940119s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
5.652285013s
FAIL (2025-07-07 05:10:08 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
65483]: Got next segment. Inline: false
Jul 7 05:04:06.097422800 (331h53m40.868064135s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:04:06.097428120 (331h53m40.868069445s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:04:06.623732228 (331h53m41.394373563s) [seg_pos={0 0}, upload=265483]: Begin upload segment...
Jul 7 05:04:06.623774189 (331h53m41.394415524s) [seg_pos={0 0}, upload=265483]: Done begin upload segment.
Jul 7 05:04:06.623795539 (331h53m41.394436874s) [noise=true , address=77.90.31.14:4674 , piece_id=KUGSISFXDEFATV2BHKW34NREXENVYMNZRSM3VTXHCZOLBWYCO3IA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.623850364 (331h53m41.394491699s) [noise=true , address=77.90.31.17:4801 , piece_id=DHPU2ISCQWL6TOZQED7BG6JJ5DYRJW5FAYO4MGLB3KEOLVNC3CFA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624347755 (331h53m41.39498909s) [noise=true , address=77.90.31.16:4751 , piece_id=DQNZ6VYCO2WPLAT7CGMQOTIRXLLJTYRCUCVLI3RJZCYUZT3F6YXQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624383835 (331h53m41.39502517s) [noise=true , address=104.36.82.14:4248 , piece_id=GQVC4QYUSXVHM3WZ3OT7XSB42HEOEWHYVBMVGQVSMDFINDON6BSA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624634515 (331h53m41.39527585s) [noise=true , address=45.91.116.9:4264 , piece_id=BAUPMJNTKX5S6NGVZYISJH5EJIVMVICZP4PNUKM6D525UNKAJBUA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624844035 (331h53m41.39548537s) [noise=true , address=104.36.82.45:4927 , piece_id=6ZFIELGIKBDL2IKSE7EQP25Z7HPBP4GRSF5Y2YXUWZX54RV3ZAFA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624903259 (331h53m41.395544594s) [noise=true , address=104.36.82.18:4397 , piece_id=VF4FXOENNLGT3N7ZJ3T7EPYEW6H3YS4ZKHHQJSNLJYOCMGFXVZDQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625117729 (331h53m41.395759064s) [noise=true , address=64.49.13.27:4966 , piece_id=HPG7X2LX5N5CJHAQAWM6JKYHAOPOWRPUXEVWT4SDGYJKPKN2TRKA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625170019 (331h53m41.395811354s) [noise=true , address=104.36.82.5:4855 , piece_id=5JPBSZRWWMGKSECM2XBHVQUT3F4U7JXCVXFKYKEJD27W3C5PCWNQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625343822 (331h53m41.395985157s) [noise=true , address=104.36.82.12:4173 , piece_id=5HUGZCEFE3JCGN4PUHPP4IGVCRN2R4KHPIBQJUUTAEGOLDISXF4Q, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625394227 (331h53m41.396035563s) [noise=true , address=64.49.13.154:4932 , piece_id=4CXUMWUQ37E5ATJKWKIABQKZID2G5PRB563D3LAQTIWCZOLYI76Q, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625563120 (331h53m41.396204456s) [noise=true , address=104.36.82.3:4773 , piece_id=I2XCDVOZ5RWEMWJCBM5FATOKDCUZJFC7G2KTFILU66LJU7NLC5RQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625612635 (331h53m41.39625397s) [noise=true , address=64.49.13.140:4510 , piece_id=SUB4NNB6ZG7TGV76LBI37SUS4FYVH2LBU4DXHPRESLBDDHZHHEPA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625788693 (331h53m41.396430028s) [noise=true , address=77.90.31.16:4748 , piece_id=DRUW5HWKQF3LY5AXUQBD4MC2K2TMHJHXBDOP5DRL5WCSIV6KZDHA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625854649 (331h53m41.396495984s) [noise=true , address=104.36.82.21:4479 , piece_id=56PCCZDSZH545QXGLGRZN2IUDPIF6MTHKAULXZYVAV6BOAE632YQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626075631 (331h53m41.396716966s) [noise=true , address=77.90.31.10:4540 , piece_id=3MKHY4HDZSK5YOPP5HYVMEOWWEGDCJUPYEUW2TFPOSATOT2FMWQA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626273520 (331h53m41.396914855s) [noise=true , address=104.36.82.23:4470 , piece_id=Y3NJ45DLDTZSHKMHTANQ6VTL3BX46Y2LD2QGBK5S5SLAFDJBGPSQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626467301 (331h53m41.397108636s) [noise=true , address=77.90.31.21:4903 , piece_id=JWQTRU7GLKHFXFBV2KYINTA2SEAUNDWTXER2XLNYIBXNC3KWF5ZA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:07.724567296 (331h53m42.495208631s) [upload=265483]: Next returned nil segment
Jul 7 05:04:07.724584218 (331h53m42.495225543s) [upload=265483]: Waiting for error group managing segments...
Jul 7 05:04:08.028542246 (331h53m42.799183581s) [noise=true , address=64.49.13.27:4966 , piece_id=HPG7X2LX5N5CJHAQAWM6JKYHAOPOWRPUXEVWT4SDGYJKPKN2TRKA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.070346103 (331h53m42.840987438s) [noise=true , address=64.49.13.140:4510 , piece_id=SUB4NNB6ZG7TGV76LBI37SUS4FYVH2LBU4DXHPRESLBDDHZHHEPA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.095032022 (331h53m42.865673367s) [noise=true , address=64.49.13.154:4932 , piece_id=4CXUMWUQ37E5ATJKWKIABQKZID2G5PRB563D3LAQTIWCZOLYI76Q, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.428652819 (331h53m43.199294155s) [noise=true , address=104.36.82.18:4397 , piece_id=VF4FXOENNLGT3N7ZJ3T7EPYEW6H3YS4ZKHHQJSNLJYOCMGFXVZDQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.448309175 (331h53m43.21895051s) [noise=true , address=104.36.82.3:4773 , piece_id=I2XCDVOZ5RWEMWJCBM5FATOKDCUZJFC7G2KTFILU66LJU7NLC5RQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.460440203 (331h53m43.231081538s) [noise=true , address=104.36.82.45:4927 , piece_id=6ZFIELGIKBDL2IKSE7EQP25Z7HPBP4GRSF5Y2YXUWZX54RV3ZAFA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.462441062 (331h53m43.233082407s) [noise=true , address=104.36.82.21:4479 , piece_id=56PCCZDSZH545QXGLGRZN2IUDPIF6MTHKAULXZYVAV6BOAE632YQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.479297731 (331h53m43.249939056s) [noise=true , address=104.36.82.23:4470 , piece_id=Y3NJ45DLDTZSHKMHTANQ6VTL3BX46Y2LD2QGBK5S5SLAFDJBGPSQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.505733477 (331h53m43.276374812s) [noise=true , address=104.36.82.12:4173 , piece_id=5HUGZCEFE3JCGN4PUHPP4IGVCRN2R4KHPIBQJUUTAEGOLDISXF4Q, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.574289655 (331h53m43.34493099s) [noise=true , address=104.36.82.14:4248 , piece_id=GQVC4QYUSXVHM3WZ3OT7XSB42HEOEWHYVBMVGQVSMDFINDON6BSA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.577275016 (331h53m43.347916351s) [noise=true , address=77.90.31.10:4540 , piece_id=3MKHY4HDZSK5YOPP5HYVMEOWWEGDCJUPYEUW2TFPOSATOT2FMWQA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.577418831 (331h53m43.348060166s) [noise=true , address=77.90.31.16:4751 , piece_id=DQNZ6VYCO2WPLAT7CGMQOTIRXLLJTYRCUCVLI3RJZCYUZT3F6YXQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.579017850 (331h53m43.349659185s) [noise=true , address=77.90.31.16:4748 , piece_id=DRUW5HWKQF3LY5AXUQBD4MC2K2TMHJHXBDOP5DRL5WCSIV6KZDHA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.580192378 (331h53m43.350833713s) [noise=true , address=77.90.31.14:4674 , piece_id=KUGSISFXDEFATV2BHKW34NREXENVYMNZRSM3VTXHCZOLBWYCO3IA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.580210843 (331h53m43.350852178s) [seg_pos={0 0}, upload=265483]: Segment reached optimal threshold of 14 pieces.
Jul 7 05:04:08.580342875 (331h53m43.35098421s) [noise=true , address=77.90.31.21:4903 , piece_id=JWQTRU7GLKHFXFBV2KYINTA2SEAUNDWTXER2XLNYIBXNC3KWF5ZA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZYWQ1a2sTKnFpF28iQVrem2s8nSpXkeJzZDaS7jvTZNANdfp): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580430292 (331h53m43.351071627s) [noise=true , address=45.91.116.9:4264 , piece_id=BAUPMJNTKX5S6NGVZYISJH5EJIVMVICZP4PNUKM6D525UNKAJBUA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128f6i7ALVXF3Vr8G8zsZXrNBFiT3cK8UAiic5XbFS1gRjZK86m): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580552847 (331h53m43.351194172s) [noise=true , address=77.90.31.17:4801 , piece_id=DHPU2ISCQWL6TOZQED7BG6JJ5DYRJW5FAYO4MGLB3KEOLVNC3CFA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127QRLNwZLcR5gnAgZrCjSUsH5T4jESmZ4kWeAnpj9YxaTSjoYe): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580638251 (331h53m43.351279586s) [noise=true , address=104.36.82.5:4855 , piece_id=5JPBSZRWWMGKSECM2XBHVQUT3F4U7JXCVXFKYKEJD27W3C5PCWNQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection; write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection
Jul 7 05:04:08.580668078 (331h53m43.351309413s) [seg_pos={0 0}, upload=265483]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 7 05:04:08.580803337 (331h53m43.351444672s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:04:08.580809508 (331h53m43.351450843s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:04:08.869629195 (331h53m43.64027053s) [upload=265483]: Done uploading segments...
Jul 7 05:04:08.869647730 (331h53m43.640289065s) [upload=265483]: Upload finished. err: <nil>
Duration: 5.652312695s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
5.561257328s
FAIL (2025-07-07 05:09:26 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
65483]: Got next segment. Inline: false
Jul 7 05:04:06.097422800 (331h53m40.868064135s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:04:06.097428120 (331h53m40.868069445s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:04:06.623732228 (331h53m41.394373563s) [seg_pos={0 0}, upload=265483]: Begin upload segment...
Jul 7 05:04:06.623774189 (331h53m41.394415524s) [seg_pos={0 0}, upload=265483]: Done begin upload segment.
Jul 7 05:04:06.623795539 (331h53m41.394436874s) [noise=true , address=77.90.31.14:4674 , piece_id=KUGSISFXDEFATV2BHKW34NREXENVYMNZRSM3VTXHCZOLBWYCO3IA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.623850364 (331h53m41.394491699s) [noise=true , address=77.90.31.17:4801 , piece_id=DHPU2ISCQWL6TOZQED7BG6JJ5DYRJW5FAYO4MGLB3KEOLVNC3CFA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624347755 (331h53m41.39498909s) [noise=true , address=77.90.31.16:4751 , piece_id=DQNZ6VYCO2WPLAT7CGMQOTIRXLLJTYRCUCVLI3RJZCYUZT3F6YXQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624383835 (331h53m41.39502517s) [noise=true , address=104.36.82.14:4248 , piece_id=GQVC4QYUSXVHM3WZ3OT7XSB42HEOEWHYVBMVGQVSMDFINDON6BSA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624634515 (331h53m41.39527585s) [noise=true , address=45.91.116.9:4264 , piece_id=BAUPMJNTKX5S6NGVZYISJH5EJIVMVICZP4PNUKM6D525UNKAJBUA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624844035 (331h53m41.39548537s) [noise=true , address=104.36.82.45:4927 , piece_id=6ZFIELGIKBDL2IKSE7EQP25Z7HPBP4GRSF5Y2YXUWZX54RV3ZAFA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624903259 (331h53m41.395544594s) [noise=true , address=104.36.82.18:4397 , piece_id=VF4FXOENNLGT3N7ZJ3T7EPYEW6H3YS4ZKHHQJSNLJYOCMGFXVZDQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625117729 (331h53m41.395759064s) [noise=true , address=64.49.13.27:4966 , piece_id=HPG7X2LX5N5CJHAQAWM6JKYHAOPOWRPUXEVWT4SDGYJKPKN2TRKA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625170019 (331h53m41.395811354s) [noise=true , address=104.36.82.5:4855 , piece_id=5JPBSZRWWMGKSECM2XBHVQUT3F4U7JXCVXFKYKEJD27W3C5PCWNQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625343822 (331h53m41.395985157s) [noise=true , address=104.36.82.12:4173 , piece_id=5HUGZCEFE3JCGN4PUHPP4IGVCRN2R4KHPIBQJUUTAEGOLDISXF4Q, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625394227 (331h53m41.396035563s) [noise=true , address=64.49.13.154:4932 , piece_id=4CXUMWUQ37E5ATJKWKIABQKZID2G5PRB563D3LAQTIWCZOLYI76Q, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625563120 (331h53m41.396204456s) [noise=true , address=104.36.82.3:4773 , piece_id=I2XCDVOZ5RWEMWJCBM5FATOKDCUZJFC7G2KTFILU66LJU7NLC5RQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625612635 (331h53m41.39625397s) [noise=true , address=64.49.13.140:4510 , piece_id=SUB4NNB6ZG7TGV76LBI37SUS4FYVH2LBU4DXHPRESLBDDHZHHEPA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625788693 (331h53m41.396430028s) [noise=true , address=77.90.31.16:4748 , piece_id=DRUW5HWKQF3LY5AXUQBD4MC2K2TMHJHXBDOP5DRL5WCSIV6KZDHA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625854649 (331h53m41.396495984s) [noise=true , address=104.36.82.21:4479 , piece_id=56PCCZDSZH545QXGLGRZN2IUDPIF6MTHKAULXZYVAV6BOAE632YQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626075631 (331h53m41.396716966s) [noise=true , address=77.90.31.10:4540 , piece_id=3MKHY4HDZSK5YOPP5HYVMEOWWEGDCJUPYEUW2TFPOSATOT2FMWQA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626273520 (331h53m41.396914855s) [noise=true , address=104.36.82.23:4470 , piece_id=Y3NJ45DLDTZSHKMHTANQ6VTL3BX46Y2LD2QGBK5S5SLAFDJBGPSQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626467301 (331h53m41.397108636s) [noise=true , address=77.90.31.21:4903 , piece_id=JWQTRU7GLKHFXFBV2KYINTA2SEAUNDWTXER2XLNYIBXNC3KWF5ZA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:07.724567296 (331h53m42.495208631s) [upload=265483]: Next returned nil segment
Jul 7 05:04:07.724584218 (331h53m42.495225543s) [upload=265483]: Waiting for error group managing segments...
Jul 7 05:04:08.028542246 (331h53m42.799183581s) [noise=true , address=64.49.13.27:4966 , piece_id=HPG7X2LX5N5CJHAQAWM6JKYHAOPOWRPUXEVWT4SDGYJKPKN2TRKA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.070346103 (331h53m42.840987438s) [noise=true , address=64.49.13.140:4510 , piece_id=SUB4NNB6ZG7TGV76LBI37SUS4FYVH2LBU4DXHPRESLBDDHZHHEPA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.095032022 (331h53m42.865673367s) [noise=true , address=64.49.13.154:4932 , piece_id=4CXUMWUQ37E5ATJKWKIABQKZID2G5PRB563D3LAQTIWCZOLYI76Q, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.428652819 (331h53m43.199294155s) [noise=true , address=104.36.82.18:4397 , piece_id=VF4FXOENNLGT3N7ZJ3T7EPYEW6H3YS4ZKHHQJSNLJYOCMGFXVZDQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.448309175 (331h53m43.21895051s) [noise=true , address=104.36.82.3:4773 , piece_id=I2XCDVOZ5RWEMWJCBM5FATOKDCUZJFC7G2KTFILU66LJU7NLC5RQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.460440203 (331h53m43.231081538s) [noise=true , address=104.36.82.45:4927 , piece_id=6ZFIELGIKBDL2IKSE7EQP25Z7HPBP4GRSF5Y2YXUWZX54RV3ZAFA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.462441062 (331h53m43.233082407s) [noise=true , address=104.36.82.21:4479 , piece_id=56PCCZDSZH545QXGLGRZN2IUDPIF6MTHKAULXZYVAV6BOAE632YQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.479297731 (331h53m43.249939056s) [noise=true , address=104.36.82.23:4470 , piece_id=Y3NJ45DLDTZSHKMHTANQ6VTL3BX46Y2LD2QGBK5S5SLAFDJBGPSQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.505733477 (331h53m43.276374812s) [noise=true , address=104.36.82.12:4173 , piece_id=5HUGZCEFE3JCGN4PUHPP4IGVCRN2R4KHPIBQJUUTAEGOLDISXF4Q, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.574289655 (331h53m43.34493099s) [noise=true , address=104.36.82.14:4248 , piece_id=GQVC4QYUSXVHM3WZ3OT7XSB42HEOEWHYVBMVGQVSMDFINDON6BSA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.577275016 (331h53m43.347916351s) [noise=true , address=77.90.31.10:4540 , piece_id=3MKHY4HDZSK5YOPP5HYVMEOWWEGDCJUPYEUW2TFPOSATOT2FMWQA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.577418831 (331h53m43.348060166s) [noise=true , address=77.90.31.16:4751 , piece_id=DQNZ6VYCO2WPLAT7CGMQOTIRXLLJTYRCUCVLI3RJZCYUZT3F6YXQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.579017850 (331h53m43.349659185s) [noise=true , address=77.90.31.16:4748 , piece_id=DRUW5HWKQF3LY5AXUQBD4MC2K2TMHJHXBDOP5DRL5WCSIV6KZDHA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.580192378 (331h53m43.350833713s) [noise=true , address=77.90.31.14:4674 , piece_id=KUGSISFXDEFATV2BHKW34NREXENVYMNZRSM3VTXHCZOLBWYCO3IA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.580210843 (331h53m43.350852178s) [seg_pos={0 0}, upload=265483]: Segment reached optimal threshold of 14 pieces.
Jul 7 05:04:08.580342875 (331h53m43.35098421s) [noise=true , address=77.90.31.21:4903 , piece_id=JWQTRU7GLKHFXFBV2KYINTA2SEAUNDWTXER2XLNYIBXNC3KWF5ZA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZYWQ1a2sTKnFpF28iQVrem2s8nSpXkeJzZDaS7jvTZNANdfp): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580430292 (331h53m43.351071627s) [noise=true , address=45.91.116.9:4264 , piece_id=BAUPMJNTKX5S6NGVZYISJH5EJIVMVICZP4PNUKM6D525UNKAJBUA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128f6i7ALVXF3Vr8G8zsZXrNBFiT3cK8UAiic5XbFS1gRjZK86m): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580552847 (331h53m43.351194172s) [noise=true , address=77.90.31.17:4801 , piece_id=DHPU2ISCQWL6TOZQED7BG6JJ5DYRJW5FAYO4MGLB3KEOLVNC3CFA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127QRLNwZLcR5gnAgZrCjSUsH5T4jESmZ4kWeAnpj9YxaTSjoYe): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580638251 (331h53m43.351279586s) [noise=true , address=104.36.82.5:4855 , piece_id=5JPBSZRWWMGKSECM2XBHVQUT3F4U7JXCVXFKYKEJD27W3C5PCWNQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection; write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection
Jul 7 05:04:08.580668078 (331h53m43.351309413s) [seg_pos={0 0}, upload=265483]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 7 05:04:08.580803337 (331h53m43.351444672s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:04:08.580809508 (331h53m43.351450843s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:04:08.869629195 (331h53m43.64027053s) [upload=265483]: Done uploading segments...
Jul 7 05:04:08.869647730 (331h53m43.640289065s) [upload=265483]: Upload finished. err: <nil>
Duration: 5.561281394s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
5.666884338s
FAIL (2025-07-07 05:08:56 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
65483]: Got next segment. Inline: false
Jul 7 05:04:06.097422800 (331h53m40.868064135s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:04:06.097428120 (331h53m40.868069445s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:04:06.623732228 (331h53m41.394373563s) [seg_pos={0 0}, upload=265483]: Begin upload segment...
Jul 7 05:04:06.623774189 (331h53m41.394415524s) [seg_pos={0 0}, upload=265483]: Done begin upload segment.
Jul 7 05:04:06.623795539 (331h53m41.394436874s) [noise=true , address=77.90.31.14:4674 , piece_id=KUGSISFXDEFATV2BHKW34NREXENVYMNZRSM3VTXHCZOLBWYCO3IA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.623850364 (331h53m41.394491699s) [noise=true , address=77.90.31.17:4801 , piece_id=DHPU2ISCQWL6TOZQED7BG6JJ5DYRJW5FAYO4MGLB3KEOLVNC3CFA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624347755 (331h53m41.39498909s) [noise=true , address=77.90.31.16:4751 , piece_id=DQNZ6VYCO2WPLAT7CGMQOTIRXLLJTYRCUCVLI3RJZCYUZT3F6YXQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624383835 (331h53m41.39502517s) [noise=true , address=104.36.82.14:4248 , piece_id=GQVC4QYUSXVHM3WZ3OT7XSB42HEOEWHYVBMVGQVSMDFINDON6BSA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624634515 (331h53m41.39527585s) [noise=true , address=45.91.116.9:4264 , piece_id=BAUPMJNTKX5S6NGVZYISJH5EJIVMVICZP4PNUKM6D525UNKAJBUA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624844035 (331h53m41.39548537s) [noise=true , address=104.36.82.45:4927 , piece_id=6ZFIELGIKBDL2IKSE7EQP25Z7HPBP4GRSF5Y2YXUWZX54RV3ZAFA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624903259 (331h53m41.395544594s) [noise=true , address=104.36.82.18:4397 , piece_id=VF4FXOENNLGT3N7ZJ3T7EPYEW6H3YS4ZKHHQJSNLJYOCMGFXVZDQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625117729 (331h53m41.395759064s) [noise=true , address=64.49.13.27:4966 , piece_id=HPG7X2LX5N5CJHAQAWM6JKYHAOPOWRPUXEVWT4SDGYJKPKN2TRKA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625170019 (331h53m41.395811354s) [noise=true , address=104.36.82.5:4855 , piece_id=5JPBSZRWWMGKSECM2XBHVQUT3F4U7JXCVXFKYKEJD27W3C5PCWNQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625343822 (331h53m41.395985157s) [noise=true , address=104.36.82.12:4173 , piece_id=5HUGZCEFE3JCGN4PUHPP4IGVCRN2R4KHPIBQJUUTAEGOLDISXF4Q, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625394227 (331h53m41.396035563s) [noise=true , address=64.49.13.154:4932 , piece_id=4CXUMWUQ37E5ATJKWKIABQKZID2G5PRB563D3LAQTIWCZOLYI76Q, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625563120 (331h53m41.396204456s) [noise=true , address=104.36.82.3:4773 , piece_id=I2XCDVOZ5RWEMWJCBM5FATOKDCUZJFC7G2KTFILU66LJU7NLC5RQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625612635 (331h53m41.39625397s) [noise=true , address=64.49.13.140:4510 , piece_id=SUB4NNB6ZG7TGV76LBI37SUS4FYVH2LBU4DXHPRESLBDDHZHHEPA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625788693 (331h53m41.396430028s) [noise=true , address=77.90.31.16:4748 , piece_id=DRUW5HWKQF3LY5AXUQBD4MC2K2TMHJHXBDOP5DRL5WCSIV6KZDHA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625854649 (331h53m41.396495984s) [noise=true , address=104.36.82.21:4479 , piece_id=56PCCZDSZH545QXGLGRZN2IUDPIF6MTHKAULXZYVAV6BOAE632YQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626075631 (331h53m41.396716966s) [noise=true , address=77.90.31.10:4540 , piece_id=3MKHY4HDZSK5YOPP5HYVMEOWWEGDCJUPYEUW2TFPOSATOT2FMWQA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626273520 (331h53m41.396914855s) [noise=true , address=104.36.82.23:4470 , piece_id=Y3NJ45DLDTZSHKMHTANQ6VTL3BX46Y2LD2QGBK5S5SLAFDJBGPSQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626467301 (331h53m41.397108636s) [noise=true , address=77.90.31.21:4903 , piece_id=JWQTRU7GLKHFXFBV2KYINTA2SEAUNDWTXER2XLNYIBXNC3KWF5ZA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:07.724567296 (331h53m42.495208631s) [upload=265483]: Next returned nil segment
Jul 7 05:04:07.724584218 (331h53m42.495225543s) [upload=265483]: Waiting for error group managing segments...
Jul 7 05:04:08.028542246 (331h53m42.799183581s) [noise=true , address=64.49.13.27:4966 , piece_id=HPG7X2LX5N5CJHAQAWM6JKYHAOPOWRPUXEVWT4SDGYJKPKN2TRKA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.070346103 (331h53m42.840987438s) [noise=true , address=64.49.13.140:4510 , piece_id=SUB4NNB6ZG7TGV76LBI37SUS4FYVH2LBU4DXHPRESLBDDHZHHEPA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.095032022 (331h53m42.865673367s) [noise=true , address=64.49.13.154:4932 , piece_id=4CXUMWUQ37E5ATJKWKIABQKZID2G5PRB563D3LAQTIWCZOLYI76Q, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.428652819 (331h53m43.199294155s) [noise=true , address=104.36.82.18:4397 , piece_id=VF4FXOENNLGT3N7ZJ3T7EPYEW6H3YS4ZKHHQJSNLJYOCMGFXVZDQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.448309175 (331h53m43.21895051s) [noise=true , address=104.36.82.3:4773 , piece_id=I2XCDVOZ5RWEMWJCBM5FATOKDCUZJFC7G2KTFILU66LJU7NLC5RQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.460440203 (331h53m43.231081538s) [noise=true , address=104.36.82.45:4927 , piece_id=6ZFIELGIKBDL2IKSE7EQP25Z7HPBP4GRSF5Y2YXUWZX54RV3ZAFA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.462441062 (331h53m43.233082407s) [noise=true , address=104.36.82.21:4479 , piece_id=56PCCZDSZH545QXGLGRZN2IUDPIF6MTHKAULXZYVAV6BOAE632YQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.479297731 (331h53m43.249939056s) [noise=true , address=104.36.82.23:4470 , piece_id=Y3NJ45DLDTZSHKMHTANQ6VTL3BX46Y2LD2QGBK5S5SLAFDJBGPSQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.505733477 (331h53m43.276374812s) [noise=true , address=104.36.82.12:4173 , piece_id=5HUGZCEFE3JCGN4PUHPP4IGVCRN2R4KHPIBQJUUTAEGOLDISXF4Q, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.574289655 (331h53m43.34493099s) [noise=true , address=104.36.82.14:4248 , piece_id=GQVC4QYUSXVHM3WZ3OT7XSB42HEOEWHYVBMVGQVSMDFINDON6BSA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.577275016 (331h53m43.347916351s) [noise=true , address=77.90.31.10:4540 , piece_id=3MKHY4HDZSK5YOPP5HYVMEOWWEGDCJUPYEUW2TFPOSATOT2FMWQA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.577418831 (331h53m43.348060166s) [noise=true , address=77.90.31.16:4751 , piece_id=DQNZ6VYCO2WPLAT7CGMQOTIRXLLJTYRCUCVLI3RJZCYUZT3F6YXQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.579017850 (331h53m43.349659185s) [noise=true , address=77.90.31.16:4748 , piece_id=DRUW5HWKQF3LY5AXUQBD4MC2K2TMHJHXBDOP5DRL5WCSIV6KZDHA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.580192378 (331h53m43.350833713s) [noise=true , address=77.90.31.14:4674 , piece_id=KUGSISFXDEFATV2BHKW34NREXENVYMNZRSM3VTXHCZOLBWYCO3IA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.580210843 (331h53m43.350852178s) [seg_pos={0 0}, upload=265483]: Segment reached optimal threshold of 14 pieces.
Jul 7 05:04:08.580342875 (331h53m43.35098421s) [noise=true , address=77.90.31.21:4903 , piece_id=JWQTRU7GLKHFXFBV2KYINTA2SEAUNDWTXER2XLNYIBXNC3KWF5ZA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZYWQ1a2sTKnFpF28iQVrem2s8nSpXkeJzZDaS7jvTZNANdfp): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580430292 (331h53m43.351071627s) [noise=true , address=45.91.116.9:4264 , piece_id=BAUPMJNTKX5S6NGVZYISJH5EJIVMVICZP4PNUKM6D525UNKAJBUA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128f6i7ALVXF3Vr8G8zsZXrNBFiT3cK8UAiic5XbFS1gRjZK86m): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580552847 (331h53m43.351194172s) [noise=true , address=77.90.31.17:4801 , piece_id=DHPU2ISCQWL6TOZQED7BG6JJ5DYRJW5FAYO4MGLB3KEOLVNC3CFA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127QRLNwZLcR5gnAgZrCjSUsH5T4jESmZ4kWeAnpj9YxaTSjoYe): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580638251 (331h53m43.351279586s) [noise=true , address=104.36.82.5:4855 , piece_id=5JPBSZRWWMGKSECM2XBHVQUT3F4U7JXCVXFKYKEJD27W3C5PCWNQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection; write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection
Jul 7 05:04:08.580668078 (331h53m43.351309413s) [seg_pos={0 0}, upload=265483]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 7 05:04:08.580803337 (331h53m43.351444672s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:04:08.580809508 (331h53m43.351450843s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:04:08.869629195 (331h53m43.64027053s) [upload=265483]: Done uploading segments...
Jul 7 05:04:08.869647730 (331h53m43.640289065s) [upload=265483]: Upload finished. err: <nil>
Duration: 5.666908964s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
5.73771225s
FAIL (2025-07-07 05:08:22 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
65483]: Got next segment. Inline: false
Jul 7 05:04:06.097422800 (331h53m40.868064135s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:04:06.097428120 (331h53m40.868069445s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:04:06.623732228 (331h53m41.394373563s) [seg_pos={0 0}, upload=265483]: Begin upload segment...
Jul 7 05:04:06.623774189 (331h53m41.394415524s) [seg_pos={0 0}, upload=265483]: Done begin upload segment.
Jul 7 05:04:06.623795539 (331h53m41.394436874s) [noise=true , address=77.90.31.14:4674 , piece_id=KUGSISFXDEFATV2BHKW34NREXENVYMNZRSM3VTXHCZOLBWYCO3IA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.623850364 (331h53m41.394491699s) [noise=true , address=77.90.31.17:4801 , piece_id=DHPU2ISCQWL6TOZQED7BG6JJ5DYRJW5FAYO4MGLB3KEOLVNC3CFA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624347755 (331h53m41.39498909s) [noise=true , address=77.90.31.16:4751 , piece_id=DQNZ6VYCO2WPLAT7CGMQOTIRXLLJTYRCUCVLI3RJZCYUZT3F6YXQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624383835 (331h53m41.39502517s) [noise=true , address=104.36.82.14:4248 , piece_id=GQVC4QYUSXVHM3WZ3OT7XSB42HEOEWHYVBMVGQVSMDFINDON6BSA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624634515 (331h53m41.39527585s) [noise=true , address=45.91.116.9:4264 , piece_id=BAUPMJNTKX5S6NGVZYISJH5EJIVMVICZP4PNUKM6D525UNKAJBUA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624844035 (331h53m41.39548537s) [noise=true , address=104.36.82.45:4927 , piece_id=6ZFIELGIKBDL2IKSE7EQP25Z7HPBP4GRSF5Y2YXUWZX54RV3ZAFA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624903259 (331h53m41.395544594s) [noise=true , address=104.36.82.18:4397 , piece_id=VF4FXOENNLGT3N7ZJ3T7EPYEW6H3YS4ZKHHQJSNLJYOCMGFXVZDQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625117729 (331h53m41.395759064s) [noise=true , address=64.49.13.27:4966 , piece_id=HPG7X2LX5N5CJHAQAWM6JKYHAOPOWRPUXEVWT4SDGYJKPKN2TRKA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625170019 (331h53m41.395811354s) [noise=true , address=104.36.82.5:4855 , piece_id=5JPBSZRWWMGKSECM2XBHVQUT3F4U7JXCVXFKYKEJD27W3C5PCWNQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625343822 (331h53m41.395985157s) [noise=true , address=104.36.82.12:4173 , piece_id=5HUGZCEFE3JCGN4PUHPP4IGVCRN2R4KHPIBQJUUTAEGOLDISXF4Q, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625394227 (331h53m41.396035563s) [noise=true , address=64.49.13.154:4932 , piece_id=4CXUMWUQ37E5ATJKWKIABQKZID2G5PRB563D3LAQTIWCZOLYI76Q, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625563120 (331h53m41.396204456s) [noise=true , address=104.36.82.3:4773 , piece_id=I2XCDVOZ5RWEMWJCBM5FATOKDCUZJFC7G2KTFILU66LJU7NLC5RQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625612635 (331h53m41.39625397s) [noise=true , address=64.49.13.140:4510 , piece_id=SUB4NNB6ZG7TGV76LBI37SUS4FYVH2LBU4DXHPRESLBDDHZHHEPA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625788693 (331h53m41.396430028s) [noise=true , address=77.90.31.16:4748 , piece_id=DRUW5HWKQF3LY5AXUQBD4MC2K2TMHJHXBDOP5DRL5WCSIV6KZDHA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625854649 (331h53m41.396495984s) [noise=true , address=104.36.82.21:4479 , piece_id=56PCCZDSZH545QXGLGRZN2IUDPIF6MTHKAULXZYVAV6BOAE632YQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626075631 (331h53m41.396716966s) [noise=true , address=77.90.31.10:4540 , piece_id=3MKHY4HDZSK5YOPP5HYVMEOWWEGDCJUPYEUW2TFPOSATOT2FMWQA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626273520 (331h53m41.396914855s) [noise=true , address=104.36.82.23:4470 , piece_id=Y3NJ45DLDTZSHKMHTANQ6VTL3BX46Y2LD2QGBK5S5SLAFDJBGPSQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626467301 (331h53m41.397108636s) [noise=true , address=77.90.31.21:4903 , piece_id=JWQTRU7GLKHFXFBV2KYINTA2SEAUNDWTXER2XLNYIBXNC3KWF5ZA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:07.724567296 (331h53m42.495208631s) [upload=265483]: Next returned nil segment
Jul 7 05:04:07.724584218 (331h53m42.495225543s) [upload=265483]: Waiting for error group managing segments...
Jul 7 05:04:08.028542246 (331h53m42.799183581s) [noise=true , address=64.49.13.27:4966 , piece_id=HPG7X2LX5N5CJHAQAWM6JKYHAOPOWRPUXEVWT4SDGYJKPKN2TRKA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.070346103 (331h53m42.840987438s) [noise=true , address=64.49.13.140:4510 , piece_id=SUB4NNB6ZG7TGV76LBI37SUS4FYVH2LBU4DXHPRESLBDDHZHHEPA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.095032022 (331h53m42.865673367s) [noise=true , address=64.49.13.154:4932 , piece_id=4CXUMWUQ37E5ATJKWKIABQKZID2G5PRB563D3LAQTIWCZOLYI76Q, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.428652819 (331h53m43.199294155s) [noise=true , address=104.36.82.18:4397 , piece_id=VF4FXOENNLGT3N7ZJ3T7EPYEW6H3YS4ZKHHQJSNLJYOCMGFXVZDQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.448309175 (331h53m43.21895051s) [noise=true , address=104.36.82.3:4773 , piece_id=I2XCDVOZ5RWEMWJCBM5FATOKDCUZJFC7G2KTFILU66LJU7NLC5RQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.460440203 (331h53m43.231081538s) [noise=true , address=104.36.82.45:4927 , piece_id=6ZFIELGIKBDL2IKSE7EQP25Z7HPBP4GRSF5Y2YXUWZX54RV3ZAFA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.462441062 (331h53m43.233082407s) [noise=true , address=104.36.82.21:4479 , piece_id=56PCCZDSZH545QXGLGRZN2IUDPIF6MTHKAULXZYVAV6BOAE632YQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.479297731 (331h53m43.249939056s) [noise=true , address=104.36.82.23:4470 , piece_id=Y3NJ45DLDTZSHKMHTANQ6VTL3BX46Y2LD2QGBK5S5SLAFDJBGPSQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.505733477 (331h53m43.276374812s) [noise=true , address=104.36.82.12:4173 , piece_id=5HUGZCEFE3JCGN4PUHPP4IGVCRN2R4KHPIBQJUUTAEGOLDISXF4Q, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.574289655 (331h53m43.34493099s) [noise=true , address=104.36.82.14:4248 , piece_id=GQVC4QYUSXVHM3WZ3OT7XSB42HEOEWHYVBMVGQVSMDFINDON6BSA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.577275016 (331h53m43.347916351s) [noise=true , address=77.90.31.10:4540 , piece_id=3MKHY4HDZSK5YOPP5HYVMEOWWEGDCJUPYEUW2TFPOSATOT2FMWQA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.577418831 (331h53m43.348060166s) [noise=true , address=77.90.31.16:4751 , piece_id=DQNZ6VYCO2WPLAT7CGMQOTIRXLLJTYRCUCVLI3RJZCYUZT3F6YXQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.579017850 (331h53m43.349659185s) [noise=true , address=77.90.31.16:4748 , piece_id=DRUW5HWKQF3LY5AXUQBD4MC2K2TMHJHXBDOP5DRL5WCSIV6KZDHA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.580192378 (331h53m43.350833713s) [noise=true , address=77.90.31.14:4674 , piece_id=KUGSISFXDEFATV2BHKW34NREXENVYMNZRSM3VTXHCZOLBWYCO3IA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.580210843 (331h53m43.350852178s) [seg_pos={0 0}, upload=265483]: Segment reached optimal threshold of 14 pieces.
Jul 7 05:04:08.580342875 (331h53m43.35098421s) [noise=true , address=77.90.31.21:4903 , piece_id=JWQTRU7GLKHFXFBV2KYINTA2SEAUNDWTXER2XLNYIBXNC3KWF5ZA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZYWQ1a2sTKnFpF28iQVrem2s8nSpXkeJzZDaS7jvTZNANdfp): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580430292 (331h53m43.351071627s) [noise=true , address=45.91.116.9:4264 , piece_id=BAUPMJNTKX5S6NGVZYISJH5EJIVMVICZP4PNUKM6D525UNKAJBUA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128f6i7ALVXF3Vr8G8zsZXrNBFiT3cK8UAiic5XbFS1gRjZK86m): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580552847 (331h53m43.351194172s) [noise=true , address=77.90.31.17:4801 , piece_id=DHPU2ISCQWL6TOZQED7BG6JJ5DYRJW5FAYO4MGLB3KEOLVNC3CFA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127QRLNwZLcR5gnAgZrCjSUsH5T4jESmZ4kWeAnpj9YxaTSjoYe): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580638251 (331h53m43.351279586s) [noise=true , address=104.36.82.5:4855 , piece_id=5JPBSZRWWMGKSECM2XBHVQUT3F4U7JXCVXFKYKEJD27W3C5PCWNQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection; write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection
Jul 7 05:04:08.580668078 (331h53m43.351309413s) [seg_pos={0 0}, upload=265483]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 7 05:04:08.580803337 (331h53m43.351444672s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:04:08.580809508 (331h53m43.351450843s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:04:08.869629195 (331h53m43.64027053s) [upload=265483]: Done uploading segments...
Jul 7 05:04:08.869647730 (331h53m43.640289065s) [upload=265483]: Upload finished. err: <nil>
Duration: 5.737736588s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
5.678600862s
FAIL (2025-07-07 05:07:10 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
65483]: Got next segment. Inline: false
Jul 7 05:04:06.097422800 (331h53m40.868064135s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:04:06.097428120 (331h53m40.868069445s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:04:06.623732228 (331h53m41.394373563s) [seg_pos={0 0}, upload=265483]: Begin upload segment...
Jul 7 05:04:06.623774189 (331h53m41.394415524s) [seg_pos={0 0}, upload=265483]: Done begin upload segment.
Jul 7 05:04:06.623795539 (331h53m41.394436874s) [noise=true , address=77.90.31.14:4674 , piece_id=KUGSISFXDEFATV2BHKW34NREXENVYMNZRSM3VTXHCZOLBWYCO3IA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.623850364 (331h53m41.394491699s) [noise=true , address=77.90.31.17:4801 , piece_id=DHPU2ISCQWL6TOZQED7BG6JJ5DYRJW5FAYO4MGLB3KEOLVNC3CFA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624347755 (331h53m41.39498909s) [noise=true , address=77.90.31.16:4751 , piece_id=DQNZ6VYCO2WPLAT7CGMQOTIRXLLJTYRCUCVLI3RJZCYUZT3F6YXQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624383835 (331h53m41.39502517s) [noise=true , address=104.36.82.14:4248 , piece_id=GQVC4QYUSXVHM3WZ3OT7XSB42HEOEWHYVBMVGQVSMDFINDON6BSA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624634515 (331h53m41.39527585s) [noise=true , address=45.91.116.9:4264 , piece_id=BAUPMJNTKX5S6NGVZYISJH5EJIVMVICZP4PNUKM6D525UNKAJBUA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624844035 (331h53m41.39548537s) [noise=true , address=104.36.82.45:4927 , piece_id=6ZFIELGIKBDL2IKSE7EQP25Z7HPBP4GRSF5Y2YXUWZX54RV3ZAFA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624903259 (331h53m41.395544594s) [noise=true , address=104.36.82.18:4397 , piece_id=VF4FXOENNLGT3N7ZJ3T7EPYEW6H3YS4ZKHHQJSNLJYOCMGFXVZDQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625117729 (331h53m41.395759064s) [noise=true , address=64.49.13.27:4966 , piece_id=HPG7X2LX5N5CJHAQAWM6JKYHAOPOWRPUXEVWT4SDGYJKPKN2TRKA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625170019 (331h53m41.395811354s) [noise=true , address=104.36.82.5:4855 , piece_id=5JPBSZRWWMGKSECM2XBHVQUT3F4U7JXCVXFKYKEJD27W3C5PCWNQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625343822 (331h53m41.395985157s) [noise=true , address=104.36.82.12:4173 , piece_id=5HUGZCEFE3JCGN4PUHPP4IGVCRN2R4KHPIBQJUUTAEGOLDISXF4Q, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625394227 (331h53m41.396035563s) [noise=true , address=64.49.13.154:4932 , piece_id=4CXUMWUQ37E5ATJKWKIABQKZID2G5PRB563D3LAQTIWCZOLYI76Q, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625563120 (331h53m41.396204456s) [noise=true , address=104.36.82.3:4773 , piece_id=I2XCDVOZ5RWEMWJCBM5FATOKDCUZJFC7G2KTFILU66LJU7NLC5RQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625612635 (331h53m41.39625397s) [noise=true , address=64.49.13.140:4510 , piece_id=SUB4NNB6ZG7TGV76LBI37SUS4FYVH2LBU4DXHPRESLBDDHZHHEPA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625788693 (331h53m41.396430028s) [noise=true , address=77.90.31.16:4748 , piece_id=DRUW5HWKQF3LY5AXUQBD4MC2K2TMHJHXBDOP5DRL5WCSIV6KZDHA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625854649 (331h53m41.396495984s) [noise=true , address=104.36.82.21:4479 , piece_id=56PCCZDSZH545QXGLGRZN2IUDPIF6MTHKAULXZYVAV6BOAE632YQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626075631 (331h53m41.396716966s) [noise=true , address=77.90.31.10:4540 , piece_id=3MKHY4HDZSK5YOPP5HYVMEOWWEGDCJUPYEUW2TFPOSATOT2FMWQA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626273520 (331h53m41.396914855s) [noise=true , address=104.36.82.23:4470 , piece_id=Y3NJ45DLDTZSHKMHTANQ6VTL3BX46Y2LD2QGBK5S5SLAFDJBGPSQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626467301 (331h53m41.397108636s) [noise=true , address=77.90.31.21:4903 , piece_id=JWQTRU7GLKHFXFBV2KYINTA2SEAUNDWTXER2XLNYIBXNC3KWF5ZA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:07.724567296 (331h53m42.495208631s) [upload=265483]: Next returned nil segment
Jul 7 05:04:07.724584218 (331h53m42.495225543s) [upload=265483]: Waiting for error group managing segments...
Jul 7 05:04:08.028542246 (331h53m42.799183581s) [noise=true , address=64.49.13.27:4966 , piece_id=HPG7X2LX5N5CJHAQAWM6JKYHAOPOWRPUXEVWT4SDGYJKPKN2TRKA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.070346103 (331h53m42.840987438s) [noise=true , address=64.49.13.140:4510 , piece_id=SUB4NNB6ZG7TGV76LBI37SUS4FYVH2LBU4DXHPRESLBDDHZHHEPA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.095032022 (331h53m42.865673367s) [noise=true , address=64.49.13.154:4932 , piece_id=4CXUMWUQ37E5ATJKWKIABQKZID2G5PRB563D3LAQTIWCZOLYI76Q, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.428652819 (331h53m43.199294155s) [noise=true , address=104.36.82.18:4397 , piece_id=VF4FXOENNLGT3N7ZJ3T7EPYEW6H3YS4ZKHHQJSNLJYOCMGFXVZDQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.448309175 (331h53m43.21895051s) [noise=true , address=104.36.82.3:4773 , piece_id=I2XCDVOZ5RWEMWJCBM5FATOKDCUZJFC7G2KTFILU66LJU7NLC5RQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.460440203 (331h53m43.231081538s) [noise=true , address=104.36.82.45:4927 , piece_id=6ZFIELGIKBDL2IKSE7EQP25Z7HPBP4GRSF5Y2YXUWZX54RV3ZAFA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.462441062 (331h53m43.233082407s) [noise=true , address=104.36.82.21:4479 , piece_id=56PCCZDSZH545QXGLGRZN2IUDPIF6MTHKAULXZYVAV6BOAE632YQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.479297731 (331h53m43.249939056s) [noise=true , address=104.36.82.23:4470 , piece_id=Y3NJ45DLDTZSHKMHTANQ6VTL3BX46Y2LD2QGBK5S5SLAFDJBGPSQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.505733477 (331h53m43.276374812s) [noise=true , address=104.36.82.12:4173 , piece_id=5HUGZCEFE3JCGN4PUHPP4IGVCRN2R4KHPIBQJUUTAEGOLDISXF4Q, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.574289655 (331h53m43.34493099s) [noise=true , address=104.36.82.14:4248 , piece_id=GQVC4QYUSXVHM3WZ3OT7XSB42HEOEWHYVBMVGQVSMDFINDON6BSA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.577275016 (331h53m43.347916351s) [noise=true , address=77.90.31.10:4540 , piece_id=3MKHY4HDZSK5YOPP5HYVMEOWWEGDCJUPYEUW2TFPOSATOT2FMWQA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.577418831 (331h53m43.348060166s) [noise=true , address=77.90.31.16:4751 , piece_id=DQNZ6VYCO2WPLAT7CGMQOTIRXLLJTYRCUCVLI3RJZCYUZT3F6YXQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.579017850 (331h53m43.349659185s) [noise=true , address=77.90.31.16:4748 , piece_id=DRUW5HWKQF3LY5AXUQBD4MC2K2TMHJHXBDOP5DRL5WCSIV6KZDHA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.580192378 (331h53m43.350833713s) [noise=true , address=77.90.31.14:4674 , piece_id=KUGSISFXDEFATV2BHKW34NREXENVYMNZRSM3VTXHCZOLBWYCO3IA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.580210843 (331h53m43.350852178s) [seg_pos={0 0}, upload=265483]: Segment reached optimal threshold of 14 pieces.
Jul 7 05:04:08.580342875 (331h53m43.35098421s) [noise=true , address=77.90.31.21:4903 , piece_id=JWQTRU7GLKHFXFBV2KYINTA2SEAUNDWTXER2XLNYIBXNC3KWF5ZA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZYWQ1a2sTKnFpF28iQVrem2s8nSpXkeJzZDaS7jvTZNANdfp): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580430292 (331h53m43.351071627s) [noise=true , address=45.91.116.9:4264 , piece_id=BAUPMJNTKX5S6NGVZYISJH5EJIVMVICZP4PNUKM6D525UNKAJBUA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128f6i7ALVXF3Vr8G8zsZXrNBFiT3cK8UAiic5XbFS1gRjZK86m): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580552847 (331h53m43.351194172s) [noise=true , address=77.90.31.17:4801 , piece_id=DHPU2ISCQWL6TOZQED7BG6JJ5DYRJW5FAYO4MGLB3KEOLVNC3CFA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127QRLNwZLcR5gnAgZrCjSUsH5T4jESmZ4kWeAnpj9YxaTSjoYe): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580638251 (331h53m43.351279586s) [noise=true , address=104.36.82.5:4855 , piece_id=5JPBSZRWWMGKSECM2XBHVQUT3F4U7JXCVXFKYKEJD27W3C5PCWNQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection; write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection
Jul 7 05:04:08.580668078 (331h53m43.351309413s) [seg_pos={0 0}, upload=265483]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 7 05:04:08.580803337 (331h53m43.351444672s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:04:08.580809508 (331h53m43.351450843s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:04:08.869629195 (331h53m43.64027053s) [upload=265483]: Done uploading segments...
Jul 7 05:04:08.869647730 (331h53m43.640289065s) [upload=265483]: Upload finished. err: <nil>
Duration: 5.678638925s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
5.930377118s
FAIL (2025-07-07 05:05:57 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
65483]: Got next segment. Inline: false
Jul 7 05:04:06.097422800 (331h53m40.868064135s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:04:06.097428120 (331h53m40.868069445s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:04:06.623732228 (331h53m41.394373563s) [seg_pos={0 0}, upload=265483]: Begin upload segment...
Jul 7 05:04:06.623774189 (331h53m41.394415524s) [seg_pos={0 0}, upload=265483]: Done begin upload segment.
Jul 7 05:04:06.623795539 (331h53m41.394436874s) [noise=true , address=77.90.31.14:4674 , piece_id=KUGSISFXDEFATV2BHKW34NREXENVYMNZRSM3VTXHCZOLBWYCO3IA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.623850364 (331h53m41.394491699s) [noise=true , address=77.90.31.17:4801 , piece_id=DHPU2ISCQWL6TOZQED7BG6JJ5DYRJW5FAYO4MGLB3KEOLVNC3CFA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624347755 (331h53m41.39498909s) [noise=true , address=77.90.31.16:4751 , piece_id=DQNZ6VYCO2WPLAT7CGMQOTIRXLLJTYRCUCVLI3RJZCYUZT3F6YXQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624383835 (331h53m41.39502517s) [noise=true , address=104.36.82.14:4248 , piece_id=GQVC4QYUSXVHM3WZ3OT7XSB42HEOEWHYVBMVGQVSMDFINDON6BSA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624634515 (331h53m41.39527585s) [noise=true , address=45.91.116.9:4264 , piece_id=BAUPMJNTKX5S6NGVZYISJH5EJIVMVICZP4PNUKM6D525UNKAJBUA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624844035 (331h53m41.39548537s) [noise=true , address=104.36.82.45:4927 , piece_id=6ZFIELGIKBDL2IKSE7EQP25Z7HPBP4GRSF5Y2YXUWZX54RV3ZAFA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.624903259 (331h53m41.395544594s) [noise=true , address=104.36.82.18:4397 , piece_id=VF4FXOENNLGT3N7ZJ3T7EPYEW6H3YS4ZKHHQJSNLJYOCMGFXVZDQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625117729 (331h53m41.395759064s) [noise=true , address=64.49.13.27:4966 , piece_id=HPG7X2LX5N5CJHAQAWM6JKYHAOPOWRPUXEVWT4SDGYJKPKN2TRKA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625170019 (331h53m41.395811354s) [noise=true , address=104.36.82.5:4855 , piece_id=5JPBSZRWWMGKSECM2XBHVQUT3F4U7JXCVXFKYKEJD27W3C5PCWNQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625343822 (331h53m41.395985157s) [noise=true , address=104.36.82.12:4173 , piece_id=5HUGZCEFE3JCGN4PUHPP4IGVCRN2R4KHPIBQJUUTAEGOLDISXF4Q, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625394227 (331h53m41.396035563s) [noise=true , address=64.49.13.154:4932 , piece_id=4CXUMWUQ37E5ATJKWKIABQKZID2G5PRB563D3LAQTIWCZOLYI76Q, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625563120 (331h53m41.396204456s) [noise=true , address=104.36.82.3:4773 , piece_id=I2XCDVOZ5RWEMWJCBM5FATOKDCUZJFC7G2KTFILU66LJU7NLC5RQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625612635 (331h53m41.39625397s) [noise=true , address=64.49.13.140:4510 , piece_id=SUB4NNB6ZG7TGV76LBI37SUS4FYVH2LBU4DXHPRESLBDDHZHHEPA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625788693 (331h53m41.396430028s) [noise=true , address=77.90.31.16:4748 , piece_id=DRUW5HWKQF3LY5AXUQBD4MC2K2TMHJHXBDOP5DRL5WCSIV6KZDHA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.625854649 (331h53m41.396495984s) [noise=true , address=104.36.82.21:4479 , piece_id=56PCCZDSZH545QXGLGRZN2IUDPIF6MTHKAULXZYVAV6BOAE632YQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626075631 (331h53m41.396716966s) [noise=true , address=77.90.31.10:4540 , piece_id=3MKHY4HDZSK5YOPP5HYVMEOWWEGDCJUPYEUW2TFPOSATOT2FMWQA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626273520 (331h53m41.396914855s) [noise=true , address=104.36.82.23:4470 , piece_id=Y3NJ45DLDTZSHKMHTANQ6VTL3BX46Y2LD2QGBK5S5SLAFDJBGPSQ, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:06.626467301 (331h53m41.397108636s) [noise=true , address=77.90.31.21:4903 , piece_id=JWQTRU7GLKHFXFBV2KYINTA2SEAUNDWTXER2XLNYIBXNC3KWF5ZA, seg_pos={0 0}, upload=265483]: Uploading piece...
Jul 7 05:04:07.724567296 (331h53m42.495208631s) [upload=265483]: Next returned nil segment
Jul 7 05:04:07.724584218 (331h53m42.495225543s) [upload=265483]: Waiting for error group managing segments...
Jul 7 05:04:08.028542246 (331h53m42.799183581s) [noise=true , address=64.49.13.27:4966 , piece_id=HPG7X2LX5N5CJHAQAWM6JKYHAOPOWRPUXEVWT4SDGYJKPKN2TRKA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.070346103 (331h53m42.840987438s) [noise=true , address=64.49.13.140:4510 , piece_id=SUB4NNB6ZG7TGV76LBI37SUS4FYVH2LBU4DXHPRESLBDDHZHHEPA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.095032022 (331h53m42.865673367s) [noise=true , address=64.49.13.154:4932 , piece_id=4CXUMWUQ37E5ATJKWKIABQKZID2G5PRB563D3LAQTIWCZOLYI76Q, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.428652819 (331h53m43.199294155s) [noise=true , address=104.36.82.18:4397 , piece_id=VF4FXOENNLGT3N7ZJ3T7EPYEW6H3YS4ZKHHQJSNLJYOCMGFXVZDQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.448309175 (331h53m43.21895051s) [noise=true , address=104.36.82.3:4773 , piece_id=I2XCDVOZ5RWEMWJCBM5FATOKDCUZJFC7G2KTFILU66LJU7NLC5RQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.460440203 (331h53m43.231081538s) [noise=true , address=104.36.82.45:4927 , piece_id=6ZFIELGIKBDL2IKSE7EQP25Z7HPBP4GRSF5Y2YXUWZX54RV3ZAFA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.462441062 (331h53m43.233082407s) [noise=true , address=104.36.82.21:4479 , piece_id=56PCCZDSZH545QXGLGRZN2IUDPIF6MTHKAULXZYVAV6BOAE632YQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.479297731 (331h53m43.249939056s) [noise=true , address=104.36.82.23:4470 , piece_id=Y3NJ45DLDTZSHKMHTANQ6VTL3BX46Y2LD2QGBK5S5SLAFDJBGPSQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.505733477 (331h53m43.276374812s) [noise=true , address=104.36.82.12:4173 , piece_id=5HUGZCEFE3JCGN4PUHPP4IGVCRN2R4KHPIBQJUUTAEGOLDISXF4Q, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.574289655 (331h53m43.34493099s) [noise=true , address=104.36.82.14:4248 , piece_id=GQVC4QYUSXVHM3WZ3OT7XSB42HEOEWHYVBMVGQVSMDFINDON6BSA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.577275016 (331h53m43.347916351s) [noise=true , address=77.90.31.10:4540 , piece_id=3MKHY4HDZSK5YOPP5HYVMEOWWEGDCJUPYEUW2TFPOSATOT2FMWQA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.577418831 (331h53m43.348060166s) [noise=true , address=77.90.31.16:4751 , piece_id=DQNZ6VYCO2WPLAT7CGMQOTIRXLLJTYRCUCVLI3RJZCYUZT3F6YXQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.579017850 (331h53m43.349659185s) [noise=true , address=77.90.31.16:4748 , piece_id=DRUW5HWKQF3LY5AXUQBD4MC2K2TMHJHXBDOP5DRL5WCSIV6KZDHA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.580192378 (331h53m43.350833713s) [noise=true , address=77.90.31.14:4674 , piece_id=KUGSISFXDEFATV2BHKW34NREXENVYMNZRSM3VTXHCZOLBWYCO3IA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: <nil>
Jul 7 05:04:08.580210843 (331h53m43.350852178s) [seg_pos={0 0}, upload=265483]: Segment reached optimal threshold of 14 pieces.
Jul 7 05:04:08.580342875 (331h53m43.35098421s) [noise=true , address=77.90.31.21:4903 , piece_id=JWQTRU7GLKHFXFBV2KYINTA2SEAUNDWTXER2XLNYIBXNC3KWF5ZA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZYWQ1a2sTKnFpF28iQVrem2s8nSpXkeJzZDaS7jvTZNANdfp): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580430292 (331h53m43.351071627s) [noise=true , address=45.91.116.9:4264 , piece_id=BAUPMJNTKX5S6NGVZYISJH5EJIVMVICZP4PNUKM6D525UNKAJBUA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128f6i7ALVXF3Vr8G8zsZXrNBFiT3cK8UAiic5XbFS1gRjZK86m): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580552847 (331h53m43.351194172s) [noise=true , address=77.90.31.17:4801 , piece_id=DHPU2ISCQWL6TOZQED7BG6JJ5DYRJW5FAYO4MGLB3KEOLVNC3CFA, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127QRLNwZLcR5gnAgZrCjSUsH5T4jESmZ4kWeAnpj9YxaTSjoYe): protocol: expected piece hash; context canceled; EOF
Jul 7 05:04:08.580638251 (331h53m43.351279586s) [noise=true , address=104.36.82.5:4855 , piece_id=5JPBSZRWWMGKSECM2XBHVQUT3F4U7JXCVXFKYKEJD27W3C5PCWNQ, seg_pos={0 0}, upload=265483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection; write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59012->104.36.82.5:4855: use of closed network connection
Jul 7 05:04:08.580668078 (331h53m43.351309413s) [seg_pos={0 0}, upload=265483]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 7 05:04:08.580803337 (331h53m43.351444672s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:04:08.580809508 (331h53m43.351450843s) [upload=265483]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:04:08.869629195 (331h53m43.64027053s) [upload=265483]: Done uploading segments...
Jul 7 05:04:08.869647730 (331h53m43.640289065s) [upload=265483]: Upload finished. err: <nil>
Duration: 5.930397868s
core
uplink
us-select-1
us1-placement-20
|