Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure

Orbiter Check History

Showing 50 of 835383 reports (Page 16464 of 16708)
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................]
duration:
5.832877222s
FAIL (2025-07-07 14:03:49 UTC)
orbiter warning: 
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul  7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul  7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul  7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul  7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul  7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul  7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul  7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul  7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul  7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul  7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul  7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul  7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul  7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul  7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.83291348s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................]
duration:
5.735901418s
FAIL (2025-07-07 14:02:39 UTC)
orbiter warning: 
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul  7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul  7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul  7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul  7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul  7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul  7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul  7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul  7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul  7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul  7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul  7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul  7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul  7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul  7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.735922599s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................]
duration:
5.729192459s
FAIL (2025-07-07 14:01:28 UTC)
orbiter warning: 
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul  7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul  7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul  7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul  7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul  7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul  7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul  7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul  7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul  7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul  7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul  7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul  7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul  7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul  7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.729217767s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................]
duration:
5.799305456s
FAIL (2025-07-07 14:00:58 UTC)
orbiter warning: 
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul  7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul  7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul  7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul  7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul  7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul  7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul  7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul  7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul  7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul  7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul  7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul  7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul  7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul  7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.799361944s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................]
duration:
5.723070918s
FAIL (2025-07-07 14:00:35 UTC)
orbiter warning: 
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul  7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul  7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul  7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul  7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul  7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul  7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul  7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul  7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul  7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul  7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul  7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul  7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul  7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul  7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.723097889s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................]
duration:
5.651276873s
FAIL (2025-07-07 14:00:02 UTC)
orbiter warning: 
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul  7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul  7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul  7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul  7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul  7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul  7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul  7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul  7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul  7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul  7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul  7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul  7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul  7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul  7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.651308373s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................]
duration:
5.619983733s
FAIL (2025-07-07 13:59:03 UTC)
orbiter warning: 
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul  7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul  7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul  7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul  7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul  7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul  7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul  7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul  7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul  7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul  7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul  7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul  7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul  7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul  7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.620012319s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................]
duration:
5.731866576s
FAIL (2025-07-07 13:57:58 UTC)
orbiter warning: 
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul  7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul  7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul  7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul  7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul  7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul  7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul  7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul  7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul  7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul  7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul  7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul  7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul  7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul  7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.731894469s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................]
duration:
5.653278122s
FAIL (2025-07-07 13:57:23 UTC)
orbiter warning: 
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul  7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul  7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul  7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul  7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul  7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul  7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul  7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul  7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul  7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul  7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul  7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul  7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul  7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul  7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.653313199s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................]
duration:
6.589440331s
FAIL (2025-07-07 13:56:48 UTC)
orbiter warning: 
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul  7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul  7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul  7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul  7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul  7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul  7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul  7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul  7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul  7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul  7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul  7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul  7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul  7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul  7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 6.589465268s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................]
duration:
5.603090125s
FAIL (2025-07-07 13:56:32 UTC)
orbiter warning: 
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul  7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul  7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul  7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul  7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul  7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul  7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul  7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul  7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul  7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul  7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul  7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul  7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul  7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul  7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.603116204s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................]
duration:
5.64891785s
FAIL (2025-07-07 13:55:52 UTC)
orbiter warning: 
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul  7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul  7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul  7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul  7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul  7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul  7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul  7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul  7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul  7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul  7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul  7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul  7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul  7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul  7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.648951573s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................]
duration:
5.6464411s
FAIL (2025-07-07 13:54:53 UTC)
orbiter warning: 
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul  7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul  7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul  7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul  7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul  7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul  7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul  7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul  7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul  7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul  7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul  7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul  7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul  7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul  7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.646466871s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................]
duration:
5.67416886s
FAIL (2025-07-07 13:54:35 UTC)
orbiter warning: 
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul  7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul  7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul  7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul  7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul  7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul  7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul  7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul  7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul  7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul  7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul  7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul  7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul  7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul  7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.674197404s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................]
duration:
5.765663905s
FAIL (2025-07-07 13:53:24 UTC)
orbiter warning: 
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul  7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul  7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul  7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul  7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul  7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul  7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul  7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul  7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul  7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul  7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul  7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul  7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul  7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul  7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.765689143s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................]
duration:
5.776589038s
FAIL (2025-07-07 13:52:27 UTC)
orbiter warning: 
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul  7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul  7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul  7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul  7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul  7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul  7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul  7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul  7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul  7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul  7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul  7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul  7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul  7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul  7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.776615608s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................]
duration:
5.918161269s
FAIL (2025-07-07 13:51:54 UTC)
orbiter warning: 
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul  7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul  7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul  7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul  7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul  7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul  7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul  7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul  7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul  7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul  7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul  7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul  7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul  7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul  7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.918212055s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................]
duration:
5.775965114s
FAIL (2025-07-07 13:51:34 UTC)
orbiter warning: 
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul  7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul  7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul  7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul  7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul  7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul  7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul  7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul  7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul  7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul  7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul  7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul  7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul  7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul  7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.775995993s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................]
duration:
5.621352954s
FAIL (2025-07-07 13:50:23 UTC)
orbiter warning: 
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul  7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul  7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul  7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul  7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul  7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul  7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul  7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul  7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul  7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul  7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul  7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul  7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul  7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul  7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.62138236s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................]
duration:
5.942899729s
FAIL (2025-07-07 13:49:14 UTC)
orbiter warning: 
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul  7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul  7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul  7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul  7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul  7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul  7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul  7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul  7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul  7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul  7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul  7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul  7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul  7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul  7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.942929606s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................]
duration:
5.686109317s
FAIL (2025-07-07 13:48:36 UTC)
orbiter warning: 
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul  7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul  7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul  7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul  7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul  7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul  7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul  7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul  7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul  7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul  7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul  7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul  7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul  7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul  7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.686136757s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................]
duration:
5.672828254s
FAIL (2025-07-07 13:47:31 UTC)
orbiter warning: 
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul  7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul  7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul  7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul  7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul  7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul  7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul  7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul  7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul  7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul  7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul  7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul  7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul  7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul  7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.672856017s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................]
duration:
5.715996413s
FAIL (2025-07-07 13:47:02 UTC)
orbiter warning: 
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul  7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul  7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul  7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul  7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul  7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul  7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul  7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul  7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul  7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul  7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul  7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul  7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul  7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul  7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.716037682s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................]
duration:
5.635164569s
FAIL (2025-07-07 13:45:47 UTC)
orbiter warning: 
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul  7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul  7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul  7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul  7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul  7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul  7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul  7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul  7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul  7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul  7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul  7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul  7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul  7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul  7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.635189196s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................]
duration:
5.898797912s
FAIL (2025-07-07 13:45:16 UTC)
orbiter warning: 
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul  7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul  7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul  7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul  7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul  7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul  7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul  7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul  7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul  7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul  7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul  7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul  7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul  7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul  7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.89882771s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................]
duration:
5.695326238s
FAIL (2025-07-07 13:44:06 UTC)
orbiter warning: 
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul  7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul  7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul  7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul  7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul  7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul  7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul  7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul  7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul  7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul  7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul  7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul  7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul  7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul  7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.69535388s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................]
duration:
5.94363352s
FAIL (2025-07-07 13:43:24 UTC)
orbiter warning: 
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul  7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul  7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul  7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul  7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul  7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul  7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul  7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul  7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul  7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul  7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul  7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul  7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul  7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul  7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.943661533s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................]
duration:
6.011193644s
FAIL (2025-07-07 13:42:24 UTC)
orbiter warning: 
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul  7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul  7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul  7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul  7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul  7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul  7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul  7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul  7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul  7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul  7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul  7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul  7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul  7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul  7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 6.011235375s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................]
duration:
5.793049919s
FAIL (2025-07-07 13:41:33 UTC)
orbiter warning: 
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul  7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul  7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul  7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul  7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul  7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul  7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul  7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul  7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul  7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul  7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul  7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul  7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul  7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul  7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.793087019s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................]
duration:
5.677259303s
FAIL (2025-07-07 13:41:16 UTC)
orbiter warning: 
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul  7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul  7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul  7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul  7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul  7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul  7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul  7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul  7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul  7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul  7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul  7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul  7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul  7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul  7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.677289511s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................]
duration:
5.609349938s
FAIL (2025-07-07 13:40:17 UTC)
orbiter warning: 
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul  7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul  7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul  7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul  7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul  7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul  7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul  7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul  7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul  7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul  7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul  7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul  7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul  7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul  7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.609372551s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................]
duration:
5.762263248s
FAIL (2025-07-07 13:39:33 UTC)
orbiter warning: 
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul  7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul  7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul  7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul  7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul  7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul  7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul  7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul  7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul  7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul  7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul  7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul  7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul  7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul  7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.762290752s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................]
duration:
5.655925637s
FAIL (2025-07-07 13:38:24 UTC)
orbiter warning: 
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul  7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul  7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul  7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul  7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul  7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul  7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul  7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul  7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul  7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul  7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul  7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul  7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul  7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul  7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.655956326s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................]
duration:
5.731591188s
FAIL (2025-07-07 13:37:36 UTC)
orbiter warning: 
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul  7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul  7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul  7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul  7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul  7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul  7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul  7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul  7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul  7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul  7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul  7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul  7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul  7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul  7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.731619001s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................]
duration:
5.896479737s
FAIL (2025-07-07 13:36:51 UTC)
orbiter warning: 
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul  7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul  7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul  7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul  7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul  7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul  7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul  7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul  7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul  7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul  7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul  7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul  7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul  7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul  7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.896502971s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................]
duration:
6.608302034s
FAIL (2025-07-07 13:35:43 UTC)
orbiter warning: 
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul  7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul  7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul  7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul  7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul  7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul  7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul  7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul  7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul  7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul  7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul  7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul  7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul  7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul  7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 6.608335818s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................]
duration:
5.712921079s
FAIL (2025-07-07 13:35:06 UTC)
orbiter warning: 
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul  7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul  7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul  7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul  7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul  7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul  7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul  7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul  7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul  7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul  7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul  7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul  7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul  7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul  7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.712949983s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................]
duration:
5.634974766s
FAIL (2025-07-07 13:34:20 UTC)
orbiter warning: 
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul  7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul  7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul  7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul  7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul  7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul  7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul  7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul  7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul  7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul  7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul  7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul  7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul  7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul  7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.635000917s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................]
duration:
5.989429847s
FAIL (2025-07-07 13:33:32 UTC)
orbiter warning: 
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul  7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul  7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul  7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul  7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul  7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul  7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul  7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul  7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul  7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul  7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul  7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul  7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul  7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul  7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.989456046s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............]
duration:
5.711622715s
FAIL (2025-07-07 13:32:25 UTC)
orbiter warning: 
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul  7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul  7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul  7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul  7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul  7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul  7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul  7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul  7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul  7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul  7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul  7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul  7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul  7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul  7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.711691557s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............]
duration:
5.732196726s
FAIL (2025-07-07 13:31:48 UTC)
orbiter warning: 
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul  7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul  7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul  7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul  7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul  7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul  7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul  7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul  7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul  7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul  7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul  7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul  7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul  7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul  7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.732217165s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............]
duration:
5.827092038s
FAIL (2025-07-07 13:31:01 UTC)
orbiter warning: 
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul  7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul  7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul  7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul  7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul  7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul  7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul  7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul  7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul  7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul  7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul  7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul  7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul  7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul  7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.827122265s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............]
duration:
5.624984279s
FAIL (2025-07-07 13:30:18 UTC)
orbiter warning: 
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul  7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul  7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul  7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul  7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul  7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul  7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul  7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul  7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul  7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul  7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul  7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul  7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul  7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul  7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.625003325s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........]
duration:
6.139072748s
FAIL (2025-07-07 13:29:31 UTC)
orbiter warning: 
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul  7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul  7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul  7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul  7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul  7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul  7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul  7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul  7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul  7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul  7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul  7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul  7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul  7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul  7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 6.139099739s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........]
duration:
5.983254862s
FAIL (2025-07-07 13:28:48 UTC)
orbiter warning: 
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul  7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul  7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul  7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul  7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul  7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul  7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul  7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul  7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul  7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul  7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul  7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul  7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul  7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul  7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.983297904s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........]
duration:
5.711310528s
FAIL (2025-07-07 13:27:45 UTC)
orbiter warning: 
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul  7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul  7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul  7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul  7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul  7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul  7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul  7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul  7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul  7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul  7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul  7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul  7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul  7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul  7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.711342259s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........]
duration:
6.041729514s
FAIL (2025-07-07 13:27:04 UTC)
orbiter warning: 
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul  7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul  7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul  7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul  7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul  7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul  7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul  7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul  7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul  7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul  7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul  7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul  7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul  7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul  7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 6.041755374s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......]
duration:
5.733533959s
FAIL (2025-07-07 13:26:42 UTC)
orbiter warning: 
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul  7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul  7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul  7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul  7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul  7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul  7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul  7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul  7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul  7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul  7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul  7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul  7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul  7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul  7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.733561732s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......]
duration:
5.694726746s
FAIL (2025-07-07 13:25:43 UTC)
orbiter warning: 
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul  7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul  7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul  7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul  7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul  7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul  7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul  7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul  7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul  7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul  7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul  7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul  7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul  7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul  7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.694750933s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....]
duration:
5.917631833s
FAIL (2025-07-07 13:25:18 UTC)
orbiter warning: 
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul  7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul  7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul  7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul  7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul  7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul  7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul  7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul  7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul  7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul  7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul  7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul  7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802     , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975     , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837     , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937     , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118    , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262     , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520     , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592     , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078    , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626     , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077    , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151    , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045     , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul  7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul  7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190    , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117    , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul  7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294    , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul  7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul  7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.917658333s core uplink us-select-1