Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
5.832877222s
FAIL (2025-07-07 14:03:49 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.83291348s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
5.735901418s
FAIL (2025-07-07 14:02:39 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.735922599s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
5.729192459s
FAIL (2025-07-07 14:01:28 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.729217767s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
5.799305456s
FAIL (2025-07-07 14:00:58 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.799361944s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
5.723070918s
FAIL (2025-07-07 14:00:35 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.723097889s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
5.651276873s
FAIL (2025-07-07 14:00:02 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.651308373s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
5.619983733s
FAIL (2025-07-07 13:59:03 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.620012319s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
5.731866576s
FAIL (2025-07-07 13:57:58 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.731894469s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
5.653278122s
FAIL (2025-07-07 13:57:23 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.653313199s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
6.589440331s
FAIL (2025-07-07 13:56:48 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 6.589465268s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
5.603090125s
FAIL (2025-07-07 13:56:32 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.603116204s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
5.64891785s
FAIL (2025-07-07 13:55:52 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.648951573s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
5.6464411s
FAIL (2025-07-07 13:54:53 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.646466871s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
5.67416886s
FAIL (2025-07-07 13:54:35 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.674197404s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
5.765663905s
FAIL (2025-07-07 13:53:24 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.765689143s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
5.776589038s
FAIL (2025-07-07 13:52:27 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.776615608s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
5.918161269s
FAIL (2025-07-07 13:51:54 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.918212055s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
5.775965114s
FAIL (2025-07-07 13:51:34 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.775995993s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
5.621352954s
FAIL (2025-07-07 13:50:23 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.62138236s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
5.942899729s
FAIL (2025-07-07 13:49:14 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.942929606s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
5.686109317s
FAIL (2025-07-07 13:48:36 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.686136757s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
5.672828254s
FAIL (2025-07-07 13:47:31 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.672856017s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
5.715996413s
FAIL (2025-07-07 13:47:02 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.716037682s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
5.635164569s
FAIL (2025-07-07 13:45:47 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.635189196s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
5.898797912s
FAIL (2025-07-07 13:45:16 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.89882771s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
5.695326238s
FAIL (2025-07-07 13:44:06 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.69535388s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
5.94363352s
FAIL (2025-07-07 13:43:24 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.943661533s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
6.011193644s
FAIL (2025-07-07 13:42:24 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 6.011235375s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
5.793049919s
FAIL (2025-07-07 13:41:33 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.793087019s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
5.677259303s
FAIL (2025-07-07 13:41:16 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.677289511s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
5.609349938s
FAIL (2025-07-07 13:40:17 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.609372551s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
5.762263248s
FAIL (2025-07-07 13:39:33 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.762290752s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
5.655925637s
FAIL (2025-07-07 13:38:24 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.655956326s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
5.731591188s
FAIL (2025-07-07 13:37:36 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.731619001s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
5.896479737s
FAIL (2025-07-07 13:36:51 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.896502971s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
6.608302034s
FAIL (2025-07-07 13:35:43 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 6.608335818s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
5.712921079s
FAIL (2025-07-07 13:35:06 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.712949983s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
5.634974766s
FAIL (2025-07-07 13:34:20 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.635000917s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
5.989429847s
FAIL (2025-07-07 13:33:32 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.989456046s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
5.711622715s
FAIL (2025-07-07 13:32:25 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.711691557s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
5.732196726s
FAIL (2025-07-07 13:31:48 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.732217165s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
5.827092038s
FAIL (2025-07-07 13:31:01 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.827122265s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
5.624984279s
FAIL (2025-07-07 13:30:18 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.625003325s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
6.139072748s
FAIL (2025-07-07 13:29:31 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 6.139099739s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
5.983254862s
FAIL (2025-07-07 13:28:48 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.983297904s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
5.711310528s
FAIL (2025-07-07 13:27:45 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.711342259s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
6.041729514s
FAIL (2025-07-07 13:27:04 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 6.041755374s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
5.733533959s
FAIL (2025-07-07 13:26:42 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.733561732s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
5.694726746s
FAIL (2025-07-07 13:25:43 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.694750933s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
5.917631833s
FAIL (2025-07-07 13:25:18 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection
Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments...
Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil>
Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload
Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload
Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments...
Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false
Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment...
Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment.
Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece...
Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment
Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments...
Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil>
Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces.
Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection
Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments...
Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil>
Duration: 5.917658333s
core
uplink
us-select-1
|