Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 6.011193644s FAIL (2025-07-07 13:42:24 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments... Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil> Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments... Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment... Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment. Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments... Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces. Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments... Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil> Duration: 6.011235375s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 5.793049919s FAIL (2025-07-07 13:41:33 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments... Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil> Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments... Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment... Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment. Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments... Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces. Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments... Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil> Duration: 5.793087019s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 5.677259303s FAIL (2025-07-07 13:41:16 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments... Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil> Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments... Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment... Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment. Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments... Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces. Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments... Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil> Duration: 5.677289511s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 5.609349938s FAIL (2025-07-07 13:40:17 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments... Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil> Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments... Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment... Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment. Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments... Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces. Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments... Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil> Duration: 5.609372551s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 5.762263248s FAIL (2025-07-07 13:39:33 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments... Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil> Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments... Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment... Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment. Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments... Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces. Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments... Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil> Duration: 5.762290752s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 5.655925637s FAIL (2025-07-07 13:38:24 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments... Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil> Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments... Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment... Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment. Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments... Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces. Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments... Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil> Duration: 5.655956326s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 5.731591188s FAIL (2025-07-07 13:37:36 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments... Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil> Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments... Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment... Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment. Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments... Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces. Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments... Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil> Duration: 5.731619001s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 5.896479737s FAIL (2025-07-07 13:36:51 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments... Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil> Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments... Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment... Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment. Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments... Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces. Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments... Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil> Duration: 5.896502971s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 6.608302034s FAIL (2025-07-07 13:35:43 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments... Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil> Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments... Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment... Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment. Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments... Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces. Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments... Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil> Duration: 6.608335818s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 5.712921079s FAIL (2025-07-07 13:35:06 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments... Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil> Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments... Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment... Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment. Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments... Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces. Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments... Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil> Duration: 5.712949983s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 5.634974766s FAIL (2025-07-07 13:34:20 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments... Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil> Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments... Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment... Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment. Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments... Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces. Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments... Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil> Duration: 5.635000917s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 5.989429847s FAIL (2025-07-07 13:33:32 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments... Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil> Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments... Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment... Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment. Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments... Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces. Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments... Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil> Duration: 5.989456046s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 5.711622715s FAIL (2025-07-07 13:32:25 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments... Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil> Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments... Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment... Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment. Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments... Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces. Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments... Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil> Duration: 5.711691557s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 5.732196726s FAIL (2025-07-07 13:31:48 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments... Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil> Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments... Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment... Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment. Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments... Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces. Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments... Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil> Duration: 5.732217165s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 5.827092038s FAIL (2025-07-07 13:31:01 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments... Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil> Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments... Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment... Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment. Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments... Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces. Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments... Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil> Duration: 5.827122265s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 5.624984279s FAIL (2025-07-07 13:30:18 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments... Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil> Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments... Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment... Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment. Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments... Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces. Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments... Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil> Duration: 5.625003325s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 6.139072748s FAIL (2025-07-07 13:29:31 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments... Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil> Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments... Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment... Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment. Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments... Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces. Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments... Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil> Duration: 6.139099739s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 5.983254862s FAIL (2025-07-07 13:28:48 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments... Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil> Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments... Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment... Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment. Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments... Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces. Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments... Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil> Duration: 5.983297904s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 5.711310528s FAIL (2025-07-07 13:27:45 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments... Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil> Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments... Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment... Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment. Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments... Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces. Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments... Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil> Duration: 5.711342259s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 6.041729514s FAIL (2025-07-07 13:27:04 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments... Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil> Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments... Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment... Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment. Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments... Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces. Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments... Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil> Duration: 6.041755374s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 5.733533959s FAIL (2025-07-07 13:26:42 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments... Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil> Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments... Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment... Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment. Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments... Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces. Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments... Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil> Duration: 5.733561732s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 5.694726746s FAIL (2025-07-07 13:25:43 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments... Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil> Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments... Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment... Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment. Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments... Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces. Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments... Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil> Duration: 5.694750933s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 5.917631833s FAIL (2025-07-07 13:25:18 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments... Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil> Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments... Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment... Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment. Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments... Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces. Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments... Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil> Duration: 5.917658333s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 5.700380724s FAIL (2025-07-07 13:24:17 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments... Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil> Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments... Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment... Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment. Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments... Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces. Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments... Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil> Duration: 5.700399401s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 5.776950772s FAIL (2025-07-07 13:23:41 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments... Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil> Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments... Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment... Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment. Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments... Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces. Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments... Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil> Duration: 5.776974498s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 6.044462281s FAIL (2025-07-07 13:23:13 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments... Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil> Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments... Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment... Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment. Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments... Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces. Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments... Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil> Duration: 6.044490385s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 5.684073979s FAIL (2025-07-07 13:22:13 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments... Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil> Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments... Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment... Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment. Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments... Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces. Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments... Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil> Duration: 5.684109105s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.001272638s FAIL (2025-07-07 13:21:34 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== losed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47112->104.36.82.14:4223: use of closed network connection Jul 7 13:19:57.653403028 (340h9m32.424044363s) [seg_pos={0 0}, upload=272080]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 13:19:57.653468573 (340h9m32.424109898s) [upload=272080]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 13:19:57.653472801 (340h9m32.424114136s) [upload=272080]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 13:19:57.938428780 (340h9m32.709070145s) [upload=272080]: Done uploading segments... Jul 7 13:19:57.938448978 (340h9m32.709090314s) [upload=272080]: Upload finished. err: <nil> Jul 7 13:21:04.711723045 (340h10m39.48236438s) [upload=272095]: Starting upload Jul 7 13:21:04.711775796 (340h10m39.482417121s) [upload=272095]: Done starting upload Jul 7 13:21:04.711896967 (340h10m39.482538352s) [upload=272095]: Uploading segments... Jul 7 13:21:04.712010555 (340h10m39.48265193s) [upload=272095]: Got next segment. Inline: false Jul 7 13:21:04.712048047 (340h10m39.482689382s) [upload=272095]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 7 13:21:04.712052916 (340h10m39.482694251s) [upload=272095]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 7 13:21:04.944434214 (340h10m39.715075549s) [seg_pos={0 0}, upload=272095]: Begin upload segment... Jul 7 13:21:04.944475994 (340h10m39.715117319s) [seg_pos={0 0}, upload=272095]: Done begin upload segment. Jul 7 13:21:04.944498366 (340h10m39.715139701s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944523414 (340h10m39.715164739s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944872953 (340h10m39.715514348s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.944923690 (340h10m39.715565025s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945179620 (340h10m39.715820955s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945373140 (340h10m39.716014475s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945435048 (340h10m39.716076383s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945661351 (340h10m39.716302686s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.945994148 (340h10m39.716635473s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946228987 (340h10m39.716870322s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946437957 (340h10m39.717079292s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946631286 (340h10m39.717272621s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.946852740 (340h10m39.717494065s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947059105 (340h10m39.71770044s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947246544 (340h10m39.717887879s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:04.947430155 (340h10m39.71807149s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Uploading piece... Jul 7 13:21:06.666674639 (340h10m41.437315974s) [upload=272095]: Next returned nil segment Jul 7 13:21:06.666698525 (340h10m41.43733986s) [upload=272095]: Waiting for error group managing segments... Jul 7 13:21:06.976910302 (340h10m41.747551637s) [noise=true , address=104.36.82.4:4802 , piece_id=PARSI7RUK5R6V53FR5ZXPKOV7DQLPHCFXF75RR224TFDBKZ2S7TQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.005513123 (340h10m41.776154468s) [noise=true , address=45.91.116.6:4975 , piece_id=XL2OVJ32IZX4VWITDIAXT3TWS4LKFGUXHDQAVSG6FI25QSCAN3AA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.006167966 (340h10m41.776809311s) [noise=true , address=104.36.82.5:4837 , piece_id=M7YZGQT3DFSASVGGQM3E4CJGR42SVBXH6UQCTYW4L3G45B62VGZQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.010679647 (340h10m41.781320982s) [noise=true , address=45.91.116.4:4937 , piece_id=ZUBRNJSQHSGVNPWXDVVFQ43V5R4C73TKPTQ4FSWU5ERFP4WP7AAA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.010762425 (340h10m41.78140376s) [noise=true , address=45.91.116.11:4118 , piece_id=YBCOQK6WZJEVHIHKV5QCD2B5HJYWESZ47R6YHNBFVNIVH2TPIA6A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.014159835 (340h10m41.78480117s) [noise=true , address=45.91.116.9:4262 , piece_id=AINVRUZMJYN2Z62IC3XPTY6NSQ7746UEI7ZBMWRXNG7JBILK57JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.029413739 (340h10m41.800055074s) [noise=true , address=77.90.31.10:4520 , piece_id=KCRPG25TWMFRPHQM4OJPHI6BFBNZ2JYUWL2RM3D6HT4ALVQDPL5Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.035911500 (340h10m41.806552835s) [noise=true , address=77.90.31.12:4592 , piece_id=ML2M4DWWTZ32HDWLTGPODEVAI4KF5HBACO54W2W47FM5KEIDYHKQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.036808555 (340h10m41.80744989s) [noise=true , address=104.36.82.10:4078 , piece_id=YG27CWQRVD562ZY2GQT4EESIL32PVQHWK5L5BYMFNXHEZG2U6M5A, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.044594992 (340h10m41.815236317s) [noise=true , address=77.90.31.13:4626 , piece_id=43HS2SOHBJKPYOSNOJY66N2PGKW7E7CWH572CC4UXQUUGQHCJQIA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.056730609 (340h10m41.827371944s) [noise=true , address=104.36.82.10:4077 , piece_id=ZN2XDEUTQK7P5UNVQTUTZT7U43RL7AKLXWZTOICI6PH3QUZ6U37Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.075573948 (340h10m41.846215283s) [noise=true , address=104.36.82.12:4151 , piece_id=GKKX6NBBS7ZMEDOMPGCDQJCC22KES7CGZWOEAN7B3DPBX4I2QS4Q, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.081904160 (340h10m41.852545495s) [noise=true , address=45.91.116.8:4045 , piece_id=UMZ3GMVK7U2BXPQFER7CXQ5IV7OQ7VG57DYYP6KKDKA6MCSKSAIQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: <nil> Jul 7 13:21:07.081927854 (340h10m41.852569189s) [seg_pos={0 0}, upload=272095]: Segment reached optimal threshold of 13 pieces. Jul 7 13:21:07.082035350 (340h10m41.852676725s) [noise=true , address=45.91.116.14:4190 , piece_id=B7OLTHW72OPGNZ3ULPLVK4B3KVXZNTWE7YCTMHSJ5YTU7YMXFRGQ, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Jul 7 13:21:07.082181320 (340h10m41.852822695s) [noise=true , address=45.91.116.11:4117 , piece_id=NZ3WOUQEHTYUDDUVAPCSZAWOP2P7BUHXLS335SCNLP6CBF2K77QA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59636->45.91.116.11:4117: use of closed network connection Jul 7 13:21:07.082199594 (340h10m41.852840919s) [noise=true , address=104.36.82.16:4294 , piece_id=SD44Q6ZG7ZEH4G6REPK6Q6T7OALHNZFLVAXZH2NJPCOUZNTNT7JA, seg_pos={0 0}, upload=272095]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Jul 7 13:21:07.082250081 (340h10m41.852891416s) [seg_pos={0 0}, upload=272095]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 13:21:07.082345142 (340h10m41.852986477s) [upload=272095]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 13:21:07.082349842 (340h10m41.852991167s) [upload=272095]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 13:21:07.517932539 (340h10m42.288573874s) [upload=272095]: Done uploading segments... Jul 7 13:21:07.517950624 (340h10m42.288591959s) [upload=272095]: Upload finished. err: <nil> Duration: 30.001293316s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 5.670699979s FAIL (2025-07-07 12:46:06 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece_id=76E2UENIVWN6TTA3YD57X6CPVI366A2SNYQX6HTSGVLG6M4CCAZA, seg_pos={0 0}, upload=271062]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Jul 7 12:01:23.222432903 (338h50m57.993074238s) [noise=true , address=104.36.82.10:4078 , piece_id=RHOTQBNCH5MUDYCPQ37YGYX5BZNHTMO6BH43VCNYORRRU75RTWWQ, seg_pos={0 0}, upload=271062]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF Jul 7 12:01:23.222453401 (338h50m57.993094736s) [seg_pos={0 0}, upload=271062]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 12:01:23.222512745 (338h50m57.993154081s) [upload=271062]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 12:01:23.222516733 (338h50m57.993158068s) [upload=271062]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 12:01:23.524023810 (338h50m58.294665165s) [upload=271062]: Done uploading segments... Jul 7 12:01:23.524047065 (338h50m58.29468841s) [upload=271062]: Upload finished. err: <nil> Jul 7 12:01:59.027955412 (338h51m33.798596747s) [upload=271070]: Starting upload Jul 7 12:01:59.028075351 (338h51m33.798716696s) [upload=271070]: Done starting upload Jul 7 12:01:59.028139976 (338h51m33.798781311s) [upload=271070]: Uploading segments... Jul 7 12:01:59.028299931 (338h51m33.798941266s) [upload=271070]: Got next segment. Inline: false Jul 7 12:01:59.028416515 (338h51m33.79905785s) [upload=271070]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 7 12:01:59.028422416 (338h51m33.799063761s) [upload=271070]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 7 12:01:59.261880873 (338h51m34.032522218s) [seg_pos={0 0}, upload=271070]: Begin upload segment... Jul 7 12:01:59.261985924 (338h51m34.03262726s) [noise=true , address=104.36.82.9:4005 , piece_id=TZ43ZHEMJNM6P4IPJMMARHLKEX2FHTBIEFBY43IB6AAAEJMDCQNA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262067471 (338h51m34.032708816s) [noise=true , address=77.90.31.10:4517 , piece_id=3YDX4SEJC372T64RTATEJFPBJBNOVGWE5QME2L6N2MWVWUN2P7ZQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262498215 (338h51m34.03313955s) [noise=true , address=104.36.82.15:4258 , piece_id=G7UJATYPZXGE7AA2EVASTD2QXUW2F5J3N2UXSEZF23ZF5GWQJMKQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262520607 (338h51m34.033161952s) [noise=true , address=104.36.82.15:4259 , piece_id=MYFFPHWVFEKH6PPXJB5BYJZUCHPGIBOHTM6BNN4U3WGXVIHOD4YA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262795914 (338h51m34.033437249s) [seg_pos={0 0}, upload=271070]: Done begin upload segment. Jul 7 12:01:59.262857242 (338h51m34.033498577s) [noise=true , address=45.91.116.11:4118 , piece_id=OH3XLDA6VDWB66QSJ7R3Y5TTMNARBDXS7MPLFDFKNSP7QZX76EGQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.263419457 (338h51m34.034060792s) [noise=true , address=104.36.82.10:4077 , piece_id=ZPX674LYZ7BTO2MV7T2SXNMYXLDZJ7BC64DG2XDIFJTVYMTBFRGQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.263698150 (338h51m34.034339485s) [noise=true , address=104.36.82.3:4767 , piece_id=C5FKFSEABS2TO7GGPXU4J44NHKHYP7KFJZA6HNHHOETWQ6PODG4Q, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264015678 (338h51m34.034657013s) [noise=true , address=77.90.31.18:4807 , piece_id=JSZN5WN4HQN2JGFIJYMVFPDELMH67OU2UBGBWN7EYZ723NRNGX2Q, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264312575 (338h51m34.03495391s) [noise=true , address=104.36.82.12:4150 , piece_id=JVWXXQE2KUCN7TAEJPMXNJ53EASYQSF7BDLET74FKJ42U4O54HLQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264672153 (338h51m34.035313488s) [noise=true , address=104.36.82.16:4294 , piece_id=CNFTWMXOAONQYFMJVQAYU4FQ6ZCYNVKHBXKJASI3KN7GDJOVSZ6Q, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264999710 (338h51m34.035641045s) [noise=true , address=77.90.31.13:4626 , piece_id=FMDUEB4OUQSGOWWO4LL6XIGKZFKU6ZFJDY7UJPTPRBU57OZIPXSA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.265238698 (338h51m34.035880053s) [noise=true , address=104.36.82.11:4113 , piece_id=TRHOT32ONTK5AHYGBOKUWOPSLJSOEZHWM7I2BEF35B6I2CK62TKA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.265691123 (338h51m34.036332468s) [noise=true , address=104.36.82.14:4223 , piece_id=4SKO77JRLCKZIJOA2S2ED3DHHDX4N6POWUIMJSOQNJQRP5SBRP2A, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.266330596 (338h51m34.036971931s) [noise=true , address=77.90.31.12:4592 , piece_id=3K4UALXEA6HXATI7MAEK3TF2BSKRS4FTORIKFQUWALIENJ7ROGZA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.266671569 (338h51m34.037312914s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXAIRV6KPBEKHHT2WHTV7RFBZZX2M42BSDX34IICONNVFD2H4MPA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.267012862 (338h51m34.037654207s) [noise=true , address=45.91.116.9:4262 , piece_id=NPP4NPDONFYKTDJQKC5XPJPNEKKLYRAPHPNE2WKI3KOKG3VJWEKA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:02:00.922180841 (338h51m35.692822176s) [upload=271070]: Next returned nil segment Jul 7 12:02:00.922208914 (338h51m35.692850249s) [upload=271070]: Waiting for error group managing segments... Jul 7 12:02:01.187253453 (338h51m35.957894788s) [noise=true , address=104.36.82.15:4259 , piece_id=MYFFPHWVFEKH6PPXJB5BYJZUCHPGIBOHTM6BNN4U3WGXVIHOD4YA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.251407842 (338h51m36.022049177s) [noise=true , address=104.36.82.15:4258 , piece_id=G7UJATYPZXGE7AA2EVASTD2QXUW2F5J3N2UXSEZF23ZF5GWQJMKQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.260774924 (338h51m36.031416259s) [noise=true , address=104.36.82.9:4005 , piece_id=TZ43ZHEMJNM6P4IPJMMARHLKEX2FHTBIEFBY43IB6AAAEJMDCQNA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.275440331 (338h51m36.046081666s) [noise=true , address=104.36.82.3:4767 , piece_id=C5FKFSEABS2TO7GGPXU4J44NHKHYP7KFJZA6HNHHOETWQ6PODG4Q, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.292891458 (338h51m36.063532813s) [noise=true , address=104.36.82.10:4077 , piece_id=ZPX674LYZ7BTO2MV7T2SXNMYXLDZJ7BC64DG2XDIFJTVYMTBFRGQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.294071356 (338h51m36.064712701s) [noise=true , address=104.36.82.16:4294 , piece_id=CNFTWMXOAONQYFMJVQAYU4FQ6ZCYNVKHBXKJASI3KN7GDJOVSZ6Q, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.310479056 (338h51m36.081120391s) [noise=true , address=104.36.82.12:4150 , piece_id=JVWXXQE2KUCN7TAEJPMXNJ53EASYQSF7BDLET74FKJ42U4O54HLQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.319958452 (338h51m36.090599787s) [noise=true , address=104.36.82.11:4113 , piece_id=TRHOT32ONTK5AHYGBOKUWOPSLJSOEZHWM7I2BEF35B6I2CK62TKA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.345635898 (338h51m36.116277243s) [noise=true , address=45.91.116.11:4118 , piece_id=OH3XLDA6VDWB66QSJ7R3Y5TTMNARBDXS7MPLFDFKNSP7QZX76EGQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.348221234 (338h51m36.118862569s) [noise=true , address=45.91.116.9:4262 , piece_id=NPP4NPDONFYKTDJQKC5XPJPNEKKLYRAPHPNE2WKI3KOKG3VJWEKA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.379148724 (338h51m36.149790069s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXAIRV6KPBEKHHT2WHTV7RFBZZX2M42BSDX34IICONNVFD2H4MPA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.379665763 (338h51m36.150307098s) [noise=true , address=77.90.31.10:4517 , piece_id=3YDX4SEJC372T64RTATEJFPBJBNOVGWE5QME2L6N2MWVWUN2P7ZQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.383550435 (338h51m36.15419178s) [noise=true , address=77.90.31.13:4626 , piece_id=FMDUEB4OUQSGOWWO4LL6XIGKZFKU6ZFJDY7UJPTPRBU57OZIPXSA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.383582847 (338h51m36.154224182s) [seg_pos={0 0}, upload=271070]: Segment reached optimal threshold of 13 pieces. Jul 7 12:02:01.383717544 (338h51m36.15435888s) [noise=true , address=77.90.31.12:4592 , piece_id=3K4UALXEA6HXATI7MAEK3TF2BSKRS4FTORIKFQUWALIENJ7ROGZA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Jul 7 12:02:01.385367622 (338h51m36.156008967s) [noise=true , address=77.90.31.18:4807 , piece_id=JSZN5WN4HQN2JGFIJYMVFPDELMH67OU2UBGBWN7EYZ723NRNGX2Q, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.385867197 (338h51m36.156508542s) [noise=true , address=104.36.82.14:4223 , piece_id=4SKO77JRLCKZIJOA2S2ED3DHHDX4N6POWUIMJSOQNJQRP5SBRP2A, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.386478106 (338h51m36.157119451s) [seg_pos={0 0}, upload=271070]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jul 7 12:02:01.386554532 (338h51m36.157195867s) [upload=271070]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 12:02:01.386559752 (338h51m36.157201097s) [upload=271070]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 12:03:12.051066824 (338h52m46.821708159s) [upload=271070]: Done uploading segments... Jul 7 12:03:12.051087384 (338h52m46.821728719s) [upload=271070]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.670727232s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 5.946039569s FAIL (2025-07-07 12:45:25 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece_id=76E2UENIVWN6TTA3YD57X6CPVI366A2SNYQX6HTSGVLG6M4CCAZA, seg_pos={0 0}, upload=271062]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Jul 7 12:01:23.222432903 (338h50m57.993074238s) [noise=true , address=104.36.82.10:4078 , piece_id=RHOTQBNCH5MUDYCPQ37YGYX5BZNHTMO6BH43VCNYORRRU75RTWWQ, seg_pos={0 0}, upload=271062]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF Jul 7 12:01:23.222453401 (338h50m57.993094736s) [seg_pos={0 0}, upload=271062]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 12:01:23.222512745 (338h50m57.993154081s) [upload=271062]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 12:01:23.222516733 (338h50m57.993158068s) [upload=271062]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 12:01:23.524023810 (338h50m58.294665165s) [upload=271062]: Done uploading segments... Jul 7 12:01:23.524047065 (338h50m58.29468841s) [upload=271062]: Upload finished. err: <nil> Jul 7 12:01:59.027955412 (338h51m33.798596747s) [upload=271070]: Starting upload Jul 7 12:01:59.028075351 (338h51m33.798716696s) [upload=271070]: Done starting upload Jul 7 12:01:59.028139976 (338h51m33.798781311s) [upload=271070]: Uploading segments... Jul 7 12:01:59.028299931 (338h51m33.798941266s) [upload=271070]: Got next segment. Inline: false Jul 7 12:01:59.028416515 (338h51m33.79905785s) [upload=271070]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 7 12:01:59.028422416 (338h51m33.799063761s) [upload=271070]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 7 12:01:59.261880873 (338h51m34.032522218s) [seg_pos={0 0}, upload=271070]: Begin upload segment... Jul 7 12:01:59.261985924 (338h51m34.03262726s) [noise=true , address=104.36.82.9:4005 , piece_id=TZ43ZHEMJNM6P4IPJMMARHLKEX2FHTBIEFBY43IB6AAAEJMDCQNA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262067471 (338h51m34.032708816s) [noise=true , address=77.90.31.10:4517 , piece_id=3YDX4SEJC372T64RTATEJFPBJBNOVGWE5QME2L6N2MWVWUN2P7ZQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262498215 (338h51m34.03313955s) [noise=true , address=104.36.82.15:4258 , piece_id=G7UJATYPZXGE7AA2EVASTD2QXUW2F5J3N2UXSEZF23ZF5GWQJMKQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262520607 (338h51m34.033161952s) [noise=true , address=104.36.82.15:4259 , piece_id=MYFFPHWVFEKH6PPXJB5BYJZUCHPGIBOHTM6BNN4U3WGXVIHOD4YA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262795914 (338h51m34.033437249s) [seg_pos={0 0}, upload=271070]: Done begin upload segment. Jul 7 12:01:59.262857242 (338h51m34.033498577s) [noise=true , address=45.91.116.11:4118 , piece_id=OH3XLDA6VDWB66QSJ7R3Y5TTMNARBDXS7MPLFDFKNSP7QZX76EGQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.263419457 (338h51m34.034060792s) [noise=true , address=104.36.82.10:4077 , piece_id=ZPX674LYZ7BTO2MV7T2SXNMYXLDZJ7BC64DG2XDIFJTVYMTBFRGQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.263698150 (338h51m34.034339485s) [noise=true , address=104.36.82.3:4767 , piece_id=C5FKFSEABS2TO7GGPXU4J44NHKHYP7KFJZA6HNHHOETWQ6PODG4Q, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264015678 (338h51m34.034657013s) [noise=true , address=77.90.31.18:4807 , piece_id=JSZN5WN4HQN2JGFIJYMVFPDELMH67OU2UBGBWN7EYZ723NRNGX2Q, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264312575 (338h51m34.03495391s) [noise=true , address=104.36.82.12:4150 , piece_id=JVWXXQE2KUCN7TAEJPMXNJ53EASYQSF7BDLET74FKJ42U4O54HLQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264672153 (338h51m34.035313488s) [noise=true , address=104.36.82.16:4294 , piece_id=CNFTWMXOAONQYFMJVQAYU4FQ6ZCYNVKHBXKJASI3KN7GDJOVSZ6Q, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264999710 (338h51m34.035641045s) [noise=true , address=77.90.31.13:4626 , piece_id=FMDUEB4OUQSGOWWO4LL6XIGKZFKU6ZFJDY7UJPTPRBU57OZIPXSA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.265238698 (338h51m34.035880053s) [noise=true , address=104.36.82.11:4113 , piece_id=TRHOT32ONTK5AHYGBOKUWOPSLJSOEZHWM7I2BEF35B6I2CK62TKA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.265691123 (338h51m34.036332468s) [noise=true , address=104.36.82.14:4223 , piece_id=4SKO77JRLCKZIJOA2S2ED3DHHDX4N6POWUIMJSOQNJQRP5SBRP2A, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.266330596 (338h51m34.036971931s) [noise=true , address=77.90.31.12:4592 , piece_id=3K4UALXEA6HXATI7MAEK3TF2BSKRS4FTORIKFQUWALIENJ7ROGZA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.266671569 (338h51m34.037312914s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXAIRV6KPBEKHHT2WHTV7RFBZZX2M42BSDX34IICONNVFD2H4MPA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.267012862 (338h51m34.037654207s) [noise=true , address=45.91.116.9:4262 , piece_id=NPP4NPDONFYKTDJQKC5XPJPNEKKLYRAPHPNE2WKI3KOKG3VJWEKA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:02:00.922180841 (338h51m35.692822176s) [upload=271070]: Next returned nil segment Jul 7 12:02:00.922208914 (338h51m35.692850249s) [upload=271070]: Waiting for error group managing segments... Jul 7 12:02:01.187253453 (338h51m35.957894788s) [noise=true , address=104.36.82.15:4259 , piece_id=MYFFPHWVFEKH6PPXJB5BYJZUCHPGIBOHTM6BNN4U3WGXVIHOD4YA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.251407842 (338h51m36.022049177s) [noise=true , address=104.36.82.15:4258 , piece_id=G7UJATYPZXGE7AA2EVASTD2QXUW2F5J3N2UXSEZF23ZF5GWQJMKQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.260774924 (338h51m36.031416259s) [noise=true , address=104.36.82.9:4005 , piece_id=TZ43ZHEMJNM6P4IPJMMARHLKEX2FHTBIEFBY43IB6AAAEJMDCQNA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.275440331 (338h51m36.046081666s) [noise=true , address=104.36.82.3:4767 , piece_id=C5FKFSEABS2TO7GGPXU4J44NHKHYP7KFJZA6HNHHOETWQ6PODG4Q, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.292891458 (338h51m36.063532813s) [noise=true , address=104.36.82.10:4077 , piece_id=ZPX674LYZ7BTO2MV7T2SXNMYXLDZJ7BC64DG2XDIFJTVYMTBFRGQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.294071356 (338h51m36.064712701s) [noise=true , address=104.36.82.16:4294 , piece_id=CNFTWMXOAONQYFMJVQAYU4FQ6ZCYNVKHBXKJASI3KN7GDJOVSZ6Q, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.310479056 (338h51m36.081120391s) [noise=true , address=104.36.82.12:4150 , piece_id=JVWXXQE2KUCN7TAEJPMXNJ53EASYQSF7BDLET74FKJ42U4O54HLQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.319958452 (338h51m36.090599787s) [noise=true , address=104.36.82.11:4113 , piece_id=TRHOT32ONTK5AHYGBOKUWOPSLJSOEZHWM7I2BEF35B6I2CK62TKA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.345635898 (338h51m36.116277243s) [noise=true , address=45.91.116.11:4118 , piece_id=OH3XLDA6VDWB66QSJ7R3Y5TTMNARBDXS7MPLFDFKNSP7QZX76EGQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.348221234 (338h51m36.118862569s) [noise=true , address=45.91.116.9:4262 , piece_id=NPP4NPDONFYKTDJQKC5XPJPNEKKLYRAPHPNE2WKI3KOKG3VJWEKA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.379148724 (338h51m36.149790069s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXAIRV6KPBEKHHT2WHTV7RFBZZX2M42BSDX34IICONNVFD2H4MPA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.379665763 (338h51m36.150307098s) [noise=true , address=77.90.31.10:4517 , piece_id=3YDX4SEJC372T64RTATEJFPBJBNOVGWE5QME2L6N2MWVWUN2P7ZQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.383550435 (338h51m36.15419178s) [noise=true , address=77.90.31.13:4626 , piece_id=FMDUEB4OUQSGOWWO4LL6XIGKZFKU6ZFJDY7UJPTPRBU57OZIPXSA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.383582847 (338h51m36.154224182s) [seg_pos={0 0}, upload=271070]: Segment reached optimal threshold of 13 pieces. Jul 7 12:02:01.383717544 (338h51m36.15435888s) [noise=true , address=77.90.31.12:4592 , piece_id=3K4UALXEA6HXATI7MAEK3TF2BSKRS4FTORIKFQUWALIENJ7ROGZA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Jul 7 12:02:01.385367622 (338h51m36.156008967s) [noise=true , address=77.90.31.18:4807 , piece_id=JSZN5WN4HQN2JGFIJYMVFPDELMH67OU2UBGBWN7EYZ723NRNGX2Q, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.385867197 (338h51m36.156508542s) [noise=true , address=104.36.82.14:4223 , piece_id=4SKO77JRLCKZIJOA2S2ED3DHHDX4N6POWUIMJSOQNJQRP5SBRP2A, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.386478106 (338h51m36.157119451s) [seg_pos={0 0}, upload=271070]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jul 7 12:02:01.386554532 (338h51m36.157195867s) [upload=271070]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 12:02:01.386559752 (338h51m36.157201097s) [upload=271070]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 12:03:12.051066824 (338h52m46.821708159s) [upload=271070]: Done uploading segments... Jul 7 12:03:12.051087384 (338h52m46.821728719s) [upload=271070]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.946066118s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 5.677498466s FAIL (2025-07-07 12:44:41 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece_id=76E2UENIVWN6TTA3YD57X6CPVI366A2SNYQX6HTSGVLG6M4CCAZA, seg_pos={0 0}, upload=271062]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Jul 7 12:01:23.222432903 (338h50m57.993074238s) [noise=true , address=104.36.82.10:4078 , piece_id=RHOTQBNCH5MUDYCPQ37YGYX5BZNHTMO6BH43VCNYORRRU75RTWWQ, seg_pos={0 0}, upload=271062]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF Jul 7 12:01:23.222453401 (338h50m57.993094736s) [seg_pos={0 0}, upload=271062]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 12:01:23.222512745 (338h50m57.993154081s) [upload=271062]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 12:01:23.222516733 (338h50m57.993158068s) [upload=271062]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 12:01:23.524023810 (338h50m58.294665165s) [upload=271062]: Done uploading segments... Jul 7 12:01:23.524047065 (338h50m58.29468841s) [upload=271062]: Upload finished. err: <nil> Jul 7 12:01:59.027955412 (338h51m33.798596747s) [upload=271070]: Starting upload Jul 7 12:01:59.028075351 (338h51m33.798716696s) [upload=271070]: Done starting upload Jul 7 12:01:59.028139976 (338h51m33.798781311s) [upload=271070]: Uploading segments... Jul 7 12:01:59.028299931 (338h51m33.798941266s) [upload=271070]: Got next segment. Inline: false Jul 7 12:01:59.028416515 (338h51m33.79905785s) [upload=271070]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 7 12:01:59.028422416 (338h51m33.799063761s) [upload=271070]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 7 12:01:59.261880873 (338h51m34.032522218s) [seg_pos={0 0}, upload=271070]: Begin upload segment... Jul 7 12:01:59.261985924 (338h51m34.03262726s) [noise=true , address=104.36.82.9:4005 , piece_id=TZ43ZHEMJNM6P4IPJMMARHLKEX2FHTBIEFBY43IB6AAAEJMDCQNA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262067471 (338h51m34.032708816s) [noise=true , address=77.90.31.10:4517 , piece_id=3YDX4SEJC372T64RTATEJFPBJBNOVGWE5QME2L6N2MWVWUN2P7ZQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262498215 (338h51m34.03313955s) [noise=true , address=104.36.82.15:4258 , piece_id=G7UJATYPZXGE7AA2EVASTD2QXUW2F5J3N2UXSEZF23ZF5GWQJMKQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262520607 (338h51m34.033161952s) [noise=true , address=104.36.82.15:4259 , piece_id=MYFFPHWVFEKH6PPXJB5BYJZUCHPGIBOHTM6BNN4U3WGXVIHOD4YA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262795914 (338h51m34.033437249s) [seg_pos={0 0}, upload=271070]: Done begin upload segment. Jul 7 12:01:59.262857242 (338h51m34.033498577s) [noise=true , address=45.91.116.11:4118 , piece_id=OH3XLDA6VDWB66QSJ7R3Y5TTMNARBDXS7MPLFDFKNSP7QZX76EGQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.263419457 (338h51m34.034060792s) [noise=true , address=104.36.82.10:4077 , piece_id=ZPX674LYZ7BTO2MV7T2SXNMYXLDZJ7BC64DG2XDIFJTVYMTBFRGQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.263698150 (338h51m34.034339485s) [noise=true , address=104.36.82.3:4767 , piece_id=C5FKFSEABS2TO7GGPXU4J44NHKHYP7KFJZA6HNHHOETWQ6PODG4Q, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264015678 (338h51m34.034657013s) [noise=true , address=77.90.31.18:4807 , piece_id=JSZN5WN4HQN2JGFIJYMVFPDELMH67OU2UBGBWN7EYZ723NRNGX2Q, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264312575 (338h51m34.03495391s) [noise=true , address=104.36.82.12:4150 , piece_id=JVWXXQE2KUCN7TAEJPMXNJ53EASYQSF7BDLET74FKJ42U4O54HLQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264672153 (338h51m34.035313488s) [noise=true , address=104.36.82.16:4294 , piece_id=CNFTWMXOAONQYFMJVQAYU4FQ6ZCYNVKHBXKJASI3KN7GDJOVSZ6Q, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264999710 (338h51m34.035641045s) [noise=true , address=77.90.31.13:4626 , piece_id=FMDUEB4OUQSGOWWO4LL6XIGKZFKU6ZFJDY7UJPTPRBU57OZIPXSA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.265238698 (338h51m34.035880053s) [noise=true , address=104.36.82.11:4113 , piece_id=TRHOT32ONTK5AHYGBOKUWOPSLJSOEZHWM7I2BEF35B6I2CK62TKA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.265691123 (338h51m34.036332468s) [noise=true , address=104.36.82.14:4223 , piece_id=4SKO77JRLCKZIJOA2S2ED3DHHDX4N6POWUIMJSOQNJQRP5SBRP2A, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.266330596 (338h51m34.036971931s) [noise=true , address=77.90.31.12:4592 , piece_id=3K4UALXEA6HXATI7MAEK3TF2BSKRS4FTORIKFQUWALIENJ7ROGZA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.266671569 (338h51m34.037312914s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXAIRV6KPBEKHHT2WHTV7RFBZZX2M42BSDX34IICONNVFD2H4MPA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.267012862 (338h51m34.037654207s) [noise=true , address=45.91.116.9:4262 , piece_id=NPP4NPDONFYKTDJQKC5XPJPNEKKLYRAPHPNE2WKI3KOKG3VJWEKA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:02:00.922180841 (338h51m35.692822176s) [upload=271070]: Next returned nil segment Jul 7 12:02:00.922208914 (338h51m35.692850249s) [upload=271070]: Waiting for error group managing segments... Jul 7 12:02:01.187253453 (338h51m35.957894788s) [noise=true , address=104.36.82.15:4259 , piece_id=MYFFPHWVFEKH6PPXJB5BYJZUCHPGIBOHTM6BNN4U3WGXVIHOD4YA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.251407842 (338h51m36.022049177s) [noise=true , address=104.36.82.15:4258 , piece_id=G7UJATYPZXGE7AA2EVASTD2QXUW2F5J3N2UXSEZF23ZF5GWQJMKQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.260774924 (338h51m36.031416259s) [noise=true , address=104.36.82.9:4005 , piece_id=TZ43ZHEMJNM6P4IPJMMARHLKEX2FHTBIEFBY43IB6AAAEJMDCQNA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.275440331 (338h51m36.046081666s) [noise=true , address=104.36.82.3:4767 , piece_id=C5FKFSEABS2TO7GGPXU4J44NHKHYP7KFJZA6HNHHOETWQ6PODG4Q, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.292891458 (338h51m36.063532813s) [noise=true , address=104.36.82.10:4077 , piece_id=ZPX674LYZ7BTO2MV7T2SXNMYXLDZJ7BC64DG2XDIFJTVYMTBFRGQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.294071356 (338h51m36.064712701s) [noise=true , address=104.36.82.16:4294 , piece_id=CNFTWMXOAONQYFMJVQAYU4FQ6ZCYNVKHBXKJASI3KN7GDJOVSZ6Q, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.310479056 (338h51m36.081120391s) [noise=true , address=104.36.82.12:4150 , piece_id=JVWXXQE2KUCN7TAEJPMXNJ53EASYQSF7BDLET74FKJ42U4O54HLQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.319958452 (338h51m36.090599787s) [noise=true , address=104.36.82.11:4113 , piece_id=TRHOT32ONTK5AHYGBOKUWOPSLJSOEZHWM7I2BEF35B6I2CK62TKA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.345635898 (338h51m36.116277243s) [noise=true , address=45.91.116.11:4118 , piece_id=OH3XLDA6VDWB66QSJ7R3Y5TTMNARBDXS7MPLFDFKNSP7QZX76EGQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.348221234 (338h51m36.118862569s) [noise=true , address=45.91.116.9:4262 , piece_id=NPP4NPDONFYKTDJQKC5XPJPNEKKLYRAPHPNE2WKI3KOKG3VJWEKA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.379148724 (338h51m36.149790069s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXAIRV6KPBEKHHT2WHTV7RFBZZX2M42BSDX34IICONNVFD2H4MPA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.379665763 (338h51m36.150307098s) [noise=true , address=77.90.31.10:4517 , piece_id=3YDX4SEJC372T64RTATEJFPBJBNOVGWE5QME2L6N2MWVWUN2P7ZQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.383550435 (338h51m36.15419178s) [noise=true , address=77.90.31.13:4626 , piece_id=FMDUEB4OUQSGOWWO4LL6XIGKZFKU6ZFJDY7UJPTPRBU57OZIPXSA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.383582847 (338h51m36.154224182s) [seg_pos={0 0}, upload=271070]: Segment reached optimal threshold of 13 pieces. Jul 7 12:02:01.383717544 (338h51m36.15435888s) [noise=true , address=77.90.31.12:4592 , piece_id=3K4UALXEA6HXATI7MAEK3TF2BSKRS4FTORIKFQUWALIENJ7ROGZA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Jul 7 12:02:01.385367622 (338h51m36.156008967s) [noise=true , address=77.90.31.18:4807 , piece_id=JSZN5WN4HQN2JGFIJYMVFPDELMH67OU2UBGBWN7EYZ723NRNGX2Q, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.385867197 (338h51m36.156508542s) [noise=true , address=104.36.82.14:4223 , piece_id=4SKO77JRLCKZIJOA2S2ED3DHHDX4N6POWUIMJSOQNJQRP5SBRP2A, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.386478106 (338h51m36.157119451s) [seg_pos={0 0}, upload=271070]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jul 7 12:02:01.386554532 (338h51m36.157195867s) [upload=271070]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 12:02:01.386559752 (338h51m36.157201097s) [upload=271070]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 12:03:12.051066824 (338h52m46.821708159s) [upload=271070]: Done uploading segments... Jul 7 12:03:12.051087384 (338h52m46.821728719s) [upload=271070]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.677516301s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 5.741862497s FAIL (2025-07-07 12:43:28 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece_id=76E2UENIVWN6TTA3YD57X6CPVI366A2SNYQX6HTSGVLG6M4CCAZA, seg_pos={0 0}, upload=271062]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Jul 7 12:01:23.222432903 (338h50m57.993074238s) [noise=true , address=104.36.82.10:4078 , piece_id=RHOTQBNCH5MUDYCPQ37YGYX5BZNHTMO6BH43VCNYORRRU75RTWWQ, seg_pos={0 0}, upload=271062]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF Jul 7 12:01:23.222453401 (338h50m57.993094736s) [seg_pos={0 0}, upload=271062]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 12:01:23.222512745 (338h50m57.993154081s) [upload=271062]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 12:01:23.222516733 (338h50m57.993158068s) [upload=271062]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 12:01:23.524023810 (338h50m58.294665165s) [upload=271062]: Done uploading segments... Jul 7 12:01:23.524047065 (338h50m58.29468841s) [upload=271062]: Upload finished. err: <nil> Jul 7 12:01:59.027955412 (338h51m33.798596747s) [upload=271070]: Starting upload Jul 7 12:01:59.028075351 (338h51m33.798716696s) [upload=271070]: Done starting upload Jul 7 12:01:59.028139976 (338h51m33.798781311s) [upload=271070]: Uploading segments... Jul 7 12:01:59.028299931 (338h51m33.798941266s) [upload=271070]: Got next segment. Inline: false Jul 7 12:01:59.028416515 (338h51m33.79905785s) [upload=271070]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 7 12:01:59.028422416 (338h51m33.799063761s) [upload=271070]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 7 12:01:59.261880873 (338h51m34.032522218s) [seg_pos={0 0}, upload=271070]: Begin upload segment... Jul 7 12:01:59.261985924 (338h51m34.03262726s) [noise=true , address=104.36.82.9:4005 , piece_id=TZ43ZHEMJNM6P4IPJMMARHLKEX2FHTBIEFBY43IB6AAAEJMDCQNA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262067471 (338h51m34.032708816s) [noise=true , address=77.90.31.10:4517 , piece_id=3YDX4SEJC372T64RTATEJFPBJBNOVGWE5QME2L6N2MWVWUN2P7ZQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262498215 (338h51m34.03313955s) [noise=true , address=104.36.82.15:4258 , piece_id=G7UJATYPZXGE7AA2EVASTD2QXUW2F5J3N2UXSEZF23ZF5GWQJMKQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262520607 (338h51m34.033161952s) [noise=true , address=104.36.82.15:4259 , piece_id=MYFFPHWVFEKH6PPXJB5BYJZUCHPGIBOHTM6BNN4U3WGXVIHOD4YA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262795914 (338h51m34.033437249s) [seg_pos={0 0}, upload=271070]: Done begin upload segment. Jul 7 12:01:59.262857242 (338h51m34.033498577s) [noise=true , address=45.91.116.11:4118 , piece_id=OH3XLDA6VDWB66QSJ7R3Y5TTMNARBDXS7MPLFDFKNSP7QZX76EGQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.263419457 (338h51m34.034060792s) [noise=true , address=104.36.82.10:4077 , piece_id=ZPX674LYZ7BTO2MV7T2SXNMYXLDZJ7BC64DG2XDIFJTVYMTBFRGQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.263698150 (338h51m34.034339485s) [noise=true , address=104.36.82.3:4767 , piece_id=C5FKFSEABS2TO7GGPXU4J44NHKHYP7KFJZA6HNHHOETWQ6PODG4Q, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264015678 (338h51m34.034657013s) [noise=true , address=77.90.31.18:4807 , piece_id=JSZN5WN4HQN2JGFIJYMVFPDELMH67OU2UBGBWN7EYZ723NRNGX2Q, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264312575 (338h51m34.03495391s) [noise=true , address=104.36.82.12:4150 , piece_id=JVWXXQE2KUCN7TAEJPMXNJ53EASYQSF7BDLET74FKJ42U4O54HLQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264672153 (338h51m34.035313488s) [noise=true , address=104.36.82.16:4294 , piece_id=CNFTWMXOAONQYFMJVQAYU4FQ6ZCYNVKHBXKJASI3KN7GDJOVSZ6Q, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264999710 (338h51m34.035641045s) [noise=true , address=77.90.31.13:4626 , piece_id=FMDUEB4OUQSGOWWO4LL6XIGKZFKU6ZFJDY7UJPTPRBU57OZIPXSA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.265238698 (338h51m34.035880053s) [noise=true , address=104.36.82.11:4113 , piece_id=TRHOT32ONTK5AHYGBOKUWOPSLJSOEZHWM7I2BEF35B6I2CK62TKA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.265691123 (338h51m34.036332468s) [noise=true , address=104.36.82.14:4223 , piece_id=4SKO77JRLCKZIJOA2S2ED3DHHDX4N6POWUIMJSOQNJQRP5SBRP2A, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.266330596 (338h51m34.036971931s) [noise=true , address=77.90.31.12:4592 , piece_id=3K4UALXEA6HXATI7MAEK3TF2BSKRS4FTORIKFQUWALIENJ7ROGZA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.266671569 (338h51m34.037312914s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXAIRV6KPBEKHHT2WHTV7RFBZZX2M42BSDX34IICONNVFD2H4MPA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.267012862 (338h51m34.037654207s) [noise=true , address=45.91.116.9:4262 , piece_id=NPP4NPDONFYKTDJQKC5XPJPNEKKLYRAPHPNE2WKI3KOKG3VJWEKA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:02:00.922180841 (338h51m35.692822176s) [upload=271070]: Next returned nil segment Jul 7 12:02:00.922208914 (338h51m35.692850249s) [upload=271070]: Waiting for error group managing segments... Jul 7 12:02:01.187253453 (338h51m35.957894788s) [noise=true , address=104.36.82.15:4259 , piece_id=MYFFPHWVFEKH6PPXJB5BYJZUCHPGIBOHTM6BNN4U3WGXVIHOD4YA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.251407842 (338h51m36.022049177s) [noise=true , address=104.36.82.15:4258 , piece_id=G7UJATYPZXGE7AA2EVASTD2QXUW2F5J3N2UXSEZF23ZF5GWQJMKQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.260774924 (338h51m36.031416259s) [noise=true , address=104.36.82.9:4005 , piece_id=TZ43ZHEMJNM6P4IPJMMARHLKEX2FHTBIEFBY43IB6AAAEJMDCQNA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.275440331 (338h51m36.046081666s) [noise=true , address=104.36.82.3:4767 , piece_id=C5FKFSEABS2TO7GGPXU4J44NHKHYP7KFJZA6HNHHOETWQ6PODG4Q, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.292891458 (338h51m36.063532813s) [noise=true , address=104.36.82.10:4077 , piece_id=ZPX674LYZ7BTO2MV7T2SXNMYXLDZJ7BC64DG2XDIFJTVYMTBFRGQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.294071356 (338h51m36.064712701s) [noise=true , address=104.36.82.16:4294 , piece_id=CNFTWMXOAONQYFMJVQAYU4FQ6ZCYNVKHBXKJASI3KN7GDJOVSZ6Q, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.310479056 (338h51m36.081120391s) [noise=true , address=104.36.82.12:4150 , piece_id=JVWXXQE2KUCN7TAEJPMXNJ53EASYQSF7BDLET74FKJ42U4O54HLQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.319958452 (338h51m36.090599787s) [noise=true , address=104.36.82.11:4113 , piece_id=TRHOT32ONTK5AHYGBOKUWOPSLJSOEZHWM7I2BEF35B6I2CK62TKA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.345635898 (338h51m36.116277243s) [noise=true , address=45.91.116.11:4118 , piece_id=OH3XLDA6VDWB66QSJ7R3Y5TTMNARBDXS7MPLFDFKNSP7QZX76EGQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.348221234 (338h51m36.118862569s) [noise=true , address=45.91.116.9:4262 , piece_id=NPP4NPDONFYKTDJQKC5XPJPNEKKLYRAPHPNE2WKI3KOKG3VJWEKA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.379148724 (338h51m36.149790069s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXAIRV6KPBEKHHT2WHTV7RFBZZX2M42BSDX34IICONNVFD2H4MPA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.379665763 (338h51m36.150307098s) [noise=true , address=77.90.31.10:4517 , piece_id=3YDX4SEJC372T64RTATEJFPBJBNOVGWE5QME2L6N2MWVWUN2P7ZQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.383550435 (338h51m36.15419178s) [noise=true , address=77.90.31.13:4626 , piece_id=FMDUEB4OUQSGOWWO4LL6XIGKZFKU6ZFJDY7UJPTPRBU57OZIPXSA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.383582847 (338h51m36.154224182s) [seg_pos={0 0}, upload=271070]: Segment reached optimal threshold of 13 pieces. Jul 7 12:02:01.383717544 (338h51m36.15435888s) [noise=true , address=77.90.31.12:4592 , piece_id=3K4UALXEA6HXATI7MAEK3TF2BSKRS4FTORIKFQUWALIENJ7ROGZA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Jul 7 12:02:01.385367622 (338h51m36.156008967s) [noise=true , address=77.90.31.18:4807 , piece_id=JSZN5WN4HQN2JGFIJYMVFPDELMH67OU2UBGBWN7EYZ723NRNGX2Q, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.385867197 (338h51m36.156508542s) [noise=true , address=104.36.82.14:4223 , piece_id=4SKO77JRLCKZIJOA2S2ED3DHHDX4N6POWUIMJSOQNJQRP5SBRP2A, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.386478106 (338h51m36.157119451s) [seg_pos={0 0}, upload=271070]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jul 7 12:02:01.386554532 (338h51m36.157195867s) [upload=271070]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 12:02:01.386559752 (338h51m36.157201097s) [upload=271070]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 12:03:12.051066824 (338h52m46.821708159s) [upload=271070]: Done uploading segments... Jul 7 12:03:12.051087384 (338h52m46.821728719s) [upload=271070]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.741893085s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 5.683641007s FAIL (2025-07-07 12:42:30 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece_id=76E2UENIVWN6TTA3YD57X6CPVI366A2SNYQX6HTSGVLG6M4CCAZA, seg_pos={0 0}, upload=271062]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Jul 7 12:01:23.222432903 (338h50m57.993074238s) [noise=true , address=104.36.82.10:4078 , piece_id=RHOTQBNCH5MUDYCPQ37YGYX5BZNHTMO6BH43VCNYORRRU75RTWWQ, seg_pos={0 0}, upload=271062]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF Jul 7 12:01:23.222453401 (338h50m57.993094736s) [seg_pos={0 0}, upload=271062]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 12:01:23.222512745 (338h50m57.993154081s) [upload=271062]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 12:01:23.222516733 (338h50m57.993158068s) [upload=271062]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 12:01:23.524023810 (338h50m58.294665165s) [upload=271062]: Done uploading segments... Jul 7 12:01:23.524047065 (338h50m58.29468841s) [upload=271062]: Upload finished. err: <nil> Jul 7 12:01:59.027955412 (338h51m33.798596747s) [upload=271070]: Starting upload Jul 7 12:01:59.028075351 (338h51m33.798716696s) [upload=271070]: Done starting upload Jul 7 12:01:59.028139976 (338h51m33.798781311s) [upload=271070]: Uploading segments... Jul 7 12:01:59.028299931 (338h51m33.798941266s) [upload=271070]: Got next segment. Inline: false Jul 7 12:01:59.028416515 (338h51m33.79905785s) [upload=271070]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 7 12:01:59.028422416 (338h51m33.799063761s) [upload=271070]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 7 12:01:59.261880873 (338h51m34.032522218s) [seg_pos={0 0}, upload=271070]: Begin upload segment... Jul 7 12:01:59.261985924 (338h51m34.03262726s) [noise=true , address=104.36.82.9:4005 , piece_id=TZ43ZHEMJNM6P4IPJMMARHLKEX2FHTBIEFBY43IB6AAAEJMDCQNA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262067471 (338h51m34.032708816s) [noise=true , address=77.90.31.10:4517 , piece_id=3YDX4SEJC372T64RTATEJFPBJBNOVGWE5QME2L6N2MWVWUN2P7ZQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262498215 (338h51m34.03313955s) [noise=true , address=104.36.82.15:4258 , piece_id=G7UJATYPZXGE7AA2EVASTD2QXUW2F5J3N2UXSEZF23ZF5GWQJMKQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262520607 (338h51m34.033161952s) [noise=true , address=104.36.82.15:4259 , piece_id=MYFFPHWVFEKH6PPXJB5BYJZUCHPGIBOHTM6BNN4U3WGXVIHOD4YA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262795914 (338h51m34.033437249s) [seg_pos={0 0}, upload=271070]: Done begin upload segment. Jul 7 12:01:59.262857242 (338h51m34.033498577s) [noise=true , address=45.91.116.11:4118 , piece_id=OH3XLDA6VDWB66QSJ7R3Y5TTMNARBDXS7MPLFDFKNSP7QZX76EGQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.263419457 (338h51m34.034060792s) [noise=true , address=104.36.82.10:4077 , piece_id=ZPX674LYZ7BTO2MV7T2SXNMYXLDZJ7BC64DG2XDIFJTVYMTBFRGQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.263698150 (338h51m34.034339485s) [noise=true , address=104.36.82.3:4767 , piece_id=C5FKFSEABS2TO7GGPXU4J44NHKHYP7KFJZA6HNHHOETWQ6PODG4Q, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264015678 (338h51m34.034657013s) [noise=true , address=77.90.31.18:4807 , piece_id=JSZN5WN4HQN2JGFIJYMVFPDELMH67OU2UBGBWN7EYZ723NRNGX2Q, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264312575 (338h51m34.03495391s) [noise=true , address=104.36.82.12:4150 , piece_id=JVWXXQE2KUCN7TAEJPMXNJ53EASYQSF7BDLET74FKJ42U4O54HLQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264672153 (338h51m34.035313488s) [noise=true , address=104.36.82.16:4294 , piece_id=CNFTWMXOAONQYFMJVQAYU4FQ6ZCYNVKHBXKJASI3KN7GDJOVSZ6Q, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264999710 (338h51m34.035641045s) [noise=true , address=77.90.31.13:4626 , piece_id=FMDUEB4OUQSGOWWO4LL6XIGKZFKU6ZFJDY7UJPTPRBU57OZIPXSA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.265238698 (338h51m34.035880053s) [noise=true , address=104.36.82.11:4113 , piece_id=TRHOT32ONTK5AHYGBOKUWOPSLJSOEZHWM7I2BEF35B6I2CK62TKA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.265691123 (338h51m34.036332468s) [noise=true , address=104.36.82.14:4223 , piece_id=4SKO77JRLCKZIJOA2S2ED3DHHDX4N6POWUIMJSOQNJQRP5SBRP2A, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.266330596 (338h51m34.036971931s) [noise=true , address=77.90.31.12:4592 , piece_id=3K4UALXEA6HXATI7MAEK3TF2BSKRS4FTORIKFQUWALIENJ7ROGZA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.266671569 (338h51m34.037312914s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXAIRV6KPBEKHHT2WHTV7RFBZZX2M42BSDX34IICONNVFD2H4MPA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.267012862 (338h51m34.037654207s) [noise=true , address=45.91.116.9:4262 , piece_id=NPP4NPDONFYKTDJQKC5XPJPNEKKLYRAPHPNE2WKI3KOKG3VJWEKA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:02:00.922180841 (338h51m35.692822176s) [upload=271070]: Next returned nil segment Jul 7 12:02:00.922208914 (338h51m35.692850249s) [upload=271070]: Waiting for error group managing segments... Jul 7 12:02:01.187253453 (338h51m35.957894788s) [noise=true , address=104.36.82.15:4259 , piece_id=MYFFPHWVFEKH6PPXJB5BYJZUCHPGIBOHTM6BNN4U3WGXVIHOD4YA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.251407842 (338h51m36.022049177s) [noise=true , address=104.36.82.15:4258 , piece_id=G7UJATYPZXGE7AA2EVASTD2QXUW2F5J3N2UXSEZF23ZF5GWQJMKQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.260774924 (338h51m36.031416259s) [noise=true , address=104.36.82.9:4005 , piece_id=TZ43ZHEMJNM6P4IPJMMARHLKEX2FHTBIEFBY43IB6AAAEJMDCQNA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.275440331 (338h51m36.046081666s) [noise=true , address=104.36.82.3:4767 , piece_id=C5FKFSEABS2TO7GGPXU4J44NHKHYP7KFJZA6HNHHOETWQ6PODG4Q, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.292891458 (338h51m36.063532813s) [noise=true , address=104.36.82.10:4077 , piece_id=ZPX674LYZ7BTO2MV7T2SXNMYXLDZJ7BC64DG2XDIFJTVYMTBFRGQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.294071356 (338h51m36.064712701s) [noise=true , address=104.36.82.16:4294 , piece_id=CNFTWMXOAONQYFMJVQAYU4FQ6ZCYNVKHBXKJASI3KN7GDJOVSZ6Q, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.310479056 (338h51m36.081120391s) [noise=true , address=104.36.82.12:4150 , piece_id=JVWXXQE2KUCN7TAEJPMXNJ53EASYQSF7BDLET74FKJ42U4O54HLQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.319958452 (338h51m36.090599787s) [noise=true , address=104.36.82.11:4113 , piece_id=TRHOT32ONTK5AHYGBOKUWOPSLJSOEZHWM7I2BEF35B6I2CK62TKA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.345635898 (338h51m36.116277243s) [noise=true , address=45.91.116.11:4118 , piece_id=OH3XLDA6VDWB66QSJ7R3Y5TTMNARBDXS7MPLFDFKNSP7QZX76EGQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.348221234 (338h51m36.118862569s) [noise=true , address=45.91.116.9:4262 , piece_id=NPP4NPDONFYKTDJQKC5XPJPNEKKLYRAPHPNE2WKI3KOKG3VJWEKA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.379148724 (338h51m36.149790069s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXAIRV6KPBEKHHT2WHTV7RFBZZX2M42BSDX34IICONNVFD2H4MPA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.379665763 (338h51m36.150307098s) [noise=true , address=77.90.31.10:4517 , piece_id=3YDX4SEJC372T64RTATEJFPBJBNOVGWE5QME2L6N2MWVWUN2P7ZQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.383550435 (338h51m36.15419178s) [noise=true , address=77.90.31.13:4626 , piece_id=FMDUEB4OUQSGOWWO4LL6XIGKZFKU6ZFJDY7UJPTPRBU57OZIPXSA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.383582847 (338h51m36.154224182s) [seg_pos={0 0}, upload=271070]: Segment reached optimal threshold of 13 pieces. Jul 7 12:02:01.383717544 (338h51m36.15435888s) [noise=true , address=77.90.31.12:4592 , piece_id=3K4UALXEA6HXATI7MAEK3TF2BSKRS4FTORIKFQUWALIENJ7ROGZA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Jul 7 12:02:01.385367622 (338h51m36.156008967s) [noise=true , address=77.90.31.18:4807 , piece_id=JSZN5WN4HQN2JGFIJYMVFPDELMH67OU2UBGBWN7EYZ723NRNGX2Q, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.385867197 (338h51m36.156508542s) [noise=true , address=104.36.82.14:4223 , piece_id=4SKO77JRLCKZIJOA2S2ED3DHHDX4N6POWUIMJSOQNJQRP5SBRP2A, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.386478106 (338h51m36.157119451s) [seg_pos={0 0}, upload=271070]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jul 7 12:02:01.386554532 (338h51m36.157195867s) [upload=271070]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 12:02:01.386559752 (338h51m36.157201097s) [upload=271070]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 12:03:12.051066824 (338h52m46.821708159s) [upload=271070]: Done uploading segments... Jul 7 12:03:12.051087384 (338h52m46.821728719s) [upload=271070]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.683672135s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 5.602189128s FAIL (2025-07-07 12:41:55 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece_id=76E2UENIVWN6TTA3YD57X6CPVI366A2SNYQX6HTSGVLG6M4CCAZA, seg_pos={0 0}, upload=271062]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Jul 7 12:01:23.222432903 (338h50m57.993074238s) [noise=true , address=104.36.82.10:4078 , piece_id=RHOTQBNCH5MUDYCPQ37YGYX5BZNHTMO6BH43VCNYORRRU75RTWWQ, seg_pos={0 0}, upload=271062]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF Jul 7 12:01:23.222453401 (338h50m57.993094736s) [seg_pos={0 0}, upload=271062]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 12:01:23.222512745 (338h50m57.993154081s) [upload=271062]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 12:01:23.222516733 (338h50m57.993158068s) [upload=271062]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 12:01:23.524023810 (338h50m58.294665165s) [upload=271062]: Done uploading segments... Jul 7 12:01:23.524047065 (338h50m58.29468841s) [upload=271062]: Upload finished. err: <nil> Jul 7 12:01:59.027955412 (338h51m33.798596747s) [upload=271070]: Starting upload Jul 7 12:01:59.028075351 (338h51m33.798716696s) [upload=271070]: Done starting upload Jul 7 12:01:59.028139976 (338h51m33.798781311s) [upload=271070]: Uploading segments... Jul 7 12:01:59.028299931 (338h51m33.798941266s) [upload=271070]: Got next segment. Inline: false Jul 7 12:01:59.028416515 (338h51m33.79905785s) [upload=271070]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 7 12:01:59.028422416 (338h51m33.799063761s) [upload=271070]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 7 12:01:59.261880873 (338h51m34.032522218s) [seg_pos={0 0}, upload=271070]: Begin upload segment... Jul 7 12:01:59.261985924 (338h51m34.03262726s) [noise=true , address=104.36.82.9:4005 , piece_id=TZ43ZHEMJNM6P4IPJMMARHLKEX2FHTBIEFBY43IB6AAAEJMDCQNA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262067471 (338h51m34.032708816s) [noise=true , address=77.90.31.10:4517 , piece_id=3YDX4SEJC372T64RTATEJFPBJBNOVGWE5QME2L6N2MWVWUN2P7ZQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262498215 (338h51m34.03313955s) [noise=true , address=104.36.82.15:4258 , piece_id=G7UJATYPZXGE7AA2EVASTD2QXUW2F5J3N2UXSEZF23ZF5GWQJMKQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262520607 (338h51m34.033161952s) [noise=true , address=104.36.82.15:4259 , piece_id=MYFFPHWVFEKH6PPXJB5BYJZUCHPGIBOHTM6BNN4U3WGXVIHOD4YA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262795914 (338h51m34.033437249s) [seg_pos={0 0}, upload=271070]: Done begin upload segment. Jul 7 12:01:59.262857242 (338h51m34.033498577s) [noise=true , address=45.91.116.11:4118 , piece_id=OH3XLDA6VDWB66QSJ7R3Y5TTMNARBDXS7MPLFDFKNSP7QZX76EGQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.263419457 (338h51m34.034060792s) [noise=true , address=104.36.82.10:4077 , piece_id=ZPX674LYZ7BTO2MV7T2SXNMYXLDZJ7BC64DG2XDIFJTVYMTBFRGQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.263698150 (338h51m34.034339485s) [noise=true , address=104.36.82.3:4767 , piece_id=C5FKFSEABS2TO7GGPXU4J44NHKHYP7KFJZA6HNHHOETWQ6PODG4Q, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264015678 (338h51m34.034657013s) [noise=true , address=77.90.31.18:4807 , piece_id=JSZN5WN4HQN2JGFIJYMVFPDELMH67OU2UBGBWN7EYZ723NRNGX2Q, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264312575 (338h51m34.03495391s) [noise=true , address=104.36.82.12:4150 , piece_id=JVWXXQE2KUCN7TAEJPMXNJ53EASYQSF7BDLET74FKJ42U4O54HLQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264672153 (338h51m34.035313488s) [noise=true , address=104.36.82.16:4294 , piece_id=CNFTWMXOAONQYFMJVQAYU4FQ6ZCYNVKHBXKJASI3KN7GDJOVSZ6Q, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264999710 (338h51m34.035641045s) [noise=true , address=77.90.31.13:4626 , piece_id=FMDUEB4OUQSGOWWO4LL6XIGKZFKU6ZFJDY7UJPTPRBU57OZIPXSA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.265238698 (338h51m34.035880053s) [noise=true , address=104.36.82.11:4113 , piece_id=TRHOT32ONTK5AHYGBOKUWOPSLJSOEZHWM7I2BEF35B6I2CK62TKA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.265691123 (338h51m34.036332468s) [noise=true , address=104.36.82.14:4223 , piece_id=4SKO77JRLCKZIJOA2S2ED3DHHDX4N6POWUIMJSOQNJQRP5SBRP2A, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.266330596 (338h51m34.036971931s) [noise=true , address=77.90.31.12:4592 , piece_id=3K4UALXEA6HXATI7MAEK3TF2BSKRS4FTORIKFQUWALIENJ7ROGZA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.266671569 (338h51m34.037312914s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXAIRV6KPBEKHHT2WHTV7RFBZZX2M42BSDX34IICONNVFD2H4MPA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.267012862 (338h51m34.037654207s) [noise=true , address=45.91.116.9:4262 , piece_id=NPP4NPDONFYKTDJQKC5XPJPNEKKLYRAPHPNE2WKI3KOKG3VJWEKA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:02:00.922180841 (338h51m35.692822176s) [upload=271070]: Next returned nil segment Jul 7 12:02:00.922208914 (338h51m35.692850249s) [upload=271070]: Waiting for error group managing segments... Jul 7 12:02:01.187253453 (338h51m35.957894788s) [noise=true , address=104.36.82.15:4259 , piece_id=MYFFPHWVFEKH6PPXJB5BYJZUCHPGIBOHTM6BNN4U3WGXVIHOD4YA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.251407842 (338h51m36.022049177s) [noise=true , address=104.36.82.15:4258 , piece_id=G7UJATYPZXGE7AA2EVASTD2QXUW2F5J3N2UXSEZF23ZF5GWQJMKQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.260774924 (338h51m36.031416259s) [noise=true , address=104.36.82.9:4005 , piece_id=TZ43ZHEMJNM6P4IPJMMARHLKEX2FHTBIEFBY43IB6AAAEJMDCQNA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.275440331 (338h51m36.046081666s) [noise=true , address=104.36.82.3:4767 , piece_id=C5FKFSEABS2TO7GGPXU4J44NHKHYP7KFJZA6HNHHOETWQ6PODG4Q, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.292891458 (338h51m36.063532813s) [noise=true , address=104.36.82.10:4077 , piece_id=ZPX674LYZ7BTO2MV7T2SXNMYXLDZJ7BC64DG2XDIFJTVYMTBFRGQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.294071356 (338h51m36.064712701s) [noise=true , address=104.36.82.16:4294 , piece_id=CNFTWMXOAONQYFMJVQAYU4FQ6ZCYNVKHBXKJASI3KN7GDJOVSZ6Q, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.310479056 (338h51m36.081120391s) [noise=true , address=104.36.82.12:4150 , piece_id=JVWXXQE2KUCN7TAEJPMXNJ53EASYQSF7BDLET74FKJ42U4O54HLQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.319958452 (338h51m36.090599787s) [noise=true , address=104.36.82.11:4113 , piece_id=TRHOT32ONTK5AHYGBOKUWOPSLJSOEZHWM7I2BEF35B6I2CK62TKA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.345635898 (338h51m36.116277243s) [noise=true , address=45.91.116.11:4118 , piece_id=OH3XLDA6VDWB66QSJ7R3Y5TTMNARBDXS7MPLFDFKNSP7QZX76EGQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.348221234 (338h51m36.118862569s) [noise=true , address=45.91.116.9:4262 , piece_id=NPP4NPDONFYKTDJQKC5XPJPNEKKLYRAPHPNE2WKI3KOKG3VJWEKA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.379148724 (338h51m36.149790069s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXAIRV6KPBEKHHT2WHTV7RFBZZX2M42BSDX34IICONNVFD2H4MPA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.379665763 (338h51m36.150307098s) [noise=true , address=77.90.31.10:4517 , piece_id=3YDX4SEJC372T64RTATEJFPBJBNOVGWE5QME2L6N2MWVWUN2P7ZQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.383550435 (338h51m36.15419178s) [noise=true , address=77.90.31.13:4626 , piece_id=FMDUEB4OUQSGOWWO4LL6XIGKZFKU6ZFJDY7UJPTPRBU57OZIPXSA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.383582847 (338h51m36.154224182s) [seg_pos={0 0}, upload=271070]: Segment reached optimal threshold of 13 pieces. Jul 7 12:02:01.383717544 (338h51m36.15435888s) [noise=true , address=77.90.31.12:4592 , piece_id=3K4UALXEA6HXATI7MAEK3TF2BSKRS4FTORIKFQUWALIENJ7ROGZA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Jul 7 12:02:01.385367622 (338h51m36.156008967s) [noise=true , address=77.90.31.18:4807 , piece_id=JSZN5WN4HQN2JGFIJYMVFPDELMH67OU2UBGBWN7EYZ723NRNGX2Q, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.385867197 (338h51m36.156508542s) [noise=true , address=104.36.82.14:4223 , piece_id=4SKO77JRLCKZIJOA2S2ED3DHHDX4N6POWUIMJSOQNJQRP5SBRP2A, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.386478106 (338h51m36.157119451s) [seg_pos={0 0}, upload=271070]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jul 7 12:02:01.386554532 (338h51m36.157195867s) [upload=271070]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 12:02:01.386559752 (338h51m36.157201097s) [upload=271070]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 12:03:12.051066824 (338h52m46.821708159s) [upload=271070]: Done uploading segments... Jul 7 12:03:12.051087384 (338h52m46.821728719s) [upload=271070]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.602235827s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 5.606228434s FAIL (2025-07-07 12:41:40 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece_id=76E2UENIVWN6TTA3YD57X6CPVI366A2SNYQX6HTSGVLG6M4CCAZA, seg_pos={0 0}, upload=271062]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Jul 7 12:01:23.222432903 (338h50m57.993074238s) [noise=true , address=104.36.82.10:4078 , piece_id=RHOTQBNCH5MUDYCPQ37YGYX5BZNHTMO6BH43VCNYORRRU75RTWWQ, seg_pos={0 0}, upload=271062]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF Jul 7 12:01:23.222453401 (338h50m57.993094736s) [seg_pos={0 0}, upload=271062]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 12:01:23.222512745 (338h50m57.993154081s) [upload=271062]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 12:01:23.222516733 (338h50m57.993158068s) [upload=271062]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 12:01:23.524023810 (338h50m58.294665165s) [upload=271062]: Done uploading segments... Jul 7 12:01:23.524047065 (338h50m58.29468841s) [upload=271062]: Upload finished. err: <nil> Jul 7 12:01:59.027955412 (338h51m33.798596747s) [upload=271070]: Starting upload Jul 7 12:01:59.028075351 (338h51m33.798716696s) [upload=271070]: Done starting upload Jul 7 12:01:59.028139976 (338h51m33.798781311s) [upload=271070]: Uploading segments... Jul 7 12:01:59.028299931 (338h51m33.798941266s) [upload=271070]: Got next segment. Inline: false Jul 7 12:01:59.028416515 (338h51m33.79905785s) [upload=271070]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 7 12:01:59.028422416 (338h51m33.799063761s) [upload=271070]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 7 12:01:59.261880873 (338h51m34.032522218s) [seg_pos={0 0}, upload=271070]: Begin upload segment... Jul 7 12:01:59.261985924 (338h51m34.03262726s) [noise=true , address=104.36.82.9:4005 , piece_id=TZ43ZHEMJNM6P4IPJMMARHLKEX2FHTBIEFBY43IB6AAAEJMDCQNA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262067471 (338h51m34.032708816s) [noise=true , address=77.90.31.10:4517 , piece_id=3YDX4SEJC372T64RTATEJFPBJBNOVGWE5QME2L6N2MWVWUN2P7ZQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262498215 (338h51m34.03313955s) [noise=true , address=104.36.82.15:4258 , piece_id=G7UJATYPZXGE7AA2EVASTD2QXUW2F5J3N2UXSEZF23ZF5GWQJMKQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262520607 (338h51m34.033161952s) [noise=true , address=104.36.82.15:4259 , piece_id=MYFFPHWVFEKH6PPXJB5BYJZUCHPGIBOHTM6BNN4U3WGXVIHOD4YA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262795914 (338h51m34.033437249s) [seg_pos={0 0}, upload=271070]: Done begin upload segment. Jul 7 12:01:59.262857242 (338h51m34.033498577s) [noise=true , address=45.91.116.11:4118 , piece_id=OH3XLDA6VDWB66QSJ7R3Y5TTMNARBDXS7MPLFDFKNSP7QZX76EGQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.263419457 (338h51m34.034060792s) [noise=true , address=104.36.82.10:4077 , piece_id=ZPX674LYZ7BTO2MV7T2SXNMYXLDZJ7BC64DG2XDIFJTVYMTBFRGQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.263698150 (338h51m34.034339485s) [noise=true , address=104.36.82.3:4767 , piece_id=C5FKFSEABS2TO7GGPXU4J44NHKHYP7KFJZA6HNHHOETWQ6PODG4Q, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264015678 (338h51m34.034657013s) [noise=true , address=77.90.31.18:4807 , piece_id=JSZN5WN4HQN2JGFIJYMVFPDELMH67OU2UBGBWN7EYZ723NRNGX2Q, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264312575 (338h51m34.03495391s) [noise=true , address=104.36.82.12:4150 , piece_id=JVWXXQE2KUCN7TAEJPMXNJ53EASYQSF7BDLET74FKJ42U4O54HLQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264672153 (338h51m34.035313488s) [noise=true , address=104.36.82.16:4294 , piece_id=CNFTWMXOAONQYFMJVQAYU4FQ6ZCYNVKHBXKJASI3KN7GDJOVSZ6Q, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264999710 (338h51m34.035641045s) [noise=true , address=77.90.31.13:4626 , piece_id=FMDUEB4OUQSGOWWO4LL6XIGKZFKU6ZFJDY7UJPTPRBU57OZIPXSA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.265238698 (338h51m34.035880053s) [noise=true , address=104.36.82.11:4113 , piece_id=TRHOT32ONTK5AHYGBOKUWOPSLJSOEZHWM7I2BEF35B6I2CK62TKA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.265691123 (338h51m34.036332468s) [noise=true , address=104.36.82.14:4223 , piece_id=4SKO77JRLCKZIJOA2S2ED3DHHDX4N6POWUIMJSOQNJQRP5SBRP2A, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.266330596 (338h51m34.036971931s) [noise=true , address=77.90.31.12:4592 , piece_id=3K4UALXEA6HXATI7MAEK3TF2BSKRS4FTORIKFQUWALIENJ7ROGZA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.266671569 (338h51m34.037312914s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXAIRV6KPBEKHHT2WHTV7RFBZZX2M42BSDX34IICONNVFD2H4MPA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.267012862 (338h51m34.037654207s) [noise=true , address=45.91.116.9:4262 , piece_id=NPP4NPDONFYKTDJQKC5XPJPNEKKLYRAPHPNE2WKI3KOKG3VJWEKA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:02:00.922180841 (338h51m35.692822176s) [upload=271070]: Next returned nil segment Jul 7 12:02:00.922208914 (338h51m35.692850249s) [upload=271070]: Waiting for error group managing segments... Jul 7 12:02:01.187253453 (338h51m35.957894788s) [noise=true , address=104.36.82.15:4259 , piece_id=MYFFPHWVFEKH6PPXJB5BYJZUCHPGIBOHTM6BNN4U3WGXVIHOD4YA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.251407842 (338h51m36.022049177s) [noise=true , address=104.36.82.15:4258 , piece_id=G7UJATYPZXGE7AA2EVASTD2QXUW2F5J3N2UXSEZF23ZF5GWQJMKQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.260774924 (338h51m36.031416259s) [noise=true , address=104.36.82.9:4005 , piece_id=TZ43ZHEMJNM6P4IPJMMARHLKEX2FHTBIEFBY43IB6AAAEJMDCQNA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.275440331 (338h51m36.046081666s) [noise=true , address=104.36.82.3:4767 , piece_id=C5FKFSEABS2TO7GGPXU4J44NHKHYP7KFJZA6HNHHOETWQ6PODG4Q, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.292891458 (338h51m36.063532813s) [noise=true , address=104.36.82.10:4077 , piece_id=ZPX674LYZ7BTO2MV7T2SXNMYXLDZJ7BC64DG2XDIFJTVYMTBFRGQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.294071356 (338h51m36.064712701s) [noise=true , address=104.36.82.16:4294 , piece_id=CNFTWMXOAONQYFMJVQAYU4FQ6ZCYNVKHBXKJASI3KN7GDJOVSZ6Q, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.310479056 (338h51m36.081120391s) [noise=true , address=104.36.82.12:4150 , piece_id=JVWXXQE2KUCN7TAEJPMXNJ53EASYQSF7BDLET74FKJ42U4O54HLQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.319958452 (338h51m36.090599787s) [noise=true , address=104.36.82.11:4113 , piece_id=TRHOT32ONTK5AHYGBOKUWOPSLJSOEZHWM7I2BEF35B6I2CK62TKA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.345635898 (338h51m36.116277243s) [noise=true , address=45.91.116.11:4118 , piece_id=OH3XLDA6VDWB66QSJ7R3Y5TTMNARBDXS7MPLFDFKNSP7QZX76EGQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.348221234 (338h51m36.118862569s) [noise=true , address=45.91.116.9:4262 , piece_id=NPP4NPDONFYKTDJQKC5XPJPNEKKLYRAPHPNE2WKI3KOKG3VJWEKA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.379148724 (338h51m36.149790069s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXAIRV6KPBEKHHT2WHTV7RFBZZX2M42BSDX34IICONNVFD2H4MPA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.379665763 (338h51m36.150307098s) [noise=true , address=77.90.31.10:4517 , piece_id=3YDX4SEJC372T64RTATEJFPBJBNOVGWE5QME2L6N2MWVWUN2P7ZQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.383550435 (338h51m36.15419178s) [noise=true , address=77.90.31.13:4626 , piece_id=FMDUEB4OUQSGOWWO4LL6XIGKZFKU6ZFJDY7UJPTPRBU57OZIPXSA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.383582847 (338h51m36.154224182s) [seg_pos={0 0}, upload=271070]: Segment reached optimal threshold of 13 pieces. Jul 7 12:02:01.383717544 (338h51m36.15435888s) [noise=true , address=77.90.31.12:4592 , piece_id=3K4UALXEA6HXATI7MAEK3TF2BSKRS4FTORIKFQUWALIENJ7ROGZA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Jul 7 12:02:01.385367622 (338h51m36.156008967s) [noise=true , address=77.90.31.18:4807 , piece_id=JSZN5WN4HQN2JGFIJYMVFPDELMH67OU2UBGBWN7EYZ723NRNGX2Q, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.385867197 (338h51m36.156508542s) [noise=true , address=104.36.82.14:4223 , piece_id=4SKO77JRLCKZIJOA2S2ED3DHHDX4N6POWUIMJSOQNJQRP5SBRP2A, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.386478106 (338h51m36.157119451s) [seg_pos={0 0}, upload=271070]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jul 7 12:02:01.386554532 (338h51m36.157195867s) [upload=271070]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 12:02:01.386559752 (338h51m36.157201097s) [upload=271070]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 12:03:12.051066824 (338h52m46.821708159s) [upload=271070]: Done uploading segments... Jul 7 12:03:12.051087384 (338h52m46.821728719s) [upload=271070]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.606252521s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 5.727742102s FAIL (2025-07-07 12:41:16 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece_id=76E2UENIVWN6TTA3YD57X6CPVI366A2SNYQX6HTSGVLG6M4CCAZA, seg_pos={0 0}, upload=271062]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Jul 7 12:01:23.222432903 (338h50m57.993074238s) [noise=true , address=104.36.82.10:4078 , piece_id=RHOTQBNCH5MUDYCPQ37YGYX5BZNHTMO6BH43VCNYORRRU75RTWWQ, seg_pos={0 0}, upload=271062]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF Jul 7 12:01:23.222453401 (338h50m57.993094736s) [seg_pos={0 0}, upload=271062]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 12:01:23.222512745 (338h50m57.993154081s) [upload=271062]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 12:01:23.222516733 (338h50m57.993158068s) [upload=271062]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 12:01:23.524023810 (338h50m58.294665165s) [upload=271062]: Done uploading segments... Jul 7 12:01:23.524047065 (338h50m58.29468841s) [upload=271062]: Upload finished. err: <nil> Jul 7 12:01:59.027955412 (338h51m33.798596747s) [upload=271070]: Starting upload Jul 7 12:01:59.028075351 (338h51m33.798716696s) [upload=271070]: Done starting upload Jul 7 12:01:59.028139976 (338h51m33.798781311s) [upload=271070]: Uploading segments... Jul 7 12:01:59.028299931 (338h51m33.798941266s) [upload=271070]: Got next segment. Inline: false Jul 7 12:01:59.028416515 (338h51m33.79905785s) [upload=271070]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 7 12:01:59.028422416 (338h51m33.799063761s) [upload=271070]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 7 12:01:59.261880873 (338h51m34.032522218s) [seg_pos={0 0}, upload=271070]: Begin upload segment... Jul 7 12:01:59.261985924 (338h51m34.03262726s) [noise=true , address=104.36.82.9:4005 , piece_id=TZ43ZHEMJNM6P4IPJMMARHLKEX2FHTBIEFBY43IB6AAAEJMDCQNA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262067471 (338h51m34.032708816s) [noise=true , address=77.90.31.10:4517 , piece_id=3YDX4SEJC372T64RTATEJFPBJBNOVGWE5QME2L6N2MWVWUN2P7ZQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262498215 (338h51m34.03313955s) [noise=true , address=104.36.82.15:4258 , piece_id=G7UJATYPZXGE7AA2EVASTD2QXUW2F5J3N2UXSEZF23ZF5GWQJMKQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262520607 (338h51m34.033161952s) [noise=true , address=104.36.82.15:4259 , piece_id=MYFFPHWVFEKH6PPXJB5BYJZUCHPGIBOHTM6BNN4U3WGXVIHOD4YA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262795914 (338h51m34.033437249s) [seg_pos={0 0}, upload=271070]: Done begin upload segment. Jul 7 12:01:59.262857242 (338h51m34.033498577s) [noise=true , address=45.91.116.11:4118 , piece_id=OH3XLDA6VDWB66QSJ7R3Y5TTMNARBDXS7MPLFDFKNSP7QZX76EGQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.263419457 (338h51m34.034060792s) [noise=true , address=104.36.82.10:4077 , piece_id=ZPX674LYZ7BTO2MV7T2SXNMYXLDZJ7BC64DG2XDIFJTVYMTBFRGQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.263698150 (338h51m34.034339485s) [noise=true , address=104.36.82.3:4767 , piece_id=C5FKFSEABS2TO7GGPXU4J44NHKHYP7KFJZA6HNHHOETWQ6PODG4Q, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264015678 (338h51m34.034657013s) [noise=true , address=77.90.31.18:4807 , piece_id=JSZN5WN4HQN2JGFIJYMVFPDELMH67OU2UBGBWN7EYZ723NRNGX2Q, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264312575 (338h51m34.03495391s) [noise=true , address=104.36.82.12:4150 , piece_id=JVWXXQE2KUCN7TAEJPMXNJ53EASYQSF7BDLET74FKJ42U4O54HLQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264672153 (338h51m34.035313488s) [noise=true , address=104.36.82.16:4294 , piece_id=CNFTWMXOAONQYFMJVQAYU4FQ6ZCYNVKHBXKJASI3KN7GDJOVSZ6Q, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264999710 (338h51m34.035641045s) [noise=true , address=77.90.31.13:4626 , piece_id=FMDUEB4OUQSGOWWO4LL6XIGKZFKU6ZFJDY7UJPTPRBU57OZIPXSA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.265238698 (338h51m34.035880053s) [noise=true , address=104.36.82.11:4113 , piece_id=TRHOT32ONTK5AHYGBOKUWOPSLJSOEZHWM7I2BEF35B6I2CK62TKA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.265691123 (338h51m34.036332468s) [noise=true , address=104.36.82.14:4223 , piece_id=4SKO77JRLCKZIJOA2S2ED3DHHDX4N6POWUIMJSOQNJQRP5SBRP2A, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.266330596 (338h51m34.036971931s) [noise=true , address=77.90.31.12:4592 , piece_id=3K4UALXEA6HXATI7MAEK3TF2BSKRS4FTORIKFQUWALIENJ7ROGZA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.266671569 (338h51m34.037312914s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXAIRV6KPBEKHHT2WHTV7RFBZZX2M42BSDX34IICONNVFD2H4MPA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.267012862 (338h51m34.037654207s) [noise=true , address=45.91.116.9:4262 , piece_id=NPP4NPDONFYKTDJQKC5XPJPNEKKLYRAPHPNE2WKI3KOKG3VJWEKA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:02:00.922180841 (338h51m35.692822176s) [upload=271070]: Next returned nil segment Jul 7 12:02:00.922208914 (338h51m35.692850249s) [upload=271070]: Waiting for error group managing segments... Jul 7 12:02:01.187253453 (338h51m35.957894788s) [noise=true , address=104.36.82.15:4259 , piece_id=MYFFPHWVFEKH6PPXJB5BYJZUCHPGIBOHTM6BNN4U3WGXVIHOD4YA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.251407842 (338h51m36.022049177s) [noise=true , address=104.36.82.15:4258 , piece_id=G7UJATYPZXGE7AA2EVASTD2QXUW2F5J3N2UXSEZF23ZF5GWQJMKQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.260774924 (338h51m36.031416259s) [noise=true , address=104.36.82.9:4005 , piece_id=TZ43ZHEMJNM6P4IPJMMARHLKEX2FHTBIEFBY43IB6AAAEJMDCQNA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.275440331 (338h51m36.046081666s) [noise=true , address=104.36.82.3:4767 , piece_id=C5FKFSEABS2TO7GGPXU4J44NHKHYP7KFJZA6HNHHOETWQ6PODG4Q, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.292891458 (338h51m36.063532813s) [noise=true , address=104.36.82.10:4077 , piece_id=ZPX674LYZ7BTO2MV7T2SXNMYXLDZJ7BC64DG2XDIFJTVYMTBFRGQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.294071356 (338h51m36.064712701s) [noise=true , address=104.36.82.16:4294 , piece_id=CNFTWMXOAONQYFMJVQAYU4FQ6ZCYNVKHBXKJASI3KN7GDJOVSZ6Q, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.310479056 (338h51m36.081120391s) [noise=true , address=104.36.82.12:4150 , piece_id=JVWXXQE2KUCN7TAEJPMXNJ53EASYQSF7BDLET74FKJ42U4O54HLQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.319958452 (338h51m36.090599787s) [noise=true , address=104.36.82.11:4113 , piece_id=TRHOT32ONTK5AHYGBOKUWOPSLJSOEZHWM7I2BEF35B6I2CK62TKA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.345635898 (338h51m36.116277243s) [noise=true , address=45.91.116.11:4118 , piece_id=OH3XLDA6VDWB66QSJ7R3Y5TTMNARBDXS7MPLFDFKNSP7QZX76EGQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.348221234 (338h51m36.118862569s) [noise=true , address=45.91.116.9:4262 , piece_id=NPP4NPDONFYKTDJQKC5XPJPNEKKLYRAPHPNE2WKI3KOKG3VJWEKA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.379148724 (338h51m36.149790069s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXAIRV6KPBEKHHT2WHTV7RFBZZX2M42BSDX34IICONNVFD2H4MPA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.379665763 (338h51m36.150307098s) [noise=true , address=77.90.31.10:4517 , piece_id=3YDX4SEJC372T64RTATEJFPBJBNOVGWE5QME2L6N2MWVWUN2P7ZQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.383550435 (338h51m36.15419178s) [noise=true , address=77.90.31.13:4626 , piece_id=FMDUEB4OUQSGOWWO4LL6XIGKZFKU6ZFJDY7UJPTPRBU57OZIPXSA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.383582847 (338h51m36.154224182s) [seg_pos={0 0}, upload=271070]: Segment reached optimal threshold of 13 pieces. Jul 7 12:02:01.383717544 (338h51m36.15435888s) [noise=true , address=77.90.31.12:4592 , piece_id=3K4UALXEA6HXATI7MAEK3TF2BSKRS4FTORIKFQUWALIENJ7ROGZA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Jul 7 12:02:01.385367622 (338h51m36.156008967s) [noise=true , address=77.90.31.18:4807 , piece_id=JSZN5WN4HQN2JGFIJYMVFPDELMH67OU2UBGBWN7EYZ723NRNGX2Q, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.385867197 (338h51m36.156508542s) [noise=true , address=104.36.82.14:4223 , piece_id=4SKO77JRLCKZIJOA2S2ED3DHHDX4N6POWUIMJSOQNJQRP5SBRP2A, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.386478106 (338h51m36.157119451s) [seg_pos={0 0}, upload=271070]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jul 7 12:02:01.386554532 (338h51m36.157195867s) [upload=271070]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 12:02:01.386559752 (338h51m36.157201097s) [upload=271070]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 12:03:12.051066824 (338h52m46.821708159s) [upload=271070]: Done uploading segments... Jul 7 12:03:12.051087384 (338h52m46.821728719s) [upload=271070]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.727771779s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 5.647959247s FAIL (2025-07-07 12:40:51 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece_id=76E2UENIVWN6TTA3YD57X6CPVI366A2SNYQX6HTSGVLG6M4CCAZA, seg_pos={0 0}, upload=271062]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Jul 7 12:01:23.222432903 (338h50m57.993074238s) [noise=true , address=104.36.82.10:4078 , piece_id=RHOTQBNCH5MUDYCPQ37YGYX5BZNHTMO6BH43VCNYORRRU75RTWWQ, seg_pos={0 0}, upload=271062]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF Jul 7 12:01:23.222453401 (338h50m57.993094736s) [seg_pos={0 0}, upload=271062]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 12:01:23.222512745 (338h50m57.993154081s) [upload=271062]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 12:01:23.222516733 (338h50m57.993158068s) [upload=271062]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 12:01:23.524023810 (338h50m58.294665165s) [upload=271062]: Done uploading segments... Jul 7 12:01:23.524047065 (338h50m58.29468841s) [upload=271062]: Upload finished. err: <nil> Jul 7 12:01:59.027955412 (338h51m33.798596747s) [upload=271070]: Starting upload Jul 7 12:01:59.028075351 (338h51m33.798716696s) [upload=271070]: Done starting upload Jul 7 12:01:59.028139976 (338h51m33.798781311s) [upload=271070]: Uploading segments... Jul 7 12:01:59.028299931 (338h51m33.798941266s) [upload=271070]: Got next segment. Inline: false Jul 7 12:01:59.028416515 (338h51m33.79905785s) [upload=271070]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 7 12:01:59.028422416 (338h51m33.799063761s) [upload=271070]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 7 12:01:59.261880873 (338h51m34.032522218s) [seg_pos={0 0}, upload=271070]: Begin upload segment... Jul 7 12:01:59.261985924 (338h51m34.03262726s) [noise=true , address=104.36.82.9:4005 , piece_id=TZ43ZHEMJNM6P4IPJMMARHLKEX2FHTBIEFBY43IB6AAAEJMDCQNA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262067471 (338h51m34.032708816s) [noise=true , address=77.90.31.10:4517 , piece_id=3YDX4SEJC372T64RTATEJFPBJBNOVGWE5QME2L6N2MWVWUN2P7ZQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262498215 (338h51m34.03313955s) [noise=true , address=104.36.82.15:4258 , piece_id=G7UJATYPZXGE7AA2EVASTD2QXUW2F5J3N2UXSEZF23ZF5GWQJMKQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262520607 (338h51m34.033161952s) [noise=true , address=104.36.82.15:4259 , piece_id=MYFFPHWVFEKH6PPXJB5BYJZUCHPGIBOHTM6BNN4U3WGXVIHOD4YA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262795914 (338h51m34.033437249s) [seg_pos={0 0}, upload=271070]: Done begin upload segment. Jul 7 12:01:59.262857242 (338h51m34.033498577s) [noise=true , address=45.91.116.11:4118 , piece_id=OH3XLDA6VDWB66QSJ7R3Y5TTMNARBDXS7MPLFDFKNSP7QZX76EGQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.263419457 (338h51m34.034060792s) [noise=true , address=104.36.82.10:4077 , piece_id=ZPX674LYZ7BTO2MV7T2SXNMYXLDZJ7BC64DG2XDIFJTVYMTBFRGQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.263698150 (338h51m34.034339485s) [noise=true , address=104.36.82.3:4767 , piece_id=C5FKFSEABS2TO7GGPXU4J44NHKHYP7KFJZA6HNHHOETWQ6PODG4Q, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264015678 (338h51m34.034657013s) [noise=true , address=77.90.31.18:4807 , piece_id=JSZN5WN4HQN2JGFIJYMVFPDELMH67OU2UBGBWN7EYZ723NRNGX2Q, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264312575 (338h51m34.03495391s) [noise=true , address=104.36.82.12:4150 , piece_id=JVWXXQE2KUCN7TAEJPMXNJ53EASYQSF7BDLET74FKJ42U4O54HLQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264672153 (338h51m34.035313488s) [noise=true , address=104.36.82.16:4294 , piece_id=CNFTWMXOAONQYFMJVQAYU4FQ6ZCYNVKHBXKJASI3KN7GDJOVSZ6Q, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264999710 (338h51m34.035641045s) [noise=true , address=77.90.31.13:4626 , piece_id=FMDUEB4OUQSGOWWO4LL6XIGKZFKU6ZFJDY7UJPTPRBU57OZIPXSA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.265238698 (338h51m34.035880053s) [noise=true , address=104.36.82.11:4113 , piece_id=TRHOT32ONTK5AHYGBOKUWOPSLJSOEZHWM7I2BEF35B6I2CK62TKA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.265691123 (338h51m34.036332468s) [noise=true , address=104.36.82.14:4223 , piece_id=4SKO77JRLCKZIJOA2S2ED3DHHDX4N6POWUIMJSOQNJQRP5SBRP2A, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.266330596 (338h51m34.036971931s) [noise=true , address=77.90.31.12:4592 , piece_id=3K4UALXEA6HXATI7MAEK3TF2BSKRS4FTORIKFQUWALIENJ7ROGZA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.266671569 (338h51m34.037312914s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXAIRV6KPBEKHHT2WHTV7RFBZZX2M42BSDX34IICONNVFD2H4MPA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.267012862 (338h51m34.037654207s) [noise=true , address=45.91.116.9:4262 , piece_id=NPP4NPDONFYKTDJQKC5XPJPNEKKLYRAPHPNE2WKI3KOKG3VJWEKA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:02:00.922180841 (338h51m35.692822176s) [upload=271070]: Next returned nil segment Jul 7 12:02:00.922208914 (338h51m35.692850249s) [upload=271070]: Waiting for error group managing segments... Jul 7 12:02:01.187253453 (338h51m35.957894788s) [noise=true , address=104.36.82.15:4259 , piece_id=MYFFPHWVFEKH6PPXJB5BYJZUCHPGIBOHTM6BNN4U3WGXVIHOD4YA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.251407842 (338h51m36.022049177s) [noise=true , address=104.36.82.15:4258 , piece_id=G7UJATYPZXGE7AA2EVASTD2QXUW2F5J3N2UXSEZF23ZF5GWQJMKQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.260774924 (338h51m36.031416259s) [noise=true , address=104.36.82.9:4005 , piece_id=TZ43ZHEMJNM6P4IPJMMARHLKEX2FHTBIEFBY43IB6AAAEJMDCQNA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.275440331 (338h51m36.046081666s) [noise=true , address=104.36.82.3:4767 , piece_id=C5FKFSEABS2TO7GGPXU4J44NHKHYP7KFJZA6HNHHOETWQ6PODG4Q, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.292891458 (338h51m36.063532813s) [noise=true , address=104.36.82.10:4077 , piece_id=ZPX674LYZ7BTO2MV7T2SXNMYXLDZJ7BC64DG2XDIFJTVYMTBFRGQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.294071356 (338h51m36.064712701s) [noise=true , address=104.36.82.16:4294 , piece_id=CNFTWMXOAONQYFMJVQAYU4FQ6ZCYNVKHBXKJASI3KN7GDJOVSZ6Q, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.310479056 (338h51m36.081120391s) [noise=true , address=104.36.82.12:4150 , piece_id=JVWXXQE2KUCN7TAEJPMXNJ53EASYQSF7BDLET74FKJ42U4O54HLQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.319958452 (338h51m36.090599787s) [noise=true , address=104.36.82.11:4113 , piece_id=TRHOT32ONTK5AHYGBOKUWOPSLJSOEZHWM7I2BEF35B6I2CK62TKA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.345635898 (338h51m36.116277243s) [noise=true , address=45.91.116.11:4118 , piece_id=OH3XLDA6VDWB66QSJ7R3Y5TTMNARBDXS7MPLFDFKNSP7QZX76EGQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.348221234 (338h51m36.118862569s) [noise=true , address=45.91.116.9:4262 , piece_id=NPP4NPDONFYKTDJQKC5XPJPNEKKLYRAPHPNE2WKI3KOKG3VJWEKA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.379148724 (338h51m36.149790069s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXAIRV6KPBEKHHT2WHTV7RFBZZX2M42BSDX34IICONNVFD2H4MPA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.379665763 (338h51m36.150307098s) [noise=true , address=77.90.31.10:4517 , piece_id=3YDX4SEJC372T64RTATEJFPBJBNOVGWE5QME2L6N2MWVWUN2P7ZQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.383550435 (338h51m36.15419178s) [noise=true , address=77.90.31.13:4626 , piece_id=FMDUEB4OUQSGOWWO4LL6XIGKZFKU6ZFJDY7UJPTPRBU57OZIPXSA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.383582847 (338h51m36.154224182s) [seg_pos={0 0}, upload=271070]: Segment reached optimal threshold of 13 pieces. Jul 7 12:02:01.383717544 (338h51m36.15435888s) [noise=true , address=77.90.31.12:4592 , piece_id=3K4UALXEA6HXATI7MAEK3TF2BSKRS4FTORIKFQUWALIENJ7ROGZA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Jul 7 12:02:01.385367622 (338h51m36.156008967s) [noise=true , address=77.90.31.18:4807 , piece_id=JSZN5WN4HQN2JGFIJYMVFPDELMH67OU2UBGBWN7EYZ723NRNGX2Q, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.385867197 (338h51m36.156508542s) [noise=true , address=104.36.82.14:4223 , piece_id=4SKO77JRLCKZIJOA2S2ED3DHHDX4N6POWUIMJSOQNJQRP5SBRP2A, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.386478106 (338h51m36.157119451s) [seg_pos={0 0}, upload=271070]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jul 7 12:02:01.386554532 (338h51m36.157195867s) [upload=271070]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 12:02:01.386559752 (338h51m36.157201097s) [upload=271070]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 12:03:12.051066824 (338h52m46.821708159s) [upload=271070]: Done uploading segments... Jul 7 12:03:12.051087384 (338h52m46.821728719s) [upload=271070]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.647991189s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 5.965683731s FAIL (2025-07-07 12:39:44 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece_id=76E2UENIVWN6TTA3YD57X6CPVI366A2SNYQX6HTSGVLG6M4CCAZA, seg_pos={0 0}, upload=271062]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Jul 7 12:01:23.222432903 (338h50m57.993074238s) [noise=true , address=104.36.82.10:4078 , piece_id=RHOTQBNCH5MUDYCPQ37YGYX5BZNHTMO6BH43VCNYORRRU75RTWWQ, seg_pos={0 0}, upload=271062]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF Jul 7 12:01:23.222453401 (338h50m57.993094736s) [seg_pos={0 0}, upload=271062]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 12:01:23.222512745 (338h50m57.993154081s) [upload=271062]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 12:01:23.222516733 (338h50m57.993158068s) [upload=271062]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 12:01:23.524023810 (338h50m58.294665165s) [upload=271062]: Done uploading segments... Jul 7 12:01:23.524047065 (338h50m58.29468841s) [upload=271062]: Upload finished. err: <nil> Jul 7 12:01:59.027955412 (338h51m33.798596747s) [upload=271070]: Starting upload Jul 7 12:01:59.028075351 (338h51m33.798716696s) [upload=271070]: Done starting upload Jul 7 12:01:59.028139976 (338h51m33.798781311s) [upload=271070]: Uploading segments... Jul 7 12:01:59.028299931 (338h51m33.798941266s) [upload=271070]: Got next segment. Inline: false Jul 7 12:01:59.028416515 (338h51m33.79905785s) [upload=271070]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 7 12:01:59.028422416 (338h51m33.799063761s) [upload=271070]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 7 12:01:59.261880873 (338h51m34.032522218s) [seg_pos={0 0}, upload=271070]: Begin upload segment... Jul 7 12:01:59.261985924 (338h51m34.03262726s) [noise=true , address=104.36.82.9:4005 , piece_id=TZ43ZHEMJNM6P4IPJMMARHLKEX2FHTBIEFBY43IB6AAAEJMDCQNA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262067471 (338h51m34.032708816s) [noise=true , address=77.90.31.10:4517 , piece_id=3YDX4SEJC372T64RTATEJFPBJBNOVGWE5QME2L6N2MWVWUN2P7ZQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262498215 (338h51m34.03313955s) [noise=true , address=104.36.82.15:4258 , piece_id=G7UJATYPZXGE7AA2EVASTD2QXUW2F5J3N2UXSEZF23ZF5GWQJMKQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262520607 (338h51m34.033161952s) [noise=true , address=104.36.82.15:4259 , piece_id=MYFFPHWVFEKH6PPXJB5BYJZUCHPGIBOHTM6BNN4U3WGXVIHOD4YA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262795914 (338h51m34.033437249s) [seg_pos={0 0}, upload=271070]: Done begin upload segment. Jul 7 12:01:59.262857242 (338h51m34.033498577s) [noise=true , address=45.91.116.11:4118 , piece_id=OH3XLDA6VDWB66QSJ7R3Y5TTMNARBDXS7MPLFDFKNSP7QZX76EGQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.263419457 (338h51m34.034060792s) [noise=true , address=104.36.82.10:4077 , piece_id=ZPX674LYZ7BTO2MV7T2SXNMYXLDZJ7BC64DG2XDIFJTVYMTBFRGQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.263698150 (338h51m34.034339485s) [noise=true , address=104.36.82.3:4767 , piece_id=C5FKFSEABS2TO7GGPXU4J44NHKHYP7KFJZA6HNHHOETWQ6PODG4Q, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264015678 (338h51m34.034657013s) [noise=true , address=77.90.31.18:4807 , piece_id=JSZN5WN4HQN2JGFIJYMVFPDELMH67OU2UBGBWN7EYZ723NRNGX2Q, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264312575 (338h51m34.03495391s) [noise=true , address=104.36.82.12:4150 , piece_id=JVWXXQE2KUCN7TAEJPMXNJ53EASYQSF7BDLET74FKJ42U4O54HLQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264672153 (338h51m34.035313488s) [noise=true , address=104.36.82.16:4294 , piece_id=CNFTWMXOAONQYFMJVQAYU4FQ6ZCYNVKHBXKJASI3KN7GDJOVSZ6Q, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264999710 (338h51m34.035641045s) [noise=true , address=77.90.31.13:4626 , piece_id=FMDUEB4OUQSGOWWO4LL6XIGKZFKU6ZFJDY7UJPTPRBU57OZIPXSA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.265238698 (338h51m34.035880053s) [noise=true , address=104.36.82.11:4113 , piece_id=TRHOT32ONTK5AHYGBOKUWOPSLJSOEZHWM7I2BEF35B6I2CK62TKA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.265691123 (338h51m34.036332468s) [noise=true , address=104.36.82.14:4223 , piece_id=4SKO77JRLCKZIJOA2S2ED3DHHDX4N6POWUIMJSOQNJQRP5SBRP2A, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.266330596 (338h51m34.036971931s) [noise=true , address=77.90.31.12:4592 , piece_id=3K4UALXEA6HXATI7MAEK3TF2BSKRS4FTORIKFQUWALIENJ7ROGZA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.266671569 (338h51m34.037312914s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXAIRV6KPBEKHHT2WHTV7RFBZZX2M42BSDX34IICONNVFD2H4MPA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.267012862 (338h51m34.037654207s) [noise=true , address=45.91.116.9:4262 , piece_id=NPP4NPDONFYKTDJQKC5XPJPNEKKLYRAPHPNE2WKI3KOKG3VJWEKA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:02:00.922180841 (338h51m35.692822176s) [upload=271070]: Next returned nil segment Jul 7 12:02:00.922208914 (338h51m35.692850249s) [upload=271070]: Waiting for error group managing segments... Jul 7 12:02:01.187253453 (338h51m35.957894788s) [noise=true , address=104.36.82.15:4259 , piece_id=MYFFPHWVFEKH6PPXJB5BYJZUCHPGIBOHTM6BNN4U3WGXVIHOD4YA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.251407842 (338h51m36.022049177s) [noise=true , address=104.36.82.15:4258 , piece_id=G7UJATYPZXGE7AA2EVASTD2QXUW2F5J3N2UXSEZF23ZF5GWQJMKQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.260774924 (338h51m36.031416259s) [noise=true , address=104.36.82.9:4005 , piece_id=TZ43ZHEMJNM6P4IPJMMARHLKEX2FHTBIEFBY43IB6AAAEJMDCQNA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.275440331 (338h51m36.046081666s) [noise=true , address=104.36.82.3:4767 , piece_id=C5FKFSEABS2TO7GGPXU4J44NHKHYP7KFJZA6HNHHOETWQ6PODG4Q, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.292891458 (338h51m36.063532813s) [noise=true , address=104.36.82.10:4077 , piece_id=ZPX674LYZ7BTO2MV7T2SXNMYXLDZJ7BC64DG2XDIFJTVYMTBFRGQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.294071356 (338h51m36.064712701s) [noise=true , address=104.36.82.16:4294 , piece_id=CNFTWMXOAONQYFMJVQAYU4FQ6ZCYNVKHBXKJASI3KN7GDJOVSZ6Q, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.310479056 (338h51m36.081120391s) [noise=true , address=104.36.82.12:4150 , piece_id=JVWXXQE2KUCN7TAEJPMXNJ53EASYQSF7BDLET74FKJ42U4O54HLQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.319958452 (338h51m36.090599787s) [noise=true , address=104.36.82.11:4113 , piece_id=TRHOT32ONTK5AHYGBOKUWOPSLJSOEZHWM7I2BEF35B6I2CK62TKA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.345635898 (338h51m36.116277243s) [noise=true , address=45.91.116.11:4118 , piece_id=OH3XLDA6VDWB66QSJ7R3Y5TTMNARBDXS7MPLFDFKNSP7QZX76EGQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.348221234 (338h51m36.118862569s) [noise=true , address=45.91.116.9:4262 , piece_id=NPP4NPDONFYKTDJQKC5XPJPNEKKLYRAPHPNE2WKI3KOKG3VJWEKA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.379148724 (338h51m36.149790069s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXAIRV6KPBEKHHT2WHTV7RFBZZX2M42BSDX34IICONNVFD2H4MPA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.379665763 (338h51m36.150307098s) [noise=true , address=77.90.31.10:4517 , piece_id=3YDX4SEJC372T64RTATEJFPBJBNOVGWE5QME2L6N2MWVWUN2P7ZQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.383550435 (338h51m36.15419178s) [noise=true , address=77.90.31.13:4626 , piece_id=FMDUEB4OUQSGOWWO4LL6XIGKZFKU6ZFJDY7UJPTPRBU57OZIPXSA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.383582847 (338h51m36.154224182s) [seg_pos={0 0}, upload=271070]: Segment reached optimal threshold of 13 pieces. Jul 7 12:02:01.383717544 (338h51m36.15435888s) [noise=true , address=77.90.31.12:4592 , piece_id=3K4UALXEA6HXATI7MAEK3TF2BSKRS4FTORIKFQUWALIENJ7ROGZA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Jul 7 12:02:01.385367622 (338h51m36.156008967s) [noise=true , address=77.90.31.18:4807 , piece_id=JSZN5WN4HQN2JGFIJYMVFPDELMH67OU2UBGBWN7EYZ723NRNGX2Q, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.385867197 (338h51m36.156508542s) [noise=true , address=104.36.82.14:4223 , piece_id=4SKO77JRLCKZIJOA2S2ED3DHHDX4N6POWUIMJSOQNJQRP5SBRP2A, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.386478106 (338h51m36.157119451s) [seg_pos={0 0}, upload=271070]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jul 7 12:02:01.386554532 (338h51m36.157195867s) [upload=271070]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 12:02:01.386559752 (338h51m36.157201097s) [upload=271070]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 12:03:12.051066824 (338h52m46.821708159s) [upload=271070]: Done uploading segments... Jul 7 12:03:12.051087384 (338h52m46.821728719s) [upload=271070]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.965701866s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 5.7944801s FAIL (2025-07-07 12:39:04 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece_id=76E2UENIVWN6TTA3YD57X6CPVI366A2SNYQX6HTSGVLG6M4CCAZA, seg_pos={0 0}, upload=271062]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Jul 7 12:01:23.222432903 (338h50m57.993074238s) [noise=true , address=104.36.82.10:4078 , piece_id=RHOTQBNCH5MUDYCPQ37YGYX5BZNHTMO6BH43VCNYORRRU75RTWWQ, seg_pos={0 0}, upload=271062]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF Jul 7 12:01:23.222453401 (338h50m57.993094736s) [seg_pos={0 0}, upload=271062]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 12:01:23.222512745 (338h50m57.993154081s) [upload=271062]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 12:01:23.222516733 (338h50m57.993158068s) [upload=271062]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 12:01:23.524023810 (338h50m58.294665165s) [upload=271062]: Done uploading segments... Jul 7 12:01:23.524047065 (338h50m58.29468841s) [upload=271062]: Upload finished. err: <nil> Jul 7 12:01:59.027955412 (338h51m33.798596747s) [upload=271070]: Starting upload Jul 7 12:01:59.028075351 (338h51m33.798716696s) [upload=271070]: Done starting upload Jul 7 12:01:59.028139976 (338h51m33.798781311s) [upload=271070]: Uploading segments... Jul 7 12:01:59.028299931 (338h51m33.798941266s) [upload=271070]: Got next segment. Inline: false Jul 7 12:01:59.028416515 (338h51m33.79905785s) [upload=271070]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 7 12:01:59.028422416 (338h51m33.799063761s) [upload=271070]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 7 12:01:59.261880873 (338h51m34.032522218s) [seg_pos={0 0}, upload=271070]: Begin upload segment... Jul 7 12:01:59.261985924 (338h51m34.03262726s) [noise=true , address=104.36.82.9:4005 , piece_id=TZ43ZHEMJNM6P4IPJMMARHLKEX2FHTBIEFBY43IB6AAAEJMDCQNA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262067471 (338h51m34.032708816s) [noise=true , address=77.90.31.10:4517 , piece_id=3YDX4SEJC372T64RTATEJFPBJBNOVGWE5QME2L6N2MWVWUN2P7ZQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262498215 (338h51m34.03313955s) [noise=true , address=104.36.82.15:4258 , piece_id=G7UJATYPZXGE7AA2EVASTD2QXUW2F5J3N2UXSEZF23ZF5GWQJMKQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262520607 (338h51m34.033161952s) [noise=true , address=104.36.82.15:4259 , piece_id=MYFFPHWVFEKH6PPXJB5BYJZUCHPGIBOHTM6BNN4U3WGXVIHOD4YA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262795914 (338h51m34.033437249s) [seg_pos={0 0}, upload=271070]: Done begin upload segment. Jul 7 12:01:59.262857242 (338h51m34.033498577s) [noise=true , address=45.91.116.11:4118 , piece_id=OH3XLDA6VDWB66QSJ7R3Y5TTMNARBDXS7MPLFDFKNSP7QZX76EGQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.263419457 (338h51m34.034060792s) [noise=true , address=104.36.82.10:4077 , piece_id=ZPX674LYZ7BTO2MV7T2SXNMYXLDZJ7BC64DG2XDIFJTVYMTBFRGQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.263698150 (338h51m34.034339485s) [noise=true , address=104.36.82.3:4767 , piece_id=C5FKFSEABS2TO7GGPXU4J44NHKHYP7KFJZA6HNHHOETWQ6PODG4Q, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264015678 (338h51m34.034657013s) [noise=true , address=77.90.31.18:4807 , piece_id=JSZN5WN4HQN2JGFIJYMVFPDELMH67OU2UBGBWN7EYZ723NRNGX2Q, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264312575 (338h51m34.03495391s) [noise=true , address=104.36.82.12:4150 , piece_id=JVWXXQE2KUCN7TAEJPMXNJ53EASYQSF7BDLET74FKJ42U4O54HLQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264672153 (338h51m34.035313488s) [noise=true , address=104.36.82.16:4294 , piece_id=CNFTWMXOAONQYFMJVQAYU4FQ6ZCYNVKHBXKJASI3KN7GDJOVSZ6Q, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264999710 (338h51m34.035641045s) [noise=true , address=77.90.31.13:4626 , piece_id=FMDUEB4OUQSGOWWO4LL6XIGKZFKU6ZFJDY7UJPTPRBU57OZIPXSA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.265238698 (338h51m34.035880053s) [noise=true , address=104.36.82.11:4113 , piece_id=TRHOT32ONTK5AHYGBOKUWOPSLJSOEZHWM7I2BEF35B6I2CK62TKA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.265691123 (338h51m34.036332468s) [noise=true , address=104.36.82.14:4223 , piece_id=4SKO77JRLCKZIJOA2S2ED3DHHDX4N6POWUIMJSOQNJQRP5SBRP2A, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.266330596 (338h51m34.036971931s) [noise=true , address=77.90.31.12:4592 , piece_id=3K4UALXEA6HXATI7MAEK3TF2BSKRS4FTORIKFQUWALIENJ7ROGZA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.266671569 (338h51m34.037312914s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXAIRV6KPBEKHHT2WHTV7RFBZZX2M42BSDX34IICONNVFD2H4MPA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.267012862 (338h51m34.037654207s) [noise=true , address=45.91.116.9:4262 , piece_id=NPP4NPDONFYKTDJQKC5XPJPNEKKLYRAPHPNE2WKI3KOKG3VJWEKA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:02:00.922180841 (338h51m35.692822176s) [upload=271070]: Next returned nil segment Jul 7 12:02:00.922208914 (338h51m35.692850249s) [upload=271070]: Waiting for error group managing segments... Jul 7 12:02:01.187253453 (338h51m35.957894788s) [noise=true , address=104.36.82.15:4259 , piece_id=MYFFPHWVFEKH6PPXJB5BYJZUCHPGIBOHTM6BNN4U3WGXVIHOD4YA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.251407842 (338h51m36.022049177s) [noise=true , address=104.36.82.15:4258 , piece_id=G7UJATYPZXGE7AA2EVASTD2QXUW2F5J3N2UXSEZF23ZF5GWQJMKQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.260774924 (338h51m36.031416259s) [noise=true , address=104.36.82.9:4005 , piece_id=TZ43ZHEMJNM6P4IPJMMARHLKEX2FHTBIEFBY43IB6AAAEJMDCQNA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.275440331 (338h51m36.046081666s) [noise=true , address=104.36.82.3:4767 , piece_id=C5FKFSEABS2TO7GGPXU4J44NHKHYP7KFJZA6HNHHOETWQ6PODG4Q, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.292891458 (338h51m36.063532813s) [noise=true , address=104.36.82.10:4077 , piece_id=ZPX674LYZ7BTO2MV7T2SXNMYXLDZJ7BC64DG2XDIFJTVYMTBFRGQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.294071356 (338h51m36.064712701s) [noise=true , address=104.36.82.16:4294 , piece_id=CNFTWMXOAONQYFMJVQAYU4FQ6ZCYNVKHBXKJASI3KN7GDJOVSZ6Q, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.310479056 (338h51m36.081120391s) [noise=true , address=104.36.82.12:4150 , piece_id=JVWXXQE2KUCN7TAEJPMXNJ53EASYQSF7BDLET74FKJ42U4O54HLQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.319958452 (338h51m36.090599787s) [noise=true , address=104.36.82.11:4113 , piece_id=TRHOT32ONTK5AHYGBOKUWOPSLJSOEZHWM7I2BEF35B6I2CK62TKA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.345635898 (338h51m36.116277243s) [noise=true , address=45.91.116.11:4118 , piece_id=OH3XLDA6VDWB66QSJ7R3Y5TTMNARBDXS7MPLFDFKNSP7QZX76EGQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.348221234 (338h51m36.118862569s) [noise=true , address=45.91.116.9:4262 , piece_id=NPP4NPDONFYKTDJQKC5XPJPNEKKLYRAPHPNE2WKI3KOKG3VJWEKA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.379148724 (338h51m36.149790069s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXAIRV6KPBEKHHT2WHTV7RFBZZX2M42BSDX34IICONNVFD2H4MPA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.379665763 (338h51m36.150307098s) [noise=true , address=77.90.31.10:4517 , piece_id=3YDX4SEJC372T64RTATEJFPBJBNOVGWE5QME2L6N2MWVWUN2P7ZQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.383550435 (338h51m36.15419178s) [noise=true , address=77.90.31.13:4626 , piece_id=FMDUEB4OUQSGOWWO4LL6XIGKZFKU6ZFJDY7UJPTPRBU57OZIPXSA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.383582847 (338h51m36.154224182s) [seg_pos={0 0}, upload=271070]: Segment reached optimal threshold of 13 pieces. Jul 7 12:02:01.383717544 (338h51m36.15435888s) [noise=true , address=77.90.31.12:4592 , piece_id=3K4UALXEA6HXATI7MAEK3TF2BSKRS4FTORIKFQUWALIENJ7ROGZA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Jul 7 12:02:01.385367622 (338h51m36.156008967s) [noise=true , address=77.90.31.18:4807 , piece_id=JSZN5WN4HQN2JGFIJYMVFPDELMH67OU2UBGBWN7EYZ723NRNGX2Q, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.385867197 (338h51m36.156508542s) [noise=true , address=104.36.82.14:4223 , piece_id=4SKO77JRLCKZIJOA2S2ED3DHHDX4N6POWUIMJSOQNJQRP5SBRP2A, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.386478106 (338h51m36.157119451s) [seg_pos={0 0}, upload=271070]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jul 7 12:02:01.386554532 (338h51m36.157195867s) [upload=271070]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 12:02:01.386559752 (338h51m36.157201097s) [upload=271070]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 12:03:12.051066824 (338h52m46.821708159s) [upload=271070]: Done uploading segments... Jul 7 12:03:12.051087384 (338h52m46.821728719s) [upload=271070]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.79451128s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 5.674664543s FAIL (2025-07-07 12:38:07 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece_id=76E2UENIVWN6TTA3YD57X6CPVI366A2SNYQX6HTSGVLG6M4CCAZA, seg_pos={0 0}, upload=271062]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Jul 7 12:01:23.222432903 (338h50m57.993074238s) [noise=true , address=104.36.82.10:4078 , piece_id=RHOTQBNCH5MUDYCPQ37YGYX5BZNHTMO6BH43VCNYORRRU75RTWWQ, seg_pos={0 0}, upload=271062]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF Jul 7 12:01:23.222453401 (338h50m57.993094736s) [seg_pos={0 0}, upload=271062]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 12:01:23.222512745 (338h50m57.993154081s) [upload=271062]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 12:01:23.222516733 (338h50m57.993158068s) [upload=271062]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 12:01:23.524023810 (338h50m58.294665165s) [upload=271062]: Done uploading segments... Jul 7 12:01:23.524047065 (338h50m58.29468841s) [upload=271062]: Upload finished. err: <nil> Jul 7 12:01:59.027955412 (338h51m33.798596747s) [upload=271070]: Starting upload Jul 7 12:01:59.028075351 (338h51m33.798716696s) [upload=271070]: Done starting upload Jul 7 12:01:59.028139976 (338h51m33.798781311s) [upload=271070]: Uploading segments... Jul 7 12:01:59.028299931 (338h51m33.798941266s) [upload=271070]: Got next segment. Inline: false Jul 7 12:01:59.028416515 (338h51m33.79905785s) [upload=271070]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 7 12:01:59.028422416 (338h51m33.799063761s) [upload=271070]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 7 12:01:59.261880873 (338h51m34.032522218s) [seg_pos={0 0}, upload=271070]: Begin upload segment... Jul 7 12:01:59.261985924 (338h51m34.03262726s) [noise=true , address=104.36.82.9:4005 , piece_id=TZ43ZHEMJNM6P4IPJMMARHLKEX2FHTBIEFBY43IB6AAAEJMDCQNA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262067471 (338h51m34.032708816s) [noise=true , address=77.90.31.10:4517 , piece_id=3YDX4SEJC372T64RTATEJFPBJBNOVGWE5QME2L6N2MWVWUN2P7ZQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262498215 (338h51m34.03313955s) [noise=true , address=104.36.82.15:4258 , piece_id=G7UJATYPZXGE7AA2EVASTD2QXUW2F5J3N2UXSEZF23ZF5GWQJMKQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262520607 (338h51m34.033161952s) [noise=true , address=104.36.82.15:4259 , piece_id=MYFFPHWVFEKH6PPXJB5BYJZUCHPGIBOHTM6BNN4U3WGXVIHOD4YA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262795914 (338h51m34.033437249s) [seg_pos={0 0}, upload=271070]: Done begin upload segment. Jul 7 12:01:59.262857242 (338h51m34.033498577s) [noise=true , address=45.91.116.11:4118 , piece_id=OH3XLDA6VDWB66QSJ7R3Y5TTMNARBDXS7MPLFDFKNSP7QZX76EGQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.263419457 (338h51m34.034060792s) [noise=true , address=104.36.82.10:4077 , piece_id=ZPX674LYZ7BTO2MV7T2SXNMYXLDZJ7BC64DG2XDIFJTVYMTBFRGQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.263698150 (338h51m34.034339485s) [noise=true , address=104.36.82.3:4767 , piece_id=C5FKFSEABS2TO7GGPXU4J44NHKHYP7KFJZA6HNHHOETWQ6PODG4Q, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264015678 (338h51m34.034657013s) [noise=true , address=77.90.31.18:4807 , piece_id=JSZN5WN4HQN2JGFIJYMVFPDELMH67OU2UBGBWN7EYZ723NRNGX2Q, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264312575 (338h51m34.03495391s) [noise=true , address=104.36.82.12:4150 , piece_id=JVWXXQE2KUCN7TAEJPMXNJ53EASYQSF7BDLET74FKJ42U4O54HLQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264672153 (338h51m34.035313488s) [noise=true , address=104.36.82.16:4294 , piece_id=CNFTWMXOAONQYFMJVQAYU4FQ6ZCYNVKHBXKJASI3KN7GDJOVSZ6Q, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264999710 (338h51m34.035641045s) [noise=true , address=77.90.31.13:4626 , piece_id=FMDUEB4OUQSGOWWO4LL6XIGKZFKU6ZFJDY7UJPTPRBU57OZIPXSA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.265238698 (338h51m34.035880053s) [noise=true , address=104.36.82.11:4113 , piece_id=TRHOT32ONTK5AHYGBOKUWOPSLJSOEZHWM7I2BEF35B6I2CK62TKA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.265691123 (338h51m34.036332468s) [noise=true , address=104.36.82.14:4223 , piece_id=4SKO77JRLCKZIJOA2S2ED3DHHDX4N6POWUIMJSOQNJQRP5SBRP2A, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.266330596 (338h51m34.036971931s) [noise=true , address=77.90.31.12:4592 , piece_id=3K4UALXEA6HXATI7MAEK3TF2BSKRS4FTORIKFQUWALIENJ7ROGZA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.266671569 (338h51m34.037312914s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXAIRV6KPBEKHHT2WHTV7RFBZZX2M42BSDX34IICONNVFD2H4MPA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.267012862 (338h51m34.037654207s) [noise=true , address=45.91.116.9:4262 , piece_id=NPP4NPDONFYKTDJQKC5XPJPNEKKLYRAPHPNE2WKI3KOKG3VJWEKA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:02:00.922180841 (338h51m35.692822176s) [upload=271070]: Next returned nil segment Jul 7 12:02:00.922208914 (338h51m35.692850249s) [upload=271070]: Waiting for error group managing segments... Jul 7 12:02:01.187253453 (338h51m35.957894788s) [noise=true , address=104.36.82.15:4259 , piece_id=MYFFPHWVFEKH6PPXJB5BYJZUCHPGIBOHTM6BNN4U3WGXVIHOD4YA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.251407842 (338h51m36.022049177s) [noise=true , address=104.36.82.15:4258 , piece_id=G7UJATYPZXGE7AA2EVASTD2QXUW2F5J3N2UXSEZF23ZF5GWQJMKQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.260774924 (338h51m36.031416259s) [noise=true , address=104.36.82.9:4005 , piece_id=TZ43ZHEMJNM6P4IPJMMARHLKEX2FHTBIEFBY43IB6AAAEJMDCQNA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.275440331 (338h51m36.046081666s) [noise=true , address=104.36.82.3:4767 , piece_id=C5FKFSEABS2TO7GGPXU4J44NHKHYP7KFJZA6HNHHOETWQ6PODG4Q, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.292891458 (338h51m36.063532813s) [noise=true , address=104.36.82.10:4077 , piece_id=ZPX674LYZ7BTO2MV7T2SXNMYXLDZJ7BC64DG2XDIFJTVYMTBFRGQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.294071356 (338h51m36.064712701s) [noise=true , address=104.36.82.16:4294 , piece_id=CNFTWMXOAONQYFMJVQAYU4FQ6ZCYNVKHBXKJASI3KN7GDJOVSZ6Q, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.310479056 (338h51m36.081120391s) [noise=true , address=104.36.82.12:4150 , piece_id=JVWXXQE2KUCN7TAEJPMXNJ53EASYQSF7BDLET74FKJ42U4O54HLQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.319958452 (338h51m36.090599787s) [noise=true , address=104.36.82.11:4113 , piece_id=TRHOT32ONTK5AHYGBOKUWOPSLJSOEZHWM7I2BEF35B6I2CK62TKA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.345635898 (338h51m36.116277243s) [noise=true , address=45.91.116.11:4118 , piece_id=OH3XLDA6VDWB66QSJ7R3Y5TTMNARBDXS7MPLFDFKNSP7QZX76EGQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.348221234 (338h51m36.118862569s) [noise=true , address=45.91.116.9:4262 , piece_id=NPP4NPDONFYKTDJQKC5XPJPNEKKLYRAPHPNE2WKI3KOKG3VJWEKA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.379148724 (338h51m36.149790069s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXAIRV6KPBEKHHT2WHTV7RFBZZX2M42BSDX34IICONNVFD2H4MPA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.379665763 (338h51m36.150307098s) [noise=true , address=77.90.31.10:4517 , piece_id=3YDX4SEJC372T64RTATEJFPBJBNOVGWE5QME2L6N2MWVWUN2P7ZQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.383550435 (338h51m36.15419178s) [noise=true , address=77.90.31.13:4626 , piece_id=FMDUEB4OUQSGOWWO4LL6XIGKZFKU6ZFJDY7UJPTPRBU57OZIPXSA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.383582847 (338h51m36.154224182s) [seg_pos={0 0}, upload=271070]: Segment reached optimal threshold of 13 pieces. Jul 7 12:02:01.383717544 (338h51m36.15435888s) [noise=true , address=77.90.31.12:4592 , piece_id=3K4UALXEA6HXATI7MAEK3TF2BSKRS4FTORIKFQUWALIENJ7ROGZA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Jul 7 12:02:01.385367622 (338h51m36.156008967s) [noise=true , address=77.90.31.18:4807 , piece_id=JSZN5WN4HQN2JGFIJYMVFPDELMH67OU2UBGBWN7EYZ723NRNGX2Q, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.385867197 (338h51m36.156508542s) [noise=true , address=104.36.82.14:4223 , piece_id=4SKO77JRLCKZIJOA2S2ED3DHHDX4N6POWUIMJSOQNJQRP5SBRP2A, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.386478106 (338h51m36.157119451s) [seg_pos={0 0}, upload=271070]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jul 7 12:02:01.386554532 (338h51m36.157195867s) [upload=271070]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 12:02:01.386559752 (338h51m36.157201097s) [upload=271070]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 12:03:12.051066824 (338h52m46.821708159s) [upload=271070]: Done uploading segments... Jul 7 12:03:12.051087384 (338h52m46.821728719s) [upload=271070]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.674705833s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 5.666435151s FAIL (2025-07-07 12:36:56 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece_id=76E2UENIVWN6TTA3YD57X6CPVI366A2SNYQX6HTSGVLG6M4CCAZA, seg_pos={0 0}, upload=271062]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Jul 7 12:01:23.222432903 (338h50m57.993074238s) [noise=true , address=104.36.82.10:4078 , piece_id=RHOTQBNCH5MUDYCPQ37YGYX5BZNHTMO6BH43VCNYORRRU75RTWWQ, seg_pos={0 0}, upload=271062]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF Jul 7 12:01:23.222453401 (338h50m57.993094736s) [seg_pos={0 0}, upload=271062]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 12:01:23.222512745 (338h50m57.993154081s) [upload=271062]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 12:01:23.222516733 (338h50m57.993158068s) [upload=271062]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 12:01:23.524023810 (338h50m58.294665165s) [upload=271062]: Done uploading segments... Jul 7 12:01:23.524047065 (338h50m58.29468841s) [upload=271062]: Upload finished. err: <nil> Jul 7 12:01:59.027955412 (338h51m33.798596747s) [upload=271070]: Starting upload Jul 7 12:01:59.028075351 (338h51m33.798716696s) [upload=271070]: Done starting upload Jul 7 12:01:59.028139976 (338h51m33.798781311s) [upload=271070]: Uploading segments... Jul 7 12:01:59.028299931 (338h51m33.798941266s) [upload=271070]: Got next segment. Inline: false Jul 7 12:01:59.028416515 (338h51m33.79905785s) [upload=271070]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 7 12:01:59.028422416 (338h51m33.799063761s) [upload=271070]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 7 12:01:59.261880873 (338h51m34.032522218s) [seg_pos={0 0}, upload=271070]: Begin upload segment... Jul 7 12:01:59.261985924 (338h51m34.03262726s) [noise=true , address=104.36.82.9:4005 , piece_id=TZ43ZHEMJNM6P4IPJMMARHLKEX2FHTBIEFBY43IB6AAAEJMDCQNA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262067471 (338h51m34.032708816s) [noise=true , address=77.90.31.10:4517 , piece_id=3YDX4SEJC372T64RTATEJFPBJBNOVGWE5QME2L6N2MWVWUN2P7ZQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262498215 (338h51m34.03313955s) [noise=true , address=104.36.82.15:4258 , piece_id=G7UJATYPZXGE7AA2EVASTD2QXUW2F5J3N2UXSEZF23ZF5GWQJMKQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262520607 (338h51m34.033161952s) [noise=true , address=104.36.82.15:4259 , piece_id=MYFFPHWVFEKH6PPXJB5BYJZUCHPGIBOHTM6BNN4U3WGXVIHOD4YA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262795914 (338h51m34.033437249s) [seg_pos={0 0}, upload=271070]: Done begin upload segment. Jul 7 12:01:59.262857242 (338h51m34.033498577s) [noise=true , address=45.91.116.11:4118 , piece_id=OH3XLDA6VDWB66QSJ7R3Y5TTMNARBDXS7MPLFDFKNSP7QZX76EGQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.263419457 (338h51m34.034060792s) [noise=true , address=104.36.82.10:4077 , piece_id=ZPX674LYZ7BTO2MV7T2SXNMYXLDZJ7BC64DG2XDIFJTVYMTBFRGQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.263698150 (338h51m34.034339485s) [noise=true , address=104.36.82.3:4767 , piece_id=C5FKFSEABS2TO7GGPXU4J44NHKHYP7KFJZA6HNHHOETWQ6PODG4Q, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264015678 (338h51m34.034657013s) [noise=true , address=77.90.31.18:4807 , piece_id=JSZN5WN4HQN2JGFIJYMVFPDELMH67OU2UBGBWN7EYZ723NRNGX2Q, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264312575 (338h51m34.03495391s) [noise=true , address=104.36.82.12:4150 , piece_id=JVWXXQE2KUCN7TAEJPMXNJ53EASYQSF7BDLET74FKJ42U4O54HLQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264672153 (338h51m34.035313488s) [noise=true , address=104.36.82.16:4294 , piece_id=CNFTWMXOAONQYFMJVQAYU4FQ6ZCYNVKHBXKJASI3KN7GDJOVSZ6Q, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264999710 (338h51m34.035641045s) [noise=true , address=77.90.31.13:4626 , piece_id=FMDUEB4OUQSGOWWO4LL6XIGKZFKU6ZFJDY7UJPTPRBU57OZIPXSA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.265238698 (338h51m34.035880053s) [noise=true , address=104.36.82.11:4113 , piece_id=TRHOT32ONTK5AHYGBOKUWOPSLJSOEZHWM7I2BEF35B6I2CK62TKA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.265691123 (338h51m34.036332468s) [noise=true , address=104.36.82.14:4223 , piece_id=4SKO77JRLCKZIJOA2S2ED3DHHDX4N6POWUIMJSOQNJQRP5SBRP2A, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.266330596 (338h51m34.036971931s) [noise=true , address=77.90.31.12:4592 , piece_id=3K4UALXEA6HXATI7MAEK3TF2BSKRS4FTORIKFQUWALIENJ7ROGZA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.266671569 (338h51m34.037312914s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXAIRV6KPBEKHHT2WHTV7RFBZZX2M42BSDX34IICONNVFD2H4MPA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.267012862 (338h51m34.037654207s) [noise=true , address=45.91.116.9:4262 , piece_id=NPP4NPDONFYKTDJQKC5XPJPNEKKLYRAPHPNE2WKI3KOKG3VJWEKA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:02:00.922180841 (338h51m35.692822176s) [upload=271070]: Next returned nil segment Jul 7 12:02:00.922208914 (338h51m35.692850249s) [upload=271070]: Waiting for error group managing segments... Jul 7 12:02:01.187253453 (338h51m35.957894788s) [noise=true , address=104.36.82.15:4259 , piece_id=MYFFPHWVFEKH6PPXJB5BYJZUCHPGIBOHTM6BNN4U3WGXVIHOD4YA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.251407842 (338h51m36.022049177s) [noise=true , address=104.36.82.15:4258 , piece_id=G7UJATYPZXGE7AA2EVASTD2QXUW2F5J3N2UXSEZF23ZF5GWQJMKQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.260774924 (338h51m36.031416259s) [noise=true , address=104.36.82.9:4005 , piece_id=TZ43ZHEMJNM6P4IPJMMARHLKEX2FHTBIEFBY43IB6AAAEJMDCQNA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.275440331 (338h51m36.046081666s) [noise=true , address=104.36.82.3:4767 , piece_id=C5FKFSEABS2TO7GGPXU4J44NHKHYP7KFJZA6HNHHOETWQ6PODG4Q, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.292891458 (338h51m36.063532813s) [noise=true , address=104.36.82.10:4077 , piece_id=ZPX674LYZ7BTO2MV7T2SXNMYXLDZJ7BC64DG2XDIFJTVYMTBFRGQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.294071356 (338h51m36.064712701s) [noise=true , address=104.36.82.16:4294 , piece_id=CNFTWMXOAONQYFMJVQAYU4FQ6ZCYNVKHBXKJASI3KN7GDJOVSZ6Q, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.310479056 (338h51m36.081120391s) [noise=true , address=104.36.82.12:4150 , piece_id=JVWXXQE2KUCN7TAEJPMXNJ53EASYQSF7BDLET74FKJ42U4O54HLQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.319958452 (338h51m36.090599787s) [noise=true , address=104.36.82.11:4113 , piece_id=TRHOT32ONTK5AHYGBOKUWOPSLJSOEZHWM7I2BEF35B6I2CK62TKA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.345635898 (338h51m36.116277243s) [noise=true , address=45.91.116.11:4118 , piece_id=OH3XLDA6VDWB66QSJ7R3Y5TTMNARBDXS7MPLFDFKNSP7QZX76EGQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.348221234 (338h51m36.118862569s) [noise=true , address=45.91.116.9:4262 , piece_id=NPP4NPDONFYKTDJQKC5XPJPNEKKLYRAPHPNE2WKI3KOKG3VJWEKA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.379148724 (338h51m36.149790069s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXAIRV6KPBEKHHT2WHTV7RFBZZX2M42BSDX34IICONNVFD2H4MPA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.379665763 (338h51m36.150307098s) [noise=true , address=77.90.31.10:4517 , piece_id=3YDX4SEJC372T64RTATEJFPBJBNOVGWE5QME2L6N2MWVWUN2P7ZQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.383550435 (338h51m36.15419178s) [noise=true , address=77.90.31.13:4626 , piece_id=FMDUEB4OUQSGOWWO4LL6XIGKZFKU6ZFJDY7UJPTPRBU57OZIPXSA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.383582847 (338h51m36.154224182s) [seg_pos={0 0}, upload=271070]: Segment reached optimal threshold of 13 pieces. Jul 7 12:02:01.383717544 (338h51m36.15435888s) [noise=true , address=77.90.31.12:4592 , piece_id=3K4UALXEA6HXATI7MAEK3TF2BSKRS4FTORIKFQUWALIENJ7ROGZA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Jul 7 12:02:01.385367622 (338h51m36.156008967s) [noise=true , address=77.90.31.18:4807 , piece_id=JSZN5WN4HQN2JGFIJYMVFPDELMH67OU2UBGBWN7EYZ723NRNGX2Q, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.385867197 (338h51m36.156508542s) [noise=true , address=104.36.82.14:4223 , piece_id=4SKO77JRLCKZIJOA2S2ED3DHHDX4N6POWUIMJSOQNJQRP5SBRP2A, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.386478106 (338h51m36.157119451s) [seg_pos={0 0}, upload=271070]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jul 7 12:02:01.386554532 (338h51m36.157195867s) [upload=271070]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 12:02:01.386559752 (338h51m36.157201097s) [upload=271070]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 12:03:12.051066824 (338h52m46.821708159s) [upload=271070]: Done uploading segments... Jul 7 12:03:12.051087384 (338h52m46.821728719s) [upload=271070]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.666461s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 5.721183123s FAIL (2025-07-07 12:35:55 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece_id=76E2UENIVWN6TTA3YD57X6CPVI366A2SNYQX6HTSGVLG6M4CCAZA, seg_pos={0 0}, upload=271062]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Jul 7 12:01:23.222432903 (338h50m57.993074238s) [noise=true , address=104.36.82.10:4078 , piece_id=RHOTQBNCH5MUDYCPQ37YGYX5BZNHTMO6BH43VCNYORRRU75RTWWQ, seg_pos={0 0}, upload=271062]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF Jul 7 12:01:23.222453401 (338h50m57.993094736s) [seg_pos={0 0}, upload=271062]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 12:01:23.222512745 (338h50m57.993154081s) [upload=271062]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 12:01:23.222516733 (338h50m57.993158068s) [upload=271062]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 12:01:23.524023810 (338h50m58.294665165s) [upload=271062]: Done uploading segments... Jul 7 12:01:23.524047065 (338h50m58.29468841s) [upload=271062]: Upload finished. err: <nil> Jul 7 12:01:59.027955412 (338h51m33.798596747s) [upload=271070]: Starting upload Jul 7 12:01:59.028075351 (338h51m33.798716696s) [upload=271070]: Done starting upload Jul 7 12:01:59.028139976 (338h51m33.798781311s) [upload=271070]: Uploading segments... Jul 7 12:01:59.028299931 (338h51m33.798941266s) [upload=271070]: Got next segment. Inline: false Jul 7 12:01:59.028416515 (338h51m33.79905785s) [upload=271070]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 7 12:01:59.028422416 (338h51m33.799063761s) [upload=271070]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 7 12:01:59.261880873 (338h51m34.032522218s) [seg_pos={0 0}, upload=271070]: Begin upload segment... Jul 7 12:01:59.261985924 (338h51m34.03262726s) [noise=true , address=104.36.82.9:4005 , piece_id=TZ43ZHEMJNM6P4IPJMMARHLKEX2FHTBIEFBY43IB6AAAEJMDCQNA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262067471 (338h51m34.032708816s) [noise=true , address=77.90.31.10:4517 , piece_id=3YDX4SEJC372T64RTATEJFPBJBNOVGWE5QME2L6N2MWVWUN2P7ZQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262498215 (338h51m34.03313955s) [noise=true , address=104.36.82.15:4258 , piece_id=G7UJATYPZXGE7AA2EVASTD2QXUW2F5J3N2UXSEZF23ZF5GWQJMKQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262520607 (338h51m34.033161952s) [noise=true , address=104.36.82.15:4259 , piece_id=MYFFPHWVFEKH6PPXJB5BYJZUCHPGIBOHTM6BNN4U3WGXVIHOD4YA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262795914 (338h51m34.033437249s) [seg_pos={0 0}, upload=271070]: Done begin upload segment. Jul 7 12:01:59.262857242 (338h51m34.033498577s) [noise=true , address=45.91.116.11:4118 , piece_id=OH3XLDA6VDWB66QSJ7R3Y5TTMNARBDXS7MPLFDFKNSP7QZX76EGQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.263419457 (338h51m34.034060792s) [noise=true , address=104.36.82.10:4077 , piece_id=ZPX674LYZ7BTO2MV7T2SXNMYXLDZJ7BC64DG2XDIFJTVYMTBFRGQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.263698150 (338h51m34.034339485s) [noise=true , address=104.36.82.3:4767 , piece_id=C5FKFSEABS2TO7GGPXU4J44NHKHYP7KFJZA6HNHHOETWQ6PODG4Q, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264015678 (338h51m34.034657013s) [noise=true , address=77.90.31.18:4807 , piece_id=JSZN5WN4HQN2JGFIJYMVFPDELMH67OU2UBGBWN7EYZ723NRNGX2Q, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264312575 (338h51m34.03495391s) [noise=true , address=104.36.82.12:4150 , piece_id=JVWXXQE2KUCN7TAEJPMXNJ53EASYQSF7BDLET74FKJ42U4O54HLQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264672153 (338h51m34.035313488s) [noise=true , address=104.36.82.16:4294 , piece_id=CNFTWMXOAONQYFMJVQAYU4FQ6ZCYNVKHBXKJASI3KN7GDJOVSZ6Q, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264999710 (338h51m34.035641045s) [noise=true , address=77.90.31.13:4626 , piece_id=FMDUEB4OUQSGOWWO4LL6XIGKZFKU6ZFJDY7UJPTPRBU57OZIPXSA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.265238698 (338h51m34.035880053s) [noise=true , address=104.36.82.11:4113 , piece_id=TRHOT32ONTK5AHYGBOKUWOPSLJSOEZHWM7I2BEF35B6I2CK62TKA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.265691123 (338h51m34.036332468s) [noise=true , address=104.36.82.14:4223 , piece_id=4SKO77JRLCKZIJOA2S2ED3DHHDX4N6POWUIMJSOQNJQRP5SBRP2A, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.266330596 (338h51m34.036971931s) [noise=true , address=77.90.31.12:4592 , piece_id=3K4UALXEA6HXATI7MAEK3TF2BSKRS4FTORIKFQUWALIENJ7ROGZA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.266671569 (338h51m34.037312914s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXAIRV6KPBEKHHT2WHTV7RFBZZX2M42BSDX34IICONNVFD2H4MPA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.267012862 (338h51m34.037654207s) [noise=true , address=45.91.116.9:4262 , piece_id=NPP4NPDONFYKTDJQKC5XPJPNEKKLYRAPHPNE2WKI3KOKG3VJWEKA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:02:00.922180841 (338h51m35.692822176s) [upload=271070]: Next returned nil segment Jul 7 12:02:00.922208914 (338h51m35.692850249s) [upload=271070]: Waiting for error group managing segments... Jul 7 12:02:01.187253453 (338h51m35.957894788s) [noise=true , address=104.36.82.15:4259 , piece_id=MYFFPHWVFEKH6PPXJB5BYJZUCHPGIBOHTM6BNN4U3WGXVIHOD4YA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.251407842 (338h51m36.022049177s) [noise=true , address=104.36.82.15:4258 , piece_id=G7UJATYPZXGE7AA2EVASTD2QXUW2F5J3N2UXSEZF23ZF5GWQJMKQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.260774924 (338h51m36.031416259s) [noise=true , address=104.36.82.9:4005 , piece_id=TZ43ZHEMJNM6P4IPJMMARHLKEX2FHTBIEFBY43IB6AAAEJMDCQNA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.275440331 (338h51m36.046081666s) [noise=true , address=104.36.82.3:4767 , piece_id=C5FKFSEABS2TO7GGPXU4J44NHKHYP7KFJZA6HNHHOETWQ6PODG4Q, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.292891458 (338h51m36.063532813s) [noise=true , address=104.36.82.10:4077 , piece_id=ZPX674LYZ7BTO2MV7T2SXNMYXLDZJ7BC64DG2XDIFJTVYMTBFRGQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.294071356 (338h51m36.064712701s) [noise=true , address=104.36.82.16:4294 , piece_id=CNFTWMXOAONQYFMJVQAYU4FQ6ZCYNVKHBXKJASI3KN7GDJOVSZ6Q, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.310479056 (338h51m36.081120391s) [noise=true , address=104.36.82.12:4150 , piece_id=JVWXXQE2KUCN7TAEJPMXNJ53EASYQSF7BDLET74FKJ42U4O54HLQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.319958452 (338h51m36.090599787s) [noise=true , address=104.36.82.11:4113 , piece_id=TRHOT32ONTK5AHYGBOKUWOPSLJSOEZHWM7I2BEF35B6I2CK62TKA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.345635898 (338h51m36.116277243s) [noise=true , address=45.91.116.11:4118 , piece_id=OH3XLDA6VDWB66QSJ7R3Y5TTMNARBDXS7MPLFDFKNSP7QZX76EGQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.348221234 (338h51m36.118862569s) [noise=true , address=45.91.116.9:4262 , piece_id=NPP4NPDONFYKTDJQKC5XPJPNEKKLYRAPHPNE2WKI3KOKG3VJWEKA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.379148724 (338h51m36.149790069s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXAIRV6KPBEKHHT2WHTV7RFBZZX2M42BSDX34IICONNVFD2H4MPA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.379665763 (338h51m36.150307098s) [noise=true , address=77.90.31.10:4517 , piece_id=3YDX4SEJC372T64RTATEJFPBJBNOVGWE5QME2L6N2MWVWUN2P7ZQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.383550435 (338h51m36.15419178s) [noise=true , address=77.90.31.13:4626 , piece_id=FMDUEB4OUQSGOWWO4LL6XIGKZFKU6ZFJDY7UJPTPRBU57OZIPXSA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.383582847 (338h51m36.154224182s) [seg_pos={0 0}, upload=271070]: Segment reached optimal threshold of 13 pieces. Jul 7 12:02:01.383717544 (338h51m36.15435888s) [noise=true , address=77.90.31.12:4592 , piece_id=3K4UALXEA6HXATI7MAEK3TF2BSKRS4FTORIKFQUWALIENJ7ROGZA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Jul 7 12:02:01.385367622 (338h51m36.156008967s) [noise=true , address=77.90.31.18:4807 , piece_id=JSZN5WN4HQN2JGFIJYMVFPDELMH67OU2UBGBWN7EYZ723NRNGX2Q, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.385867197 (338h51m36.156508542s) [noise=true , address=104.36.82.14:4223 , piece_id=4SKO77JRLCKZIJOA2S2ED3DHHDX4N6POWUIMJSOQNJQRP5SBRP2A, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.386478106 (338h51m36.157119451s) [seg_pos={0 0}, upload=271070]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jul 7 12:02:01.386554532 (338h51m36.157195867s) [upload=271070]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 12:02:01.386559752 (338h51m36.157201097s) [upload=271070]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 12:03:12.051066824 (338h52m46.821708159s) [upload=271070]: Done uploading segments... Jul 7 12:03:12.051087384 (338h52m46.821728719s) [upload=271070]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.721211749s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 5.668563543s FAIL (2025-07-07 12:34:52 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece_id=76E2UENIVWN6TTA3YD57X6CPVI366A2SNYQX6HTSGVLG6M4CCAZA, seg_pos={0 0}, upload=271062]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Jul 7 12:01:23.222432903 (338h50m57.993074238s) [noise=true , address=104.36.82.10:4078 , piece_id=RHOTQBNCH5MUDYCPQ37YGYX5BZNHTMO6BH43VCNYORRRU75RTWWQ, seg_pos={0 0}, upload=271062]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF Jul 7 12:01:23.222453401 (338h50m57.993094736s) [seg_pos={0 0}, upload=271062]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 12:01:23.222512745 (338h50m57.993154081s) [upload=271062]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 12:01:23.222516733 (338h50m57.993158068s) [upload=271062]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 12:01:23.524023810 (338h50m58.294665165s) [upload=271062]: Done uploading segments... Jul 7 12:01:23.524047065 (338h50m58.29468841s) [upload=271062]: Upload finished. err: <nil> Jul 7 12:01:59.027955412 (338h51m33.798596747s) [upload=271070]: Starting upload Jul 7 12:01:59.028075351 (338h51m33.798716696s) [upload=271070]: Done starting upload Jul 7 12:01:59.028139976 (338h51m33.798781311s) [upload=271070]: Uploading segments... Jul 7 12:01:59.028299931 (338h51m33.798941266s) [upload=271070]: Got next segment. Inline: false Jul 7 12:01:59.028416515 (338h51m33.79905785s) [upload=271070]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 7 12:01:59.028422416 (338h51m33.799063761s) [upload=271070]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 7 12:01:59.261880873 (338h51m34.032522218s) [seg_pos={0 0}, upload=271070]: Begin upload segment... Jul 7 12:01:59.261985924 (338h51m34.03262726s) [noise=true , address=104.36.82.9:4005 , piece_id=TZ43ZHEMJNM6P4IPJMMARHLKEX2FHTBIEFBY43IB6AAAEJMDCQNA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262067471 (338h51m34.032708816s) [noise=true , address=77.90.31.10:4517 , piece_id=3YDX4SEJC372T64RTATEJFPBJBNOVGWE5QME2L6N2MWVWUN2P7ZQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262498215 (338h51m34.03313955s) [noise=true , address=104.36.82.15:4258 , piece_id=G7UJATYPZXGE7AA2EVASTD2QXUW2F5J3N2UXSEZF23ZF5GWQJMKQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262520607 (338h51m34.033161952s) [noise=true , address=104.36.82.15:4259 , piece_id=MYFFPHWVFEKH6PPXJB5BYJZUCHPGIBOHTM6BNN4U3WGXVIHOD4YA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262795914 (338h51m34.033437249s) [seg_pos={0 0}, upload=271070]: Done begin upload segment. Jul 7 12:01:59.262857242 (338h51m34.033498577s) [noise=true , address=45.91.116.11:4118 , piece_id=OH3XLDA6VDWB66QSJ7R3Y5TTMNARBDXS7MPLFDFKNSP7QZX76EGQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.263419457 (338h51m34.034060792s) [noise=true , address=104.36.82.10:4077 , piece_id=ZPX674LYZ7BTO2MV7T2SXNMYXLDZJ7BC64DG2XDIFJTVYMTBFRGQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.263698150 (338h51m34.034339485s) [noise=true , address=104.36.82.3:4767 , piece_id=C5FKFSEABS2TO7GGPXU4J44NHKHYP7KFJZA6HNHHOETWQ6PODG4Q, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264015678 (338h51m34.034657013s) [noise=true , address=77.90.31.18:4807 , piece_id=JSZN5WN4HQN2JGFIJYMVFPDELMH67OU2UBGBWN7EYZ723NRNGX2Q, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264312575 (338h51m34.03495391s) [noise=true , address=104.36.82.12:4150 , piece_id=JVWXXQE2KUCN7TAEJPMXNJ53EASYQSF7BDLET74FKJ42U4O54HLQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264672153 (338h51m34.035313488s) [noise=true , address=104.36.82.16:4294 , piece_id=CNFTWMXOAONQYFMJVQAYU4FQ6ZCYNVKHBXKJASI3KN7GDJOVSZ6Q, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264999710 (338h51m34.035641045s) [noise=true , address=77.90.31.13:4626 , piece_id=FMDUEB4OUQSGOWWO4LL6XIGKZFKU6ZFJDY7UJPTPRBU57OZIPXSA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.265238698 (338h51m34.035880053s) [noise=true , address=104.36.82.11:4113 , piece_id=TRHOT32ONTK5AHYGBOKUWOPSLJSOEZHWM7I2BEF35B6I2CK62TKA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.265691123 (338h51m34.036332468s) [noise=true , address=104.36.82.14:4223 , piece_id=4SKO77JRLCKZIJOA2S2ED3DHHDX4N6POWUIMJSOQNJQRP5SBRP2A, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.266330596 (338h51m34.036971931s) [noise=true , address=77.90.31.12:4592 , piece_id=3K4UALXEA6HXATI7MAEK3TF2BSKRS4FTORIKFQUWALIENJ7ROGZA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.266671569 (338h51m34.037312914s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXAIRV6KPBEKHHT2WHTV7RFBZZX2M42BSDX34IICONNVFD2H4MPA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.267012862 (338h51m34.037654207s) [noise=true , address=45.91.116.9:4262 , piece_id=NPP4NPDONFYKTDJQKC5XPJPNEKKLYRAPHPNE2WKI3KOKG3VJWEKA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:02:00.922180841 (338h51m35.692822176s) [upload=271070]: Next returned nil segment Jul 7 12:02:00.922208914 (338h51m35.692850249s) [upload=271070]: Waiting for error group managing segments... Jul 7 12:02:01.187253453 (338h51m35.957894788s) [noise=true , address=104.36.82.15:4259 , piece_id=MYFFPHWVFEKH6PPXJB5BYJZUCHPGIBOHTM6BNN4U3WGXVIHOD4YA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.251407842 (338h51m36.022049177s) [noise=true , address=104.36.82.15:4258 , piece_id=G7UJATYPZXGE7AA2EVASTD2QXUW2F5J3N2UXSEZF23ZF5GWQJMKQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.260774924 (338h51m36.031416259s) [noise=true , address=104.36.82.9:4005 , piece_id=TZ43ZHEMJNM6P4IPJMMARHLKEX2FHTBIEFBY43IB6AAAEJMDCQNA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.275440331 (338h51m36.046081666s) [noise=true , address=104.36.82.3:4767 , piece_id=C5FKFSEABS2TO7GGPXU4J44NHKHYP7KFJZA6HNHHOETWQ6PODG4Q, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.292891458 (338h51m36.063532813s) [noise=true , address=104.36.82.10:4077 , piece_id=ZPX674LYZ7BTO2MV7T2SXNMYXLDZJ7BC64DG2XDIFJTVYMTBFRGQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.294071356 (338h51m36.064712701s) [noise=true , address=104.36.82.16:4294 , piece_id=CNFTWMXOAONQYFMJVQAYU4FQ6ZCYNVKHBXKJASI3KN7GDJOVSZ6Q, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.310479056 (338h51m36.081120391s) [noise=true , address=104.36.82.12:4150 , piece_id=JVWXXQE2KUCN7TAEJPMXNJ53EASYQSF7BDLET74FKJ42U4O54HLQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.319958452 (338h51m36.090599787s) [noise=true , address=104.36.82.11:4113 , piece_id=TRHOT32ONTK5AHYGBOKUWOPSLJSOEZHWM7I2BEF35B6I2CK62TKA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.345635898 (338h51m36.116277243s) [noise=true , address=45.91.116.11:4118 , piece_id=OH3XLDA6VDWB66QSJ7R3Y5TTMNARBDXS7MPLFDFKNSP7QZX76EGQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.348221234 (338h51m36.118862569s) [noise=true , address=45.91.116.9:4262 , piece_id=NPP4NPDONFYKTDJQKC5XPJPNEKKLYRAPHPNE2WKI3KOKG3VJWEKA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.379148724 (338h51m36.149790069s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXAIRV6KPBEKHHT2WHTV7RFBZZX2M42BSDX34IICONNVFD2H4MPA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.379665763 (338h51m36.150307098s) [noise=true , address=77.90.31.10:4517 , piece_id=3YDX4SEJC372T64RTATEJFPBJBNOVGWE5QME2L6N2MWVWUN2P7ZQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.383550435 (338h51m36.15419178s) [noise=true , address=77.90.31.13:4626 , piece_id=FMDUEB4OUQSGOWWO4LL6XIGKZFKU6ZFJDY7UJPTPRBU57OZIPXSA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.383582847 (338h51m36.154224182s) [seg_pos={0 0}, upload=271070]: Segment reached optimal threshold of 13 pieces. Jul 7 12:02:01.383717544 (338h51m36.15435888s) [noise=true , address=77.90.31.12:4592 , piece_id=3K4UALXEA6HXATI7MAEK3TF2BSKRS4FTORIKFQUWALIENJ7ROGZA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Jul 7 12:02:01.385367622 (338h51m36.156008967s) [noise=true , address=77.90.31.18:4807 , piece_id=JSZN5WN4HQN2JGFIJYMVFPDELMH67OU2UBGBWN7EYZ723NRNGX2Q, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.385867197 (338h51m36.156508542s) [noise=true , address=104.36.82.14:4223 , piece_id=4SKO77JRLCKZIJOA2S2ED3DHHDX4N6POWUIMJSOQNJQRP5SBRP2A, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.386478106 (338h51m36.157119451s) [seg_pos={0 0}, upload=271070]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jul 7 12:02:01.386554532 (338h51m36.157195867s) [upload=271070]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 12:02:01.386559752 (338h51m36.157201097s) [upload=271070]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 12:03:12.051066824 (338h52m46.821708159s) [upload=271070]: Done uploading segments... Jul 7 12:03:12.051087384 (338h52m46.821728719s) [upload=271070]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.668591675s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 5.637728809s FAIL (2025-07-07 12:34:32 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece_id=76E2UENIVWN6TTA3YD57X6CPVI366A2SNYQX6HTSGVLG6M4CCAZA, seg_pos={0 0}, upload=271062]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Jul 7 12:01:23.222432903 (338h50m57.993074238s) [noise=true , address=104.36.82.10:4078 , piece_id=RHOTQBNCH5MUDYCPQ37YGYX5BZNHTMO6BH43VCNYORRRU75RTWWQ, seg_pos={0 0}, upload=271062]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF Jul 7 12:01:23.222453401 (338h50m57.993094736s) [seg_pos={0 0}, upload=271062]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 12:01:23.222512745 (338h50m57.993154081s) [upload=271062]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 12:01:23.222516733 (338h50m57.993158068s) [upload=271062]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 12:01:23.524023810 (338h50m58.294665165s) [upload=271062]: Done uploading segments... Jul 7 12:01:23.524047065 (338h50m58.29468841s) [upload=271062]: Upload finished. err: <nil> Jul 7 12:01:59.027955412 (338h51m33.798596747s) [upload=271070]: Starting upload Jul 7 12:01:59.028075351 (338h51m33.798716696s) [upload=271070]: Done starting upload Jul 7 12:01:59.028139976 (338h51m33.798781311s) [upload=271070]: Uploading segments... Jul 7 12:01:59.028299931 (338h51m33.798941266s) [upload=271070]: Got next segment. Inline: false Jul 7 12:01:59.028416515 (338h51m33.79905785s) [upload=271070]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 7 12:01:59.028422416 (338h51m33.799063761s) [upload=271070]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 7 12:01:59.261880873 (338h51m34.032522218s) [seg_pos={0 0}, upload=271070]: Begin upload segment... Jul 7 12:01:59.261985924 (338h51m34.03262726s) [noise=true , address=104.36.82.9:4005 , piece_id=TZ43ZHEMJNM6P4IPJMMARHLKEX2FHTBIEFBY43IB6AAAEJMDCQNA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262067471 (338h51m34.032708816s) [noise=true , address=77.90.31.10:4517 , piece_id=3YDX4SEJC372T64RTATEJFPBJBNOVGWE5QME2L6N2MWVWUN2P7ZQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262498215 (338h51m34.03313955s) [noise=true , address=104.36.82.15:4258 , piece_id=G7UJATYPZXGE7AA2EVASTD2QXUW2F5J3N2UXSEZF23ZF5GWQJMKQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262520607 (338h51m34.033161952s) [noise=true , address=104.36.82.15:4259 , piece_id=MYFFPHWVFEKH6PPXJB5BYJZUCHPGIBOHTM6BNN4U3WGXVIHOD4YA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262795914 (338h51m34.033437249s) [seg_pos={0 0}, upload=271070]: Done begin upload segment. Jul 7 12:01:59.262857242 (338h51m34.033498577s) [noise=true , address=45.91.116.11:4118 , piece_id=OH3XLDA6VDWB66QSJ7R3Y5TTMNARBDXS7MPLFDFKNSP7QZX76EGQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.263419457 (338h51m34.034060792s) [noise=true , address=104.36.82.10:4077 , piece_id=ZPX674LYZ7BTO2MV7T2SXNMYXLDZJ7BC64DG2XDIFJTVYMTBFRGQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.263698150 (338h51m34.034339485s) [noise=true , address=104.36.82.3:4767 , piece_id=C5FKFSEABS2TO7GGPXU4J44NHKHYP7KFJZA6HNHHOETWQ6PODG4Q, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264015678 (338h51m34.034657013s) [noise=true , address=77.90.31.18:4807 , piece_id=JSZN5WN4HQN2JGFIJYMVFPDELMH67OU2UBGBWN7EYZ723NRNGX2Q, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264312575 (338h51m34.03495391s) [noise=true , address=104.36.82.12:4150 , piece_id=JVWXXQE2KUCN7TAEJPMXNJ53EASYQSF7BDLET74FKJ42U4O54HLQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264672153 (338h51m34.035313488s) [noise=true , address=104.36.82.16:4294 , piece_id=CNFTWMXOAONQYFMJVQAYU4FQ6ZCYNVKHBXKJASI3KN7GDJOVSZ6Q, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264999710 (338h51m34.035641045s) [noise=true , address=77.90.31.13:4626 , piece_id=FMDUEB4OUQSGOWWO4LL6XIGKZFKU6ZFJDY7UJPTPRBU57OZIPXSA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.265238698 (338h51m34.035880053s) [noise=true , address=104.36.82.11:4113 , piece_id=TRHOT32ONTK5AHYGBOKUWOPSLJSOEZHWM7I2BEF35B6I2CK62TKA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.265691123 (338h51m34.036332468s) [noise=true , address=104.36.82.14:4223 , piece_id=4SKO77JRLCKZIJOA2S2ED3DHHDX4N6POWUIMJSOQNJQRP5SBRP2A, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.266330596 (338h51m34.036971931s) [noise=true , address=77.90.31.12:4592 , piece_id=3K4UALXEA6HXATI7MAEK3TF2BSKRS4FTORIKFQUWALIENJ7ROGZA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.266671569 (338h51m34.037312914s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXAIRV6KPBEKHHT2WHTV7RFBZZX2M42BSDX34IICONNVFD2H4MPA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.267012862 (338h51m34.037654207s) [noise=true , address=45.91.116.9:4262 , piece_id=NPP4NPDONFYKTDJQKC5XPJPNEKKLYRAPHPNE2WKI3KOKG3VJWEKA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:02:00.922180841 (338h51m35.692822176s) [upload=271070]: Next returned nil segment Jul 7 12:02:00.922208914 (338h51m35.692850249s) [upload=271070]: Waiting for error group managing segments... Jul 7 12:02:01.187253453 (338h51m35.957894788s) [noise=true , address=104.36.82.15:4259 , piece_id=MYFFPHWVFEKH6PPXJB5BYJZUCHPGIBOHTM6BNN4U3WGXVIHOD4YA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.251407842 (338h51m36.022049177s) [noise=true , address=104.36.82.15:4258 , piece_id=G7UJATYPZXGE7AA2EVASTD2QXUW2F5J3N2UXSEZF23ZF5GWQJMKQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.260774924 (338h51m36.031416259s) [noise=true , address=104.36.82.9:4005 , piece_id=TZ43ZHEMJNM6P4IPJMMARHLKEX2FHTBIEFBY43IB6AAAEJMDCQNA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.275440331 (338h51m36.046081666s) [noise=true , address=104.36.82.3:4767 , piece_id=C5FKFSEABS2TO7GGPXU4J44NHKHYP7KFJZA6HNHHOETWQ6PODG4Q, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.292891458 (338h51m36.063532813s) [noise=true , address=104.36.82.10:4077 , piece_id=ZPX674LYZ7BTO2MV7T2SXNMYXLDZJ7BC64DG2XDIFJTVYMTBFRGQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.294071356 (338h51m36.064712701s) [noise=true , address=104.36.82.16:4294 , piece_id=CNFTWMXOAONQYFMJVQAYU4FQ6ZCYNVKHBXKJASI3KN7GDJOVSZ6Q, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.310479056 (338h51m36.081120391s) [noise=true , address=104.36.82.12:4150 , piece_id=JVWXXQE2KUCN7TAEJPMXNJ53EASYQSF7BDLET74FKJ42U4O54HLQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.319958452 (338h51m36.090599787s) [noise=true , address=104.36.82.11:4113 , piece_id=TRHOT32ONTK5AHYGBOKUWOPSLJSOEZHWM7I2BEF35B6I2CK62TKA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.345635898 (338h51m36.116277243s) [noise=true , address=45.91.116.11:4118 , piece_id=OH3XLDA6VDWB66QSJ7R3Y5TTMNARBDXS7MPLFDFKNSP7QZX76EGQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.348221234 (338h51m36.118862569s) [noise=true , address=45.91.116.9:4262 , piece_id=NPP4NPDONFYKTDJQKC5XPJPNEKKLYRAPHPNE2WKI3KOKG3VJWEKA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.379148724 (338h51m36.149790069s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXAIRV6KPBEKHHT2WHTV7RFBZZX2M42BSDX34IICONNVFD2H4MPA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.379665763 (338h51m36.150307098s) [noise=true , address=77.90.31.10:4517 , piece_id=3YDX4SEJC372T64RTATEJFPBJBNOVGWE5QME2L6N2MWVWUN2P7ZQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.383550435 (338h51m36.15419178s) [noise=true , address=77.90.31.13:4626 , piece_id=FMDUEB4OUQSGOWWO4LL6XIGKZFKU6ZFJDY7UJPTPRBU57OZIPXSA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.383582847 (338h51m36.154224182s) [seg_pos={0 0}, upload=271070]: Segment reached optimal threshold of 13 pieces. Jul 7 12:02:01.383717544 (338h51m36.15435888s) [noise=true , address=77.90.31.12:4592 , piece_id=3K4UALXEA6HXATI7MAEK3TF2BSKRS4FTORIKFQUWALIENJ7ROGZA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Jul 7 12:02:01.385367622 (338h51m36.156008967s) [noise=true , address=77.90.31.18:4807 , piece_id=JSZN5WN4HQN2JGFIJYMVFPDELMH67OU2UBGBWN7EYZ723NRNGX2Q, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.385867197 (338h51m36.156508542s) [noise=true , address=104.36.82.14:4223 , piece_id=4SKO77JRLCKZIJOA2S2ED3DHHDX4N6POWUIMJSOQNJQRP5SBRP2A, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.386478106 (338h51m36.157119451s) [seg_pos={0 0}, upload=271070]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jul 7 12:02:01.386554532 (338h51m36.157195867s) [upload=271070]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 12:02:01.386559752 (338h51m36.157201097s) [upload=271070]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 12:03:12.051066824 (338h52m46.821708159s) [upload=271070]: Done uploading segments... Jul 7 12:03:12.051087384 (338h52m46.821728719s) [upload=271070]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.637749178s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 5.681185058s FAIL (2025-07-07 12:33:40 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece_id=76E2UENIVWN6TTA3YD57X6CPVI366A2SNYQX6HTSGVLG6M4CCAZA, seg_pos={0 0}, upload=271062]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Jul 7 12:01:23.222432903 (338h50m57.993074238s) [noise=true , address=104.36.82.10:4078 , piece_id=RHOTQBNCH5MUDYCPQ37YGYX5BZNHTMO6BH43VCNYORRRU75RTWWQ, seg_pos={0 0}, upload=271062]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF Jul 7 12:01:23.222453401 (338h50m57.993094736s) [seg_pos={0 0}, upload=271062]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 12:01:23.222512745 (338h50m57.993154081s) [upload=271062]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 12:01:23.222516733 (338h50m57.993158068s) [upload=271062]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 12:01:23.524023810 (338h50m58.294665165s) [upload=271062]: Done uploading segments... Jul 7 12:01:23.524047065 (338h50m58.29468841s) [upload=271062]: Upload finished. err: <nil> Jul 7 12:01:59.027955412 (338h51m33.798596747s) [upload=271070]: Starting upload Jul 7 12:01:59.028075351 (338h51m33.798716696s) [upload=271070]: Done starting upload Jul 7 12:01:59.028139976 (338h51m33.798781311s) [upload=271070]: Uploading segments... Jul 7 12:01:59.028299931 (338h51m33.798941266s) [upload=271070]: Got next segment. Inline: false Jul 7 12:01:59.028416515 (338h51m33.79905785s) [upload=271070]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 7 12:01:59.028422416 (338h51m33.799063761s) [upload=271070]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 7 12:01:59.261880873 (338h51m34.032522218s) [seg_pos={0 0}, upload=271070]: Begin upload segment... Jul 7 12:01:59.261985924 (338h51m34.03262726s) [noise=true , address=104.36.82.9:4005 , piece_id=TZ43ZHEMJNM6P4IPJMMARHLKEX2FHTBIEFBY43IB6AAAEJMDCQNA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262067471 (338h51m34.032708816s) [noise=true , address=77.90.31.10:4517 , piece_id=3YDX4SEJC372T64RTATEJFPBJBNOVGWE5QME2L6N2MWVWUN2P7ZQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262498215 (338h51m34.03313955s) [noise=true , address=104.36.82.15:4258 , piece_id=G7UJATYPZXGE7AA2EVASTD2QXUW2F5J3N2UXSEZF23ZF5GWQJMKQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262520607 (338h51m34.033161952s) [noise=true , address=104.36.82.15:4259 , piece_id=MYFFPHWVFEKH6PPXJB5BYJZUCHPGIBOHTM6BNN4U3WGXVIHOD4YA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262795914 (338h51m34.033437249s) [seg_pos={0 0}, upload=271070]: Done begin upload segment. Jul 7 12:01:59.262857242 (338h51m34.033498577s) [noise=true , address=45.91.116.11:4118 , piece_id=OH3XLDA6VDWB66QSJ7R3Y5TTMNARBDXS7MPLFDFKNSP7QZX76EGQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.263419457 (338h51m34.034060792s) [noise=true , address=104.36.82.10:4077 , piece_id=ZPX674LYZ7BTO2MV7T2SXNMYXLDZJ7BC64DG2XDIFJTVYMTBFRGQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.263698150 (338h51m34.034339485s) [noise=true , address=104.36.82.3:4767 , piece_id=C5FKFSEABS2TO7GGPXU4J44NHKHYP7KFJZA6HNHHOETWQ6PODG4Q, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264015678 (338h51m34.034657013s) [noise=true , address=77.90.31.18:4807 , piece_id=JSZN5WN4HQN2JGFIJYMVFPDELMH67OU2UBGBWN7EYZ723NRNGX2Q, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264312575 (338h51m34.03495391s) [noise=true , address=104.36.82.12:4150 , piece_id=JVWXXQE2KUCN7TAEJPMXNJ53EASYQSF7BDLET74FKJ42U4O54HLQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264672153 (338h51m34.035313488s) [noise=true , address=104.36.82.16:4294 , piece_id=CNFTWMXOAONQYFMJVQAYU4FQ6ZCYNVKHBXKJASI3KN7GDJOVSZ6Q, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264999710 (338h51m34.035641045s) [noise=true , address=77.90.31.13:4626 , piece_id=FMDUEB4OUQSGOWWO4LL6XIGKZFKU6ZFJDY7UJPTPRBU57OZIPXSA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.265238698 (338h51m34.035880053s) [noise=true , address=104.36.82.11:4113 , piece_id=TRHOT32ONTK5AHYGBOKUWOPSLJSOEZHWM7I2BEF35B6I2CK62TKA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.265691123 (338h51m34.036332468s) [noise=true , address=104.36.82.14:4223 , piece_id=4SKO77JRLCKZIJOA2S2ED3DHHDX4N6POWUIMJSOQNJQRP5SBRP2A, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.266330596 (338h51m34.036971931s) [noise=true , address=77.90.31.12:4592 , piece_id=3K4UALXEA6HXATI7MAEK3TF2BSKRS4FTORIKFQUWALIENJ7ROGZA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.266671569 (338h51m34.037312914s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXAIRV6KPBEKHHT2WHTV7RFBZZX2M42BSDX34IICONNVFD2H4MPA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.267012862 (338h51m34.037654207s) [noise=true , address=45.91.116.9:4262 , piece_id=NPP4NPDONFYKTDJQKC5XPJPNEKKLYRAPHPNE2WKI3KOKG3VJWEKA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:02:00.922180841 (338h51m35.692822176s) [upload=271070]: Next returned nil segment Jul 7 12:02:00.922208914 (338h51m35.692850249s) [upload=271070]: Waiting for error group managing segments... Jul 7 12:02:01.187253453 (338h51m35.957894788s) [noise=true , address=104.36.82.15:4259 , piece_id=MYFFPHWVFEKH6PPXJB5BYJZUCHPGIBOHTM6BNN4U3WGXVIHOD4YA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.251407842 (338h51m36.022049177s) [noise=true , address=104.36.82.15:4258 , piece_id=G7UJATYPZXGE7AA2EVASTD2QXUW2F5J3N2UXSEZF23ZF5GWQJMKQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.260774924 (338h51m36.031416259s) [noise=true , address=104.36.82.9:4005 , piece_id=TZ43ZHEMJNM6P4IPJMMARHLKEX2FHTBIEFBY43IB6AAAEJMDCQNA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.275440331 (338h51m36.046081666s) [noise=true , address=104.36.82.3:4767 , piece_id=C5FKFSEABS2TO7GGPXU4J44NHKHYP7KFJZA6HNHHOETWQ6PODG4Q, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.292891458 (338h51m36.063532813s) [noise=true , address=104.36.82.10:4077 , piece_id=ZPX674LYZ7BTO2MV7T2SXNMYXLDZJ7BC64DG2XDIFJTVYMTBFRGQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.294071356 (338h51m36.064712701s) [noise=true , address=104.36.82.16:4294 , piece_id=CNFTWMXOAONQYFMJVQAYU4FQ6ZCYNVKHBXKJASI3KN7GDJOVSZ6Q, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.310479056 (338h51m36.081120391s) [noise=true , address=104.36.82.12:4150 , piece_id=JVWXXQE2KUCN7TAEJPMXNJ53EASYQSF7BDLET74FKJ42U4O54HLQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.319958452 (338h51m36.090599787s) [noise=true , address=104.36.82.11:4113 , piece_id=TRHOT32ONTK5AHYGBOKUWOPSLJSOEZHWM7I2BEF35B6I2CK62TKA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.345635898 (338h51m36.116277243s) [noise=true , address=45.91.116.11:4118 , piece_id=OH3XLDA6VDWB66QSJ7R3Y5TTMNARBDXS7MPLFDFKNSP7QZX76EGQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.348221234 (338h51m36.118862569s) [noise=true , address=45.91.116.9:4262 , piece_id=NPP4NPDONFYKTDJQKC5XPJPNEKKLYRAPHPNE2WKI3KOKG3VJWEKA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.379148724 (338h51m36.149790069s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXAIRV6KPBEKHHT2WHTV7RFBZZX2M42BSDX34IICONNVFD2H4MPA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.379665763 (338h51m36.150307098s) [noise=true , address=77.90.31.10:4517 , piece_id=3YDX4SEJC372T64RTATEJFPBJBNOVGWE5QME2L6N2MWVWUN2P7ZQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.383550435 (338h51m36.15419178s) [noise=true , address=77.90.31.13:4626 , piece_id=FMDUEB4OUQSGOWWO4LL6XIGKZFKU6ZFJDY7UJPTPRBU57OZIPXSA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.383582847 (338h51m36.154224182s) [seg_pos={0 0}, upload=271070]: Segment reached optimal threshold of 13 pieces. Jul 7 12:02:01.383717544 (338h51m36.15435888s) [noise=true , address=77.90.31.12:4592 , piece_id=3K4UALXEA6HXATI7MAEK3TF2BSKRS4FTORIKFQUWALIENJ7ROGZA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Jul 7 12:02:01.385367622 (338h51m36.156008967s) [noise=true , address=77.90.31.18:4807 , piece_id=JSZN5WN4HQN2JGFIJYMVFPDELMH67OU2UBGBWN7EYZ723NRNGX2Q, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.385867197 (338h51m36.156508542s) [noise=true , address=104.36.82.14:4223 , piece_id=4SKO77JRLCKZIJOA2S2ED3DHHDX4N6POWUIMJSOQNJQRP5SBRP2A, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.386478106 (338h51m36.157119451s) [seg_pos={0 0}, upload=271070]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jul 7 12:02:01.386554532 (338h51m36.157195867s) [upload=271070]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 12:02:01.386559752 (338h51m36.157201097s) [upload=271070]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 12:03:12.051066824 (338h52m46.821708159s) [upload=271070]: Done uploading segments... Jul 7 12:03:12.051087384 (338h52m46.821728719s) [upload=271070]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.681213702s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 5.65718385s FAIL (2025-07-07 12:32:40 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece_id=76E2UENIVWN6TTA3YD57X6CPVI366A2SNYQX6HTSGVLG6M4CCAZA, seg_pos={0 0}, upload=271062]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Jul 7 12:01:23.222432903 (338h50m57.993074238s) [noise=true , address=104.36.82.10:4078 , piece_id=RHOTQBNCH5MUDYCPQ37YGYX5BZNHTMO6BH43VCNYORRRU75RTWWQ, seg_pos={0 0}, upload=271062]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF Jul 7 12:01:23.222453401 (338h50m57.993094736s) [seg_pos={0 0}, upload=271062]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 12:01:23.222512745 (338h50m57.993154081s) [upload=271062]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 12:01:23.222516733 (338h50m57.993158068s) [upload=271062]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 12:01:23.524023810 (338h50m58.294665165s) [upload=271062]: Done uploading segments... Jul 7 12:01:23.524047065 (338h50m58.29468841s) [upload=271062]: Upload finished. err: <nil> Jul 7 12:01:59.027955412 (338h51m33.798596747s) [upload=271070]: Starting upload Jul 7 12:01:59.028075351 (338h51m33.798716696s) [upload=271070]: Done starting upload Jul 7 12:01:59.028139976 (338h51m33.798781311s) [upload=271070]: Uploading segments... Jul 7 12:01:59.028299931 (338h51m33.798941266s) [upload=271070]: Got next segment. Inline: false Jul 7 12:01:59.028416515 (338h51m33.79905785s) [upload=271070]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 7 12:01:59.028422416 (338h51m33.799063761s) [upload=271070]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 7 12:01:59.261880873 (338h51m34.032522218s) [seg_pos={0 0}, upload=271070]: Begin upload segment... Jul 7 12:01:59.261985924 (338h51m34.03262726s) [noise=true , address=104.36.82.9:4005 , piece_id=TZ43ZHEMJNM6P4IPJMMARHLKEX2FHTBIEFBY43IB6AAAEJMDCQNA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262067471 (338h51m34.032708816s) [noise=true , address=77.90.31.10:4517 , piece_id=3YDX4SEJC372T64RTATEJFPBJBNOVGWE5QME2L6N2MWVWUN2P7ZQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262498215 (338h51m34.03313955s) [noise=true , address=104.36.82.15:4258 , piece_id=G7UJATYPZXGE7AA2EVASTD2QXUW2F5J3N2UXSEZF23ZF5GWQJMKQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262520607 (338h51m34.033161952s) [noise=true , address=104.36.82.15:4259 , piece_id=MYFFPHWVFEKH6PPXJB5BYJZUCHPGIBOHTM6BNN4U3WGXVIHOD4YA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262795914 (338h51m34.033437249s) [seg_pos={0 0}, upload=271070]: Done begin upload segment. Jul 7 12:01:59.262857242 (338h51m34.033498577s) [noise=true , address=45.91.116.11:4118 , piece_id=OH3XLDA6VDWB66QSJ7R3Y5TTMNARBDXS7MPLFDFKNSP7QZX76EGQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.263419457 (338h51m34.034060792s) [noise=true , address=104.36.82.10:4077 , piece_id=ZPX674LYZ7BTO2MV7T2SXNMYXLDZJ7BC64DG2XDIFJTVYMTBFRGQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.263698150 (338h51m34.034339485s) [noise=true , address=104.36.82.3:4767 , piece_id=C5FKFSEABS2TO7GGPXU4J44NHKHYP7KFJZA6HNHHOETWQ6PODG4Q, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264015678 (338h51m34.034657013s) [noise=true , address=77.90.31.18:4807 , piece_id=JSZN5WN4HQN2JGFIJYMVFPDELMH67OU2UBGBWN7EYZ723NRNGX2Q, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264312575 (338h51m34.03495391s) [noise=true , address=104.36.82.12:4150 , piece_id=JVWXXQE2KUCN7TAEJPMXNJ53EASYQSF7BDLET74FKJ42U4O54HLQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264672153 (338h51m34.035313488s) [noise=true , address=104.36.82.16:4294 , piece_id=CNFTWMXOAONQYFMJVQAYU4FQ6ZCYNVKHBXKJASI3KN7GDJOVSZ6Q, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264999710 (338h51m34.035641045s) [noise=true , address=77.90.31.13:4626 , piece_id=FMDUEB4OUQSGOWWO4LL6XIGKZFKU6ZFJDY7UJPTPRBU57OZIPXSA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.265238698 (338h51m34.035880053s) [noise=true , address=104.36.82.11:4113 , piece_id=TRHOT32ONTK5AHYGBOKUWOPSLJSOEZHWM7I2BEF35B6I2CK62TKA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.265691123 (338h51m34.036332468s) [noise=true , address=104.36.82.14:4223 , piece_id=4SKO77JRLCKZIJOA2S2ED3DHHDX4N6POWUIMJSOQNJQRP5SBRP2A, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.266330596 (338h51m34.036971931s) [noise=true , address=77.90.31.12:4592 , piece_id=3K4UALXEA6HXATI7MAEK3TF2BSKRS4FTORIKFQUWALIENJ7ROGZA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.266671569 (338h51m34.037312914s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXAIRV6KPBEKHHT2WHTV7RFBZZX2M42BSDX34IICONNVFD2H4MPA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.267012862 (338h51m34.037654207s) [noise=true , address=45.91.116.9:4262 , piece_id=NPP4NPDONFYKTDJQKC5XPJPNEKKLYRAPHPNE2WKI3KOKG3VJWEKA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:02:00.922180841 (338h51m35.692822176s) [upload=271070]: Next returned nil segment Jul 7 12:02:00.922208914 (338h51m35.692850249s) [upload=271070]: Waiting for error group managing segments... Jul 7 12:02:01.187253453 (338h51m35.957894788s) [noise=true , address=104.36.82.15:4259 , piece_id=MYFFPHWVFEKH6PPXJB5BYJZUCHPGIBOHTM6BNN4U3WGXVIHOD4YA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.251407842 (338h51m36.022049177s) [noise=true , address=104.36.82.15:4258 , piece_id=G7UJATYPZXGE7AA2EVASTD2QXUW2F5J3N2UXSEZF23ZF5GWQJMKQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.260774924 (338h51m36.031416259s) [noise=true , address=104.36.82.9:4005 , piece_id=TZ43ZHEMJNM6P4IPJMMARHLKEX2FHTBIEFBY43IB6AAAEJMDCQNA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.275440331 (338h51m36.046081666s) [noise=true , address=104.36.82.3:4767 , piece_id=C5FKFSEABS2TO7GGPXU4J44NHKHYP7KFJZA6HNHHOETWQ6PODG4Q, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.292891458 (338h51m36.063532813s) [noise=true , address=104.36.82.10:4077 , piece_id=ZPX674LYZ7BTO2MV7T2SXNMYXLDZJ7BC64DG2XDIFJTVYMTBFRGQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.294071356 (338h51m36.064712701s) [noise=true , address=104.36.82.16:4294 , piece_id=CNFTWMXOAONQYFMJVQAYU4FQ6ZCYNVKHBXKJASI3KN7GDJOVSZ6Q, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.310479056 (338h51m36.081120391s) [noise=true , address=104.36.82.12:4150 , piece_id=JVWXXQE2KUCN7TAEJPMXNJ53EASYQSF7BDLET74FKJ42U4O54HLQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.319958452 (338h51m36.090599787s) [noise=true , address=104.36.82.11:4113 , piece_id=TRHOT32ONTK5AHYGBOKUWOPSLJSOEZHWM7I2BEF35B6I2CK62TKA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.345635898 (338h51m36.116277243s) [noise=true , address=45.91.116.11:4118 , piece_id=OH3XLDA6VDWB66QSJ7R3Y5TTMNARBDXS7MPLFDFKNSP7QZX76EGQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.348221234 (338h51m36.118862569s) [noise=true , address=45.91.116.9:4262 , piece_id=NPP4NPDONFYKTDJQKC5XPJPNEKKLYRAPHPNE2WKI3KOKG3VJWEKA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.379148724 (338h51m36.149790069s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXAIRV6KPBEKHHT2WHTV7RFBZZX2M42BSDX34IICONNVFD2H4MPA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.379665763 (338h51m36.150307098s) [noise=true , address=77.90.31.10:4517 , piece_id=3YDX4SEJC372T64RTATEJFPBJBNOVGWE5QME2L6N2MWVWUN2P7ZQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.383550435 (338h51m36.15419178s) [noise=true , address=77.90.31.13:4626 , piece_id=FMDUEB4OUQSGOWWO4LL6XIGKZFKU6ZFJDY7UJPTPRBU57OZIPXSA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.383582847 (338h51m36.154224182s) [seg_pos={0 0}, upload=271070]: Segment reached optimal threshold of 13 pieces. Jul 7 12:02:01.383717544 (338h51m36.15435888s) [noise=true , address=77.90.31.12:4592 , piece_id=3K4UALXEA6HXATI7MAEK3TF2BSKRS4FTORIKFQUWALIENJ7ROGZA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Jul 7 12:02:01.385367622 (338h51m36.156008967s) [noise=true , address=77.90.31.18:4807 , piece_id=JSZN5WN4HQN2JGFIJYMVFPDELMH67OU2UBGBWN7EYZ723NRNGX2Q, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.385867197 (338h51m36.156508542s) [noise=true , address=104.36.82.14:4223 , piece_id=4SKO77JRLCKZIJOA2S2ED3DHHDX4N6POWUIMJSOQNJQRP5SBRP2A, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.386478106 (338h51m36.157119451s) [seg_pos={0 0}, upload=271070]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jul 7 12:02:01.386554532 (338h51m36.157195867s) [upload=271070]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 12:02:01.386559752 (338h51m36.157201097s) [upload=271070]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 12:03:12.051066824 (338h52m46.821708159s) [upload=271070]: Done uploading segments... Jul 7 12:03:12.051087384 (338h52m46.821728719s) [upload=271070]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.657208496s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 5.905033769s FAIL (2025-07-07 12:31:59 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece_id=76E2UENIVWN6TTA3YD57X6CPVI366A2SNYQX6HTSGVLG6M4CCAZA, seg_pos={0 0}, upload=271062]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Jul 7 12:01:23.222432903 (338h50m57.993074238s) [noise=true , address=104.36.82.10:4078 , piece_id=RHOTQBNCH5MUDYCPQ37YGYX5BZNHTMO6BH43VCNYORRRU75RTWWQ, seg_pos={0 0}, upload=271062]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF Jul 7 12:01:23.222453401 (338h50m57.993094736s) [seg_pos={0 0}, upload=271062]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 12:01:23.222512745 (338h50m57.993154081s) [upload=271062]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 12:01:23.222516733 (338h50m57.993158068s) [upload=271062]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 12:01:23.524023810 (338h50m58.294665165s) [upload=271062]: Done uploading segments... Jul 7 12:01:23.524047065 (338h50m58.29468841s) [upload=271062]: Upload finished. err: <nil> Jul 7 12:01:59.027955412 (338h51m33.798596747s) [upload=271070]: Starting upload Jul 7 12:01:59.028075351 (338h51m33.798716696s) [upload=271070]: Done starting upload Jul 7 12:01:59.028139976 (338h51m33.798781311s) [upload=271070]: Uploading segments... Jul 7 12:01:59.028299931 (338h51m33.798941266s) [upload=271070]: Got next segment. Inline: false Jul 7 12:01:59.028416515 (338h51m33.79905785s) [upload=271070]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 7 12:01:59.028422416 (338h51m33.799063761s) [upload=271070]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 7 12:01:59.261880873 (338h51m34.032522218s) [seg_pos={0 0}, upload=271070]: Begin upload segment... Jul 7 12:01:59.261985924 (338h51m34.03262726s) [noise=true , address=104.36.82.9:4005 , piece_id=TZ43ZHEMJNM6P4IPJMMARHLKEX2FHTBIEFBY43IB6AAAEJMDCQNA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262067471 (338h51m34.032708816s) [noise=true , address=77.90.31.10:4517 , piece_id=3YDX4SEJC372T64RTATEJFPBJBNOVGWE5QME2L6N2MWVWUN2P7ZQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262498215 (338h51m34.03313955s) [noise=true , address=104.36.82.15:4258 , piece_id=G7UJATYPZXGE7AA2EVASTD2QXUW2F5J3N2UXSEZF23ZF5GWQJMKQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262520607 (338h51m34.033161952s) [noise=true , address=104.36.82.15:4259 , piece_id=MYFFPHWVFEKH6PPXJB5BYJZUCHPGIBOHTM6BNN4U3WGXVIHOD4YA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262795914 (338h51m34.033437249s) [seg_pos={0 0}, upload=271070]: Done begin upload segment. Jul 7 12:01:59.262857242 (338h51m34.033498577s) [noise=true , address=45.91.116.11:4118 , piece_id=OH3XLDA6VDWB66QSJ7R3Y5TTMNARBDXS7MPLFDFKNSP7QZX76EGQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.263419457 (338h51m34.034060792s) [noise=true , address=104.36.82.10:4077 , piece_id=ZPX674LYZ7BTO2MV7T2SXNMYXLDZJ7BC64DG2XDIFJTVYMTBFRGQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.263698150 (338h51m34.034339485s) [noise=true , address=104.36.82.3:4767 , piece_id=C5FKFSEABS2TO7GGPXU4J44NHKHYP7KFJZA6HNHHOETWQ6PODG4Q, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264015678 (338h51m34.034657013s) [noise=true , address=77.90.31.18:4807 , piece_id=JSZN5WN4HQN2JGFIJYMVFPDELMH67OU2UBGBWN7EYZ723NRNGX2Q, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264312575 (338h51m34.03495391s) [noise=true , address=104.36.82.12:4150 , piece_id=JVWXXQE2KUCN7TAEJPMXNJ53EASYQSF7BDLET74FKJ42U4O54HLQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264672153 (338h51m34.035313488s) [noise=true , address=104.36.82.16:4294 , piece_id=CNFTWMXOAONQYFMJVQAYU4FQ6ZCYNVKHBXKJASI3KN7GDJOVSZ6Q, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264999710 (338h51m34.035641045s) [noise=true , address=77.90.31.13:4626 , piece_id=FMDUEB4OUQSGOWWO4LL6XIGKZFKU6ZFJDY7UJPTPRBU57OZIPXSA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.265238698 (338h51m34.035880053s) [noise=true , address=104.36.82.11:4113 , piece_id=TRHOT32ONTK5AHYGBOKUWOPSLJSOEZHWM7I2BEF35B6I2CK62TKA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.265691123 (338h51m34.036332468s) [noise=true , address=104.36.82.14:4223 , piece_id=4SKO77JRLCKZIJOA2S2ED3DHHDX4N6POWUIMJSOQNJQRP5SBRP2A, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.266330596 (338h51m34.036971931s) [noise=true , address=77.90.31.12:4592 , piece_id=3K4UALXEA6HXATI7MAEK3TF2BSKRS4FTORIKFQUWALIENJ7ROGZA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.266671569 (338h51m34.037312914s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXAIRV6KPBEKHHT2WHTV7RFBZZX2M42BSDX34IICONNVFD2H4MPA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.267012862 (338h51m34.037654207s) [noise=true , address=45.91.116.9:4262 , piece_id=NPP4NPDONFYKTDJQKC5XPJPNEKKLYRAPHPNE2WKI3KOKG3VJWEKA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:02:00.922180841 (338h51m35.692822176s) [upload=271070]: Next returned nil segment Jul 7 12:02:00.922208914 (338h51m35.692850249s) [upload=271070]: Waiting for error group managing segments... Jul 7 12:02:01.187253453 (338h51m35.957894788s) [noise=true , address=104.36.82.15:4259 , piece_id=MYFFPHWVFEKH6PPXJB5BYJZUCHPGIBOHTM6BNN4U3WGXVIHOD4YA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.251407842 (338h51m36.022049177s) [noise=true , address=104.36.82.15:4258 , piece_id=G7UJATYPZXGE7AA2EVASTD2QXUW2F5J3N2UXSEZF23ZF5GWQJMKQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.260774924 (338h51m36.031416259s) [noise=true , address=104.36.82.9:4005 , piece_id=TZ43ZHEMJNM6P4IPJMMARHLKEX2FHTBIEFBY43IB6AAAEJMDCQNA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.275440331 (338h51m36.046081666s) [noise=true , address=104.36.82.3:4767 , piece_id=C5FKFSEABS2TO7GGPXU4J44NHKHYP7KFJZA6HNHHOETWQ6PODG4Q, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.292891458 (338h51m36.063532813s) [noise=true , address=104.36.82.10:4077 , piece_id=ZPX674LYZ7BTO2MV7T2SXNMYXLDZJ7BC64DG2XDIFJTVYMTBFRGQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.294071356 (338h51m36.064712701s) [noise=true , address=104.36.82.16:4294 , piece_id=CNFTWMXOAONQYFMJVQAYU4FQ6ZCYNVKHBXKJASI3KN7GDJOVSZ6Q, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.310479056 (338h51m36.081120391s) [noise=true , address=104.36.82.12:4150 , piece_id=JVWXXQE2KUCN7TAEJPMXNJ53EASYQSF7BDLET74FKJ42U4O54HLQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.319958452 (338h51m36.090599787s) [noise=true , address=104.36.82.11:4113 , piece_id=TRHOT32ONTK5AHYGBOKUWOPSLJSOEZHWM7I2BEF35B6I2CK62TKA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.345635898 (338h51m36.116277243s) [noise=true , address=45.91.116.11:4118 , piece_id=OH3XLDA6VDWB66QSJ7R3Y5TTMNARBDXS7MPLFDFKNSP7QZX76EGQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.348221234 (338h51m36.118862569s) [noise=true , address=45.91.116.9:4262 , piece_id=NPP4NPDONFYKTDJQKC5XPJPNEKKLYRAPHPNE2WKI3KOKG3VJWEKA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.379148724 (338h51m36.149790069s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXAIRV6KPBEKHHT2WHTV7RFBZZX2M42BSDX34IICONNVFD2H4MPA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.379665763 (338h51m36.150307098s) [noise=true , address=77.90.31.10:4517 , piece_id=3YDX4SEJC372T64RTATEJFPBJBNOVGWE5QME2L6N2MWVWUN2P7ZQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.383550435 (338h51m36.15419178s) [noise=true , address=77.90.31.13:4626 , piece_id=FMDUEB4OUQSGOWWO4LL6XIGKZFKU6ZFJDY7UJPTPRBU57OZIPXSA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.383582847 (338h51m36.154224182s) [seg_pos={0 0}, upload=271070]: Segment reached optimal threshold of 13 pieces. Jul 7 12:02:01.383717544 (338h51m36.15435888s) [noise=true , address=77.90.31.12:4592 , piece_id=3K4UALXEA6HXATI7MAEK3TF2BSKRS4FTORIKFQUWALIENJ7ROGZA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Jul 7 12:02:01.385367622 (338h51m36.156008967s) [noise=true , address=77.90.31.18:4807 , piece_id=JSZN5WN4HQN2JGFIJYMVFPDELMH67OU2UBGBWN7EYZ723NRNGX2Q, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.385867197 (338h51m36.156508542s) [noise=true , address=104.36.82.14:4223 , piece_id=4SKO77JRLCKZIJOA2S2ED3DHHDX4N6POWUIMJSOQNJQRP5SBRP2A, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.386478106 (338h51m36.157119451s) [seg_pos={0 0}, upload=271070]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jul 7 12:02:01.386554532 (338h51m36.157195867s) [upload=271070]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 12:02:01.386559752 (338h51m36.157201097s) [upload=271070]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 12:03:12.051066824 (338h52m46.821708159s) [upload=271070]: Done uploading segments... Jul 7 12:03:12.051087384 (338h52m46.821728719s) [upload=271070]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.905066632s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 5.652039499s FAIL (2025-07-07 12:31:23 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece_id=76E2UENIVWN6TTA3YD57X6CPVI366A2SNYQX6HTSGVLG6M4CCAZA, seg_pos={0 0}, upload=271062]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Jul 7 12:01:23.222432903 (338h50m57.993074238s) [noise=true , address=104.36.82.10:4078 , piece_id=RHOTQBNCH5MUDYCPQ37YGYX5BZNHTMO6BH43VCNYORRRU75RTWWQ, seg_pos={0 0}, upload=271062]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF Jul 7 12:01:23.222453401 (338h50m57.993094736s) [seg_pos={0 0}, upload=271062]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 12:01:23.222512745 (338h50m57.993154081s) [upload=271062]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 12:01:23.222516733 (338h50m57.993158068s) [upload=271062]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 12:01:23.524023810 (338h50m58.294665165s) [upload=271062]: Done uploading segments... Jul 7 12:01:23.524047065 (338h50m58.29468841s) [upload=271062]: Upload finished. err: <nil> Jul 7 12:01:59.027955412 (338h51m33.798596747s) [upload=271070]: Starting upload Jul 7 12:01:59.028075351 (338h51m33.798716696s) [upload=271070]: Done starting upload Jul 7 12:01:59.028139976 (338h51m33.798781311s) [upload=271070]: Uploading segments... Jul 7 12:01:59.028299931 (338h51m33.798941266s) [upload=271070]: Got next segment. Inline: false Jul 7 12:01:59.028416515 (338h51m33.79905785s) [upload=271070]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 7 12:01:59.028422416 (338h51m33.799063761s) [upload=271070]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 7 12:01:59.261880873 (338h51m34.032522218s) [seg_pos={0 0}, upload=271070]: Begin upload segment... Jul 7 12:01:59.261985924 (338h51m34.03262726s) [noise=true , address=104.36.82.9:4005 , piece_id=TZ43ZHEMJNM6P4IPJMMARHLKEX2FHTBIEFBY43IB6AAAEJMDCQNA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262067471 (338h51m34.032708816s) [noise=true , address=77.90.31.10:4517 , piece_id=3YDX4SEJC372T64RTATEJFPBJBNOVGWE5QME2L6N2MWVWUN2P7ZQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262498215 (338h51m34.03313955s) [noise=true , address=104.36.82.15:4258 , piece_id=G7UJATYPZXGE7AA2EVASTD2QXUW2F5J3N2UXSEZF23ZF5GWQJMKQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262520607 (338h51m34.033161952s) [noise=true , address=104.36.82.15:4259 , piece_id=MYFFPHWVFEKH6PPXJB5BYJZUCHPGIBOHTM6BNN4U3WGXVIHOD4YA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262795914 (338h51m34.033437249s) [seg_pos={0 0}, upload=271070]: Done begin upload segment. Jul 7 12:01:59.262857242 (338h51m34.033498577s) [noise=true , address=45.91.116.11:4118 , piece_id=OH3XLDA6VDWB66QSJ7R3Y5TTMNARBDXS7MPLFDFKNSP7QZX76EGQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.263419457 (338h51m34.034060792s) [noise=true , address=104.36.82.10:4077 , piece_id=ZPX674LYZ7BTO2MV7T2SXNMYXLDZJ7BC64DG2XDIFJTVYMTBFRGQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.263698150 (338h51m34.034339485s) [noise=true , address=104.36.82.3:4767 , piece_id=C5FKFSEABS2TO7GGPXU4J44NHKHYP7KFJZA6HNHHOETWQ6PODG4Q, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264015678 (338h51m34.034657013s) [noise=true , address=77.90.31.18:4807 , piece_id=JSZN5WN4HQN2JGFIJYMVFPDELMH67OU2UBGBWN7EYZ723NRNGX2Q, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264312575 (338h51m34.03495391s) [noise=true , address=104.36.82.12:4150 , piece_id=JVWXXQE2KUCN7TAEJPMXNJ53EASYQSF7BDLET74FKJ42U4O54HLQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264672153 (338h51m34.035313488s) [noise=true , address=104.36.82.16:4294 , piece_id=CNFTWMXOAONQYFMJVQAYU4FQ6ZCYNVKHBXKJASI3KN7GDJOVSZ6Q, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264999710 (338h51m34.035641045s) [noise=true , address=77.90.31.13:4626 , piece_id=FMDUEB4OUQSGOWWO4LL6XIGKZFKU6ZFJDY7UJPTPRBU57OZIPXSA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.265238698 (338h51m34.035880053s) [noise=true , address=104.36.82.11:4113 , piece_id=TRHOT32ONTK5AHYGBOKUWOPSLJSOEZHWM7I2BEF35B6I2CK62TKA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.265691123 (338h51m34.036332468s) [noise=true , address=104.36.82.14:4223 , piece_id=4SKO77JRLCKZIJOA2S2ED3DHHDX4N6POWUIMJSOQNJQRP5SBRP2A, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.266330596 (338h51m34.036971931s) [noise=true , address=77.90.31.12:4592 , piece_id=3K4UALXEA6HXATI7MAEK3TF2BSKRS4FTORIKFQUWALIENJ7ROGZA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.266671569 (338h51m34.037312914s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXAIRV6KPBEKHHT2WHTV7RFBZZX2M42BSDX34IICONNVFD2H4MPA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.267012862 (338h51m34.037654207s) [noise=true , address=45.91.116.9:4262 , piece_id=NPP4NPDONFYKTDJQKC5XPJPNEKKLYRAPHPNE2WKI3KOKG3VJWEKA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:02:00.922180841 (338h51m35.692822176s) [upload=271070]: Next returned nil segment Jul 7 12:02:00.922208914 (338h51m35.692850249s) [upload=271070]: Waiting for error group managing segments... Jul 7 12:02:01.187253453 (338h51m35.957894788s) [noise=true , address=104.36.82.15:4259 , piece_id=MYFFPHWVFEKH6PPXJB5BYJZUCHPGIBOHTM6BNN4U3WGXVIHOD4YA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.251407842 (338h51m36.022049177s) [noise=true , address=104.36.82.15:4258 , piece_id=G7UJATYPZXGE7AA2EVASTD2QXUW2F5J3N2UXSEZF23ZF5GWQJMKQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.260774924 (338h51m36.031416259s) [noise=true , address=104.36.82.9:4005 , piece_id=TZ43ZHEMJNM6P4IPJMMARHLKEX2FHTBIEFBY43IB6AAAEJMDCQNA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.275440331 (338h51m36.046081666s) [noise=true , address=104.36.82.3:4767 , piece_id=C5FKFSEABS2TO7GGPXU4J44NHKHYP7KFJZA6HNHHOETWQ6PODG4Q, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.292891458 (338h51m36.063532813s) [noise=true , address=104.36.82.10:4077 , piece_id=ZPX674LYZ7BTO2MV7T2SXNMYXLDZJ7BC64DG2XDIFJTVYMTBFRGQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.294071356 (338h51m36.064712701s) [noise=true , address=104.36.82.16:4294 , piece_id=CNFTWMXOAONQYFMJVQAYU4FQ6ZCYNVKHBXKJASI3KN7GDJOVSZ6Q, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.310479056 (338h51m36.081120391s) [noise=true , address=104.36.82.12:4150 , piece_id=JVWXXQE2KUCN7TAEJPMXNJ53EASYQSF7BDLET74FKJ42U4O54HLQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.319958452 (338h51m36.090599787s) [noise=true , address=104.36.82.11:4113 , piece_id=TRHOT32ONTK5AHYGBOKUWOPSLJSOEZHWM7I2BEF35B6I2CK62TKA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.345635898 (338h51m36.116277243s) [noise=true , address=45.91.116.11:4118 , piece_id=OH3XLDA6VDWB66QSJ7R3Y5TTMNARBDXS7MPLFDFKNSP7QZX76EGQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.348221234 (338h51m36.118862569s) [noise=true , address=45.91.116.9:4262 , piece_id=NPP4NPDONFYKTDJQKC5XPJPNEKKLYRAPHPNE2WKI3KOKG3VJWEKA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.379148724 (338h51m36.149790069s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXAIRV6KPBEKHHT2WHTV7RFBZZX2M42BSDX34IICONNVFD2H4MPA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.379665763 (338h51m36.150307098s) [noise=true , address=77.90.31.10:4517 , piece_id=3YDX4SEJC372T64RTATEJFPBJBNOVGWE5QME2L6N2MWVWUN2P7ZQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.383550435 (338h51m36.15419178s) [noise=true , address=77.90.31.13:4626 , piece_id=FMDUEB4OUQSGOWWO4LL6XIGKZFKU6ZFJDY7UJPTPRBU57OZIPXSA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.383582847 (338h51m36.154224182s) [seg_pos={0 0}, upload=271070]: Segment reached optimal threshold of 13 pieces. Jul 7 12:02:01.383717544 (338h51m36.15435888s) [noise=true , address=77.90.31.12:4592 , piece_id=3K4UALXEA6HXATI7MAEK3TF2BSKRS4FTORIKFQUWALIENJ7ROGZA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Jul 7 12:02:01.385367622 (338h51m36.156008967s) [noise=true , address=77.90.31.18:4807 , piece_id=JSZN5WN4HQN2JGFIJYMVFPDELMH67OU2UBGBWN7EYZ723NRNGX2Q, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.385867197 (338h51m36.156508542s) [noise=true , address=104.36.82.14:4223 , piece_id=4SKO77JRLCKZIJOA2S2ED3DHHDX4N6POWUIMJSOQNJQRP5SBRP2A, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.386478106 (338h51m36.157119451s) [seg_pos={0 0}, upload=271070]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jul 7 12:02:01.386554532 (338h51m36.157195867s) [upload=271070]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 12:02:01.386559752 (338h51m36.157201097s) [upload=271070]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 12:03:12.051066824 (338h52m46.821708159s) [upload=271070]: Done uploading segments... Jul 7 12:03:12.051087384 (338h52m46.821728719s) [upload=271070]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.65206651s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 1.841686443s FAIL (2025-07-07 12:30:50 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== upload Jul 7 11:40:35.936449645 (338h30m10.70709098s) [upload=270785]: Done starting upload Jul 7 11:40:35.936514559 (338h30m10.707155884s) [upload=270785]: Uploading segments... Jul 7 11:40:35.936545388 (338h30m10.707186713s) [upload=270785]: Got next segment. Inline: true Jul 7 11:40:35.936549045 (338h30m10.70719038s) [upload=270785]: Waiting for error group managing segments... Jul 7 11:40:35.936590585 (338h30m10.70723191s) [upload=270785]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 7 11:40:35.936595765 (338h30m10.7072371s) [upload=270785]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 7 11:40:35.936598359 (338h30m10.707239695s) [upload=270785]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 11:40:36.219622818 (338h30m10.990264153s) [upload=270785]: Done uploading segments... Jul 7 11:40:36.219640883 (338h30m10.990282218s) [upload=270785]: Upload finished. err: <nil> Jul 7 11:41:13.707744986 (338h30m48.478386321s) [upload=270792]: Starting upload Jul 7 11:41:13.707827083 (338h30m48.478468428s) [upload=270792]: Done starting upload Jul 7 11:41:13.707902237 (338h30m48.478543572s) [upload=270792]: Uploading segments... Jul 7 11:41:13.707936983 (338h30m48.478578318s) [upload=270792]: Got next segment. Inline: true Jul 7 11:41:13.707942153 (338h30m48.478583488s) [upload=270792]: Waiting for error group managing segments... Jul 7 11:41:13.707983392 (338h30m48.478624727s) [upload=270792]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 7 11:41:13.707988842 (338h30m48.478630188s) [upload=270792]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 7 11:41:13.707992089 (338h30m48.478633424s) [upload=270792]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 11:41:14.001490555 (338h30m48.77213191s) [upload=270792]: Done uploading segments... Jul 7 11:41:14.001513128 (338h30m48.772154474s) [upload=270792]: Upload finished. err: <nil> Jul 7 11:42:09.601159074 (338h31m44.371800399s) [upload=270808]: Starting upload Jul 7 11:42:09.601235320 (338h31m44.371876655s) [upload=270808]: Done starting upload Jul 7 11:42:09.601283062 (338h31m44.371924397s) [upload=270808]: Uploading segments... Jul 7 11:42:09.601340402 (338h31m44.371981737s) [upload=270808]: Got next segment. Inline: true Jul 7 11:42:09.601344690 (338h31m44.371986025s) [upload=270808]: Waiting for error group managing segments... Jul 7 11:42:09.601379576 (338h31m44.372020911s) [upload=270808]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 7 11:42:09.601384115 (338h31m44.37202545s) [upload=270808]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 7 11:42:09.601386520 (338h31m44.372027855s) [upload=270808]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 11:42:09.874882919 (338h31m44.645524264s) [upload=270808]: Done uploading segments... Jul 7 11:42:09.874905022 (338h31m44.645546377s) [upload=270808]: Upload finished. err: <nil> Jul 7 11:42:45.937793832 (338h32m20.708435167s) [upload=270814]: Starting upload Jul 7 11:42:45.937872012 (338h32m20.708513347s) [upload=270814]: Done starting upload Jul 7 11:42:45.937937177 (338h32m20.708578512s) [upload=270814]: Uploading segments... Jul 7 11:42:45.937977414 (338h32m20.708618749s) [upload=270814]: Got next segment. Inline: true Jul 7 11:42:45.937981401 (338h32m20.708622736s) [upload=270814]: Waiting for error group managing segments... Jul 7 11:42:45.938014504 (338h32m20.708655839s) [upload=270814]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 7 11:42:45.938019985 (338h32m20.70866132s) [upload=270814]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 7 11:42:45.938022731 (338h32m20.708664066s) [upload=270814]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 11:42:46.265957179 (338h32m21.036598504s) [upload=270814]: Done uploading segments... Jul 7 11:42:46.265975775 (338h32m21.0366171s) [upload=270814]: Upload finished. err: <nil> Jul 7 11:43:13.189081597 (338h32m47.959722932s) [upload=270822]: Starting upload Jul 7 11:43:13.189130460 (338h32m47.959771785s) [upload=270822]: Done starting upload Jul 7 11:43:13.189182450 (338h32m47.959823775s) [upload=270822]: Uploading segments... Jul 7 11:43:13.189420435 (338h32m47.96006177s) [upload=270822]: Got next segment. Inline: true Jul 7 11:43:13.189426627 (338h32m47.960067962s) [upload=270822]: Waiting for error group managing segments... Jul 7 11:43:13.189476563 (338h32m47.960117898s) [upload=270822]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 7 11:43:13.189481231 (338h32m47.960122556s) [upload=270822]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 7 11:43:13.189489096 (338h32m47.960130431s) [upload=270822]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 11:43:13.479015434 (338h32m48.249656769s) [upload=270822]: Done uploading segments... Jul 7 11:43:13.479032757 (338h32m48.249674082s) [upload=270822]: Upload finished. err: <nil> Jul 7 11:44:09.100465688 (338h33m43.871107023s) [upload=270833]: Starting upload Jul 7 11:44:09.100520703 (338h33m43.871162068s) [upload=270833]: Done starting upload Jul 7 11:44:09.100579906 (338h33m43.871221231s) [upload=270833]: Uploading segments... Jul 7 11:44:09.100613181 (338h33m43.871254516s) [upload=270833]: Got next segment. Inline: true Jul 7 11:44:09.100616577 (338h33m43.871257912s) [upload=270833]: Waiting for error group managing segments... Jul 7 11:44:09.100647586 (338h33m43.871288921s) [upload=270833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 7 11:44:09.100651754 (338h33m43.871293089s) [upload=270833]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 7 11:44:09.100655080 (338h33m43.871296416s) [upload=270833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 11:44:09.377639331 (338h33m44.148280666s) [upload=270833]: Done uploading segments... Jul 7 11:44:09.377664910 (338h33m44.148306295s) [upload=270833]: Upload finished. err: <nil> Jul 7 11:44:50.210367722 (338h34m24.981009087s) [upload=270842]: Starting upload Jul 7 11:44:50.210511898 (338h34m24.981153303s) [upload=270842]: Done starting upload Jul 7 11:44:50.210592782 (338h34m24.981234128s) [upload=270842]: Uploading segments... Jul 7 11:44:50.210670622 (338h34m24.981311957s) [upload=270842]: Got next segment. Inline: true Jul 7 11:44:50.210675871 (338h34m24.981317207s) [upload=270842]: Waiting for error group managing segments... Jul 7 11:44:50.210711790 (338h34m24.981353125s) [upload=270842]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 7 11:44:50.210716409 (338h34m24.981357734s) [upload=270842]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 7 11:44:50.210718663 (338h34m24.981359998s) [upload=270842]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 11:44:50.487904509 (338h34m25.258545844s) [upload=270842]: Done uploading segments... Jul 7 11:44:50.487923305 (338h34m25.25856463s) [upload=270842]: Upload finished. err: <nil> Jul 7 11:45:39.475860963 (338h35m14.246502298s) [upload=270857]: Starting upload Jul 7 11:45:39.475917571 (338h35m14.246558906s) [upload=270857]: Done starting upload Jul 7 11:45:39.476027511 (338h35m14.246668846s) [upload=270857]: Uploading segments... Jul 7 11:45:39.476102966 (338h35m14.246744301s) [upload=270857]: Got next segment. Inline: true Jul 7 11:45:39.476107574 (338h35m14.246748909s) [upload=270857]: Waiting for error group managing segments... Jul 7 11:45:39.476151248 (338h35m14.246792583s) [upload=270857]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 7 11:45:39.476156288 (338h35m14.246797623s) [upload=270857]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 7 11:45:39.476158742 (338h35m14.246800078s) [upload=270857]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 11:45:39.753124308 (338h35m14.523765643s) [upload=270857]: Done uploading segments... Jul 7 11:45:39.753145458 (338h35m14.523786793s) [upload=270857]: Upload finished. err: <nil> Jul 7 11:46:23.856413065 (338h35m58.6270544s) [upload=270866]: Starting upload Jul 7 11:46:23.856472799 (338h35m58.627114134s) [upload=270866]: Done starting upload Jul 7 11:46:23.856530038 (338h35m58.627171374s) [upload=270866]: Uploading segments... Jul 7 11:46:23.856556740 (338h35m58.627198075s) [upload=270866]: Got next segment. Inline: true Jul 7 11:46:23.856560527 (338h35m58.627201862s) [upload=270866]: Waiting for error group managing segments... Jul 7 11:46:23.856596486 (338h35m58.627237821s) [upload=270866]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 7 11:46:23.856601255 (338h35m58.62724259s) [upload=270866]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 7 11:46:23.856603840 (338h35m58.627245175s) [upload=270866]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 11:46:24.139310919 (338h35m58.909952254s) [upload=270866]: Done uploading segments... Jul 7 11:46:24.139332080 (338h35m58.909973405s) [upload=270866]: Upload finished. err: <nil> Jul 7 11:47:26.933829897 (338h37m1.704471232s) [upload=270880]: Starting upload Jul 7 11:47:26.933918737 (338h37m1.704560072s) [upload=270880]: Done starting upload Jul 7 11:47:26.933978712 (338h37m1.704620047s) [upload=270880]: Uploading segments... Jul 7 11:47:26.934031814 (338h37m1.704673189s) [upload=270880]: Got next segment. Inline: true Jul 7 11:47:26.934038416 (338h37m1.704679761s) [upload=270880]: Waiting for error group managing segments... Jul 7 11:47:26.934081408 (338h37m1.704722743s) [upload=270880]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 7 11:47:26.934087991 (338h37m1.704729336s) [upload=270880]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 7 11:47:26.934093762 (338h37m1.704735097s) [upload=270880]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 11:47:27.218024752 (338h37m1.988666137s) [upload=270880]: Done uploading segments... Jul 7 11:47:27.218046784 (338h37m1.988688119s) [upload=270880]: Upload finished. err: <nil> Duration: 1.841719648s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 5.693410286s FAIL (2025-07-07 12:30:44 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece_id=76E2UENIVWN6TTA3YD57X6CPVI366A2SNYQX6HTSGVLG6M4CCAZA, seg_pos={0 0}, upload=271062]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Jul 7 12:01:23.222432903 (338h50m57.993074238s) [noise=true , address=104.36.82.10:4078 , piece_id=RHOTQBNCH5MUDYCPQ37YGYX5BZNHTMO6BH43VCNYORRRU75RTWWQ, seg_pos={0 0}, upload=271062]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF Jul 7 12:01:23.222453401 (338h50m57.993094736s) [seg_pos={0 0}, upload=271062]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 7 12:01:23.222512745 (338h50m57.993154081s) [upload=271062]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 12:01:23.222516733 (338h50m57.993158068s) [upload=271062]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 12:01:23.524023810 (338h50m58.294665165s) [upload=271062]: Done uploading segments... Jul 7 12:01:23.524047065 (338h50m58.29468841s) [upload=271062]: Upload finished. err: <nil> Jul 7 12:01:59.027955412 (338h51m33.798596747s) [upload=271070]: Starting upload Jul 7 12:01:59.028075351 (338h51m33.798716696s) [upload=271070]: Done starting upload Jul 7 12:01:59.028139976 (338h51m33.798781311s) [upload=271070]: Uploading segments... Jul 7 12:01:59.028299931 (338h51m33.798941266s) [upload=271070]: Got next segment. Inline: false Jul 7 12:01:59.028416515 (338h51m33.79905785s) [upload=271070]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 7 12:01:59.028422416 (338h51m33.799063761s) [upload=271070]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 7 12:01:59.261880873 (338h51m34.032522218s) [seg_pos={0 0}, upload=271070]: Begin upload segment... Jul 7 12:01:59.261985924 (338h51m34.03262726s) [noise=true , address=104.36.82.9:4005 , piece_id=TZ43ZHEMJNM6P4IPJMMARHLKEX2FHTBIEFBY43IB6AAAEJMDCQNA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262067471 (338h51m34.032708816s) [noise=true , address=77.90.31.10:4517 , piece_id=3YDX4SEJC372T64RTATEJFPBJBNOVGWE5QME2L6N2MWVWUN2P7ZQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262498215 (338h51m34.03313955s) [noise=true , address=104.36.82.15:4258 , piece_id=G7UJATYPZXGE7AA2EVASTD2QXUW2F5J3N2UXSEZF23ZF5GWQJMKQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262520607 (338h51m34.033161952s) [noise=true , address=104.36.82.15:4259 , piece_id=MYFFPHWVFEKH6PPXJB5BYJZUCHPGIBOHTM6BNN4U3WGXVIHOD4YA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.262795914 (338h51m34.033437249s) [seg_pos={0 0}, upload=271070]: Done begin upload segment. Jul 7 12:01:59.262857242 (338h51m34.033498577s) [noise=true , address=45.91.116.11:4118 , piece_id=OH3XLDA6VDWB66QSJ7R3Y5TTMNARBDXS7MPLFDFKNSP7QZX76EGQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.263419457 (338h51m34.034060792s) [noise=true , address=104.36.82.10:4077 , piece_id=ZPX674LYZ7BTO2MV7T2SXNMYXLDZJ7BC64DG2XDIFJTVYMTBFRGQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.263698150 (338h51m34.034339485s) [noise=true , address=104.36.82.3:4767 , piece_id=C5FKFSEABS2TO7GGPXU4J44NHKHYP7KFJZA6HNHHOETWQ6PODG4Q, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264015678 (338h51m34.034657013s) [noise=true , address=77.90.31.18:4807 , piece_id=JSZN5WN4HQN2JGFIJYMVFPDELMH67OU2UBGBWN7EYZ723NRNGX2Q, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264312575 (338h51m34.03495391s) [noise=true , address=104.36.82.12:4150 , piece_id=JVWXXQE2KUCN7TAEJPMXNJ53EASYQSF7BDLET74FKJ42U4O54HLQ, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264672153 (338h51m34.035313488s) [noise=true , address=104.36.82.16:4294 , piece_id=CNFTWMXOAONQYFMJVQAYU4FQ6ZCYNVKHBXKJASI3KN7GDJOVSZ6Q, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.264999710 (338h51m34.035641045s) [noise=true , address=77.90.31.13:4626 , piece_id=FMDUEB4OUQSGOWWO4LL6XIGKZFKU6ZFJDY7UJPTPRBU57OZIPXSA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.265238698 (338h51m34.035880053s) [noise=true , address=104.36.82.11:4113 , piece_id=TRHOT32ONTK5AHYGBOKUWOPSLJSOEZHWM7I2BEF35B6I2CK62TKA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.265691123 (338h51m34.036332468s) [noise=true , address=104.36.82.14:4223 , piece_id=4SKO77JRLCKZIJOA2S2ED3DHHDX4N6POWUIMJSOQNJQRP5SBRP2A, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.266330596 (338h51m34.036971931s) [noise=true , address=77.90.31.12:4592 , piece_id=3K4UALXEA6HXATI7MAEK3TF2BSKRS4FTORIKFQUWALIENJ7ROGZA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.266671569 (338h51m34.037312914s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXAIRV6KPBEKHHT2WHTV7RFBZZX2M42BSDX34IICONNVFD2H4MPA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:01:59.267012862 (338h51m34.037654207s) [noise=true , address=45.91.116.9:4262 , piece_id=NPP4NPDONFYKTDJQKC5XPJPNEKKLYRAPHPNE2WKI3KOKG3VJWEKA, seg_pos={0 0}, upload=271070]: Uploading piece... Jul 7 12:02:00.922180841 (338h51m35.692822176s) [upload=271070]: Next returned nil segment Jul 7 12:02:00.922208914 (338h51m35.692850249s) [upload=271070]: Waiting for error group managing segments... Jul 7 12:02:01.187253453 (338h51m35.957894788s) [noise=true , address=104.36.82.15:4259 , piece_id=MYFFPHWVFEKH6PPXJB5BYJZUCHPGIBOHTM6BNN4U3WGXVIHOD4YA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.251407842 (338h51m36.022049177s) [noise=true , address=104.36.82.15:4258 , piece_id=G7UJATYPZXGE7AA2EVASTD2QXUW2F5J3N2UXSEZF23ZF5GWQJMKQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.260774924 (338h51m36.031416259s) [noise=true , address=104.36.82.9:4005 , piece_id=TZ43ZHEMJNM6P4IPJMMARHLKEX2FHTBIEFBY43IB6AAAEJMDCQNA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.275440331 (338h51m36.046081666s) [noise=true , address=104.36.82.3:4767 , piece_id=C5FKFSEABS2TO7GGPXU4J44NHKHYP7KFJZA6HNHHOETWQ6PODG4Q, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.292891458 (338h51m36.063532813s) [noise=true , address=104.36.82.10:4077 , piece_id=ZPX674LYZ7BTO2MV7T2SXNMYXLDZJ7BC64DG2XDIFJTVYMTBFRGQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.294071356 (338h51m36.064712701s) [noise=true , address=104.36.82.16:4294 , piece_id=CNFTWMXOAONQYFMJVQAYU4FQ6ZCYNVKHBXKJASI3KN7GDJOVSZ6Q, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.310479056 (338h51m36.081120391s) [noise=true , address=104.36.82.12:4150 , piece_id=JVWXXQE2KUCN7TAEJPMXNJ53EASYQSF7BDLET74FKJ42U4O54HLQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.319958452 (338h51m36.090599787s) [noise=true , address=104.36.82.11:4113 , piece_id=TRHOT32ONTK5AHYGBOKUWOPSLJSOEZHWM7I2BEF35B6I2CK62TKA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.345635898 (338h51m36.116277243s) [noise=true , address=45.91.116.11:4118 , piece_id=OH3XLDA6VDWB66QSJ7R3Y5TTMNARBDXS7MPLFDFKNSP7QZX76EGQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.348221234 (338h51m36.118862569s) [noise=true , address=45.91.116.9:4262 , piece_id=NPP4NPDONFYKTDJQKC5XPJPNEKKLYRAPHPNE2WKI3KOKG3VJWEKA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.379148724 (338h51m36.149790069s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXAIRV6KPBEKHHT2WHTV7RFBZZX2M42BSDX34IICONNVFD2H4MPA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.379665763 (338h51m36.150307098s) [noise=true , address=77.90.31.10:4517 , piece_id=3YDX4SEJC372T64RTATEJFPBJBNOVGWE5QME2L6N2MWVWUN2P7ZQ, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.383550435 (338h51m36.15419178s) [noise=true , address=77.90.31.13:4626 , piece_id=FMDUEB4OUQSGOWWO4LL6XIGKZFKU6ZFJDY7UJPTPRBU57OZIPXSA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.383582847 (338h51m36.154224182s) [seg_pos={0 0}, upload=271070]: Segment reached optimal threshold of 13 pieces. Jul 7 12:02:01.383717544 (338h51m36.15435888s) [noise=true , address=77.90.31.12:4592 , piece_id=3K4UALXEA6HXATI7MAEK3TF2BSKRS4FTORIKFQUWALIENJ7ROGZA, seg_pos={0 0}, upload=271070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Jul 7 12:02:01.385367622 (338h51m36.156008967s) [noise=true , address=77.90.31.18:4807 , piece_id=JSZN5WN4HQN2JGFIJYMVFPDELMH67OU2UBGBWN7EYZ723NRNGX2Q, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.385867197 (338h51m36.156508542s) [noise=true , address=104.36.82.14:4223 , piece_id=4SKO77JRLCKZIJOA2S2ED3DHHDX4N6POWUIMJSOQNJQRP5SBRP2A, seg_pos={0 0}, upload=271070]: Done uploading piece. err: <nil> Jul 7 12:02:01.386478106 (338h51m36.157119451s) [seg_pos={0 0}, upload=271070]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jul 7 12:02:01.386554532 (338h51m36.157195867s) [upload=271070]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 7 12:02:01.386559752 (338h51m36.157201097s) [upload=271070]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 7 12:03:12.051066824 (338h52m46.821708159s) [upload=271070]: Done uploading segments... Jul 7 12:03:12.051087384 (338h52m46.821728719s) [upload=271070]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.693434443s core uplink us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)