Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [................................................X........X..] duration: 6.041537976s FAIL (2025-09-08 11:39:22 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 11:37:25.081921120 (46h9m1.12149424s) [upload=40555]: Starting upload Sep 8 11:37:25.081978961 (46h9m1.121552081s) [upload=40555]: Done starting upload Sep 8 11:37:25.082079863 (46h9m1.121652983s) [upload=40555]: Uploading segments... Sep 8 11:37:25.082211375 (46h9m1.121784495s) [upload=40555]: Got next segment. Inline: false Sep 8 11:37:25.082247265 (46h9m1.121820385s) [upload=40555]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 11:37:25.082251983 (46h9m1.121825103s) [upload=40555]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 11:37:25.342027742 (46h9m1.381600862s) [seg_pos={0 0}, upload=40555]: Begin upload segment... Sep 8 11:37:25.342076214 (46h9m1.381649335s) [seg_pos={0 0}, upload=40555]: Done begin upload segment. Sep 8 11:37:25.342101172 (46h9m1.381674292s) [noise=true , address=145.79.227.7:4295 , piece_id=TNYQWIPFR77FUOIF5757JHCS272HR4GTRCYPDYD4C7KBW7S2FGOQ, seg_pos={0 0}, upload=40555]: Uploading piece... Sep 8 11:37:25.342134696 (46h9m1.381707806s) [noise=true , address=45.91.116.14:4191 , piece_id=JFPLMMV44GYPFN22SJJH6TPYTF6YXZ7VXZGPY35CIRYETL4OO3AQ, seg_pos={0 0}, upload=40555]: Uploading piece... Sep 8 11:37:25.342596891 (46h9m1.382170011s) [noise=true , address=77.90.31.14:4663 , piece_id=YCWLHLDHQL25CGIPSAZX46JGFHHJZY7OFQRHRDW7X2IF2X4I4FFA, seg_pos={0 0}, upload=40555]: Uploading piece... Sep 8 11:37:25.342614113 (46h9m1.382187233s) [noise=true , address=77.90.31.10:4517 , piece_id=2TYSUTTXHG3VS2A3NLKIZY2EQKYRM7MMHAATWUWQDJHPLALUPHPA, seg_pos={0 0}, upload=40555]: Uploading piece... Sep 8 11:37:25.342971859 (46h9m1.382544979s) [noise=true , address=45.91.116.6:4974 , piece_id=FV3AOXWHXNIGICEA5XELGSMARSYNL3OWP2YN6SHKAHRTXOMWWB3A, seg_pos={0 0}, upload=40555]: Uploading piece... Sep 8 11:37:25.342981958 (46h9m1.382555078s) [noise=true , address=45.91.116.10:4081 , piece_id=WJCVNHTH3XWFIFZLKXI5LKHNKQNVUHVPYOJPEOD4O6XT2WS5GY4A, seg_pos={0 0}, upload=40555]: Uploading piece... Sep 8 11:37:25.343270138 (46h9m1.382843258s) [noise=true , address=145.79.227.17:4969 , piece_id=LW5ME2VDDSSPJHNUQGFDC532U5TPZX7JOBGPWM5R7PCWZX563CLA, seg_pos={0 0}, upload=40555]: Uploading piece... Sep 8 11:37:25.343314414 (46h9m1.382887524s) [noise=true , address=145.79.227.4:4185 , piece_id=HWAVOYQS3N32OA2ZVHZQ5CIVQMPM5ZKK76MY5KCCGM6WRMLJJ57Q, seg_pos={0 0}, upload=40555]: Uploading piece... Sep 8 11:37:25.343560044 (46h9m1.383133154s) [noise=true , address=45.91.116.12:4227 , piece_id=WML4UJJJDICTVFCQM57GQGHCS25Q424I2QLG3QD37USCGZOBWXWQ, seg_pos={0 0}, upload=40555]: Uploading piece... Sep 8 11:37:25.343600672 (46h9m1.383173792s) [noise=true , address=145.79.227.14:4839 , piece_id=ANEZW2FX3U2LFNAQNBE6LJ6VRA7X2NQ2HKTJ3DJB6LCIPDCF2TAQ, seg_pos={0 0}, upload=40555]: Uploading piece... Sep 8 11:37:25.343907829 (46h9m1.383480959s) [noise=true , address=45.91.116.8:4048 , piece_id=HWHMG7H7OA4QOE4TIGN7BSNVLYKKQVUJ3XMG5HNLYQREWOG45GFA, seg_pos={0 0}, upload=40555]: Uploading piece... Sep 8 11:37:25.344184659 (46h9m1.383757779s) [noise=true , address=77.90.31.16:4735 , piece_id=5ZMFLAS3EYR2ICYLRGOOJOY4ODZIGR2TGDV4CP7VLMC4VGN2NF3Q, seg_pos={0 0}, upload=40555]: Uploading piece... Sep 8 11:37:25.344532976 (46h9m1.384106096s) [noise=true , address=145.79.227.19:4078 , piece_id=UO4OFCU32OLCB7DAGZL3GG2Z34AONXQ6RLOCLY24WVMWKPGGQKIA, seg_pos={0 0}, upload=40555]: Uploading piece... Sep 8 11:37:25.344799615 (46h9m1.384372735s) [noise=true , address=77.90.31.12:4590 , piece_id=RS7FD353EQ5TNTYP2D7NXWX6RDOSKPPOAGMD7M7Z4WWLWGL5K7YA, seg_pos={0 0}, upload=40555]: Uploading piece... Sep 8 11:37:25.345033253 (46h9m1.384606363s) [noise=true , address=45.91.116.5:4299 , piece_id=SFNEPJOBOPLIVUFTGC4JH4PZDQERJHSIEDHFKRVWQGX6LY3FYAAQ, seg_pos={0 0}, upload=40555]: Uploading piece... Sep 8 11:37:25.345313408 (46h9m1.384886529s) [noise=true , address=77.90.31.10:4519 , piece_id=M5S6AQWQ3ZPD472OQQB4RS5N43J4CESVDRYHRIXWJHUSJNR7EFBA, seg_pos={0 0}, upload=40555]: Uploading piece... Sep 8 11:37:27.120751556 (46h9m3.160324666s) [upload=40555]: Next returned nil segment Sep 8 11:37:27.120769050 (46h9m3.16034217s) [upload=40555]: Waiting for error group managing segments... Sep 8 11:37:27.417612247 (46h9m3.457185367s) [noise=true , address=145.79.227.17:4969 , piece_id=LW5ME2VDDSSPJHNUQGFDC532U5TPZX7JOBGPWM5R7PCWZX563CLA, seg_pos={0 0}, upload=40555]: Done uploading piece. err: <nil> Sep 8 11:37:27.427792858 (46h9m3.467365978s) [noise=true , address=45.91.116.5:4299 , piece_id=SFNEPJOBOPLIVUFTGC4JH4PZDQERJHSIEDHFKRVWQGX6LY3FYAAQ, seg_pos={0 0}, upload=40555]: Done uploading piece. err: <nil> Sep 8 11:37:27.436322921 (46h9m3.475896031s) [noise=true , address=145.79.227.7:4295 , piece_id=TNYQWIPFR77FUOIF5757JHCS272HR4GTRCYPDYD4C7KBW7S2FGOQ, seg_pos={0 0}, upload=40555]: Done uploading piece. err: <nil> Sep 8 11:37:27.437585538 (46h9m3.477158658s) [noise=true , address=145.79.227.14:4839 , piece_id=ANEZW2FX3U2LFNAQNBE6LJ6VRA7X2NQ2HKTJ3DJB6LCIPDCF2TAQ, seg_pos={0 0}, upload=40555]: Done uploading piece. err: <nil> Sep 8 11:37:27.443817332 (46h9m3.483390452s) [noise=true , address=145.79.227.4:4185 , piece_id=HWAVOYQS3N32OA2ZVHZQ5CIVQMPM5ZKK76MY5KCCGM6WRMLJJ57Q, seg_pos={0 0}, upload=40555]: Done uploading piece. err: <nil> Sep 8 11:37:27.447638234 (46h9m3.487211354s) [noise=true , address=145.79.227.19:4078 , piece_id=UO4OFCU32OLCB7DAGZL3GG2Z34AONXQ6RLOCLY24WVMWKPGGQKIA, seg_pos={0 0}, upload=40555]: Done uploading piece. err: <nil> Sep 8 11:37:27.459634810 (46h9m3.49920793s) [noise=true , address=45.91.116.12:4227 , piece_id=WML4UJJJDICTVFCQM57GQGHCS25Q424I2QLG3QD37USCGZOBWXWQ, seg_pos={0 0}, upload=40555]: Done uploading piece. err: <nil> Sep 8 11:37:27.467864969 (46h9m3.507438089s) [noise=true , address=45.91.116.10:4081 , piece_id=WJCVNHTH3XWFIFZLKXI5LKHNKQNVUHVPYOJPEOD4O6XT2WS5GY4A, seg_pos={0 0}, upload=40555]: Done uploading piece. err: <nil> Sep 8 11:37:27.507893315 (46h9m3.547466435s) [noise=true , address=77.90.31.10:4519 , piece_id=M5S6AQWQ3ZPD472OQQB4RS5N43J4CESVDRYHRIXWJHUSJNR7EFBA, seg_pos={0 0}, upload=40555]: Done uploading piece. err: <nil> Sep 8 11:37:27.534138146 (46h9m3.573711266s) [noise=true , address=77.90.31.16:4735 , piece_id=5ZMFLAS3EYR2ICYLRGOOJOY4ODZIGR2TGDV4CP7VLMC4VGN2NF3Q, seg_pos={0 0}, upload=40555]: Done uploading piece. err: <nil> Sep 8 11:37:27.581930911 (46h9m3.621504021s) [noise=true , address=77.90.31.10:4517 , piece_id=2TYSUTTXHG3VS2A3NLKIZY2EQKYRM7MMHAATWUWQDJHPLALUPHPA, seg_pos={0 0}, upload=40555]: Done uploading piece. err: <nil> Sep 8 11:37:27.586834394 (46h9m3.626407544s) [noise=true , address=45.91.116.6:4974 , piece_id=FV3AOXWHXNIGICEA5XELGSMARSYNL3OWP2YN6SHKAHRTXOMWWB3A, seg_pos={0 0}, upload=40555]: Done uploading piece. err: <nil> Sep 8 11:37:27.586868139 (46h9m3.626441259s) [noise=true , address=77.90.31.12:4590 , piece_id=RS7FD353EQ5TNTYP2D7NXWX6RDOSKPPOAGMD7M7Z4WWLWGL5K7YA, seg_pos={0 0}, upload=40555]: Done uploading piece. err: <nil> Sep 8 11:37:27.586887886 (46h9m3.626461006s) [seg_pos={0 0}, upload=40555]: Segment reached optimal threshold of 13 pieces. Sep 8 11:37:27.586996504 (46h9m3.626569624s) [noise=true , address=45.91.116.8:4048 , piece_id=HWHMG7H7OA4QOE4TIGN7BSNVLYKKQVUJ3XMG5HNLYQREWOG45GFA, seg_pos={0 0}, upload=40555]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Sep 8 11:37:27.587114720 (46h9m3.626687841s) [noise=true , address=45.91.116.14:4191 , piece_id=JFPLMMV44GYPFN22SJJH6TPYTF6YXZ7VXZGPY35CIRYETL4OO3AQ, seg_pos={0 0}, upload=40555]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq): protocol: expected piece hash; context canceled; EOF Sep 8 11:37:27.587126122 (46h9m3.626699242s) [noise=true , address=77.90.31.14:4663 , piece_id=YCWLHLDHQL25CGIPSAZX46JGFHHJZY7OFQRHRDW7X2IF2X4I4FFA, seg_pos={0 0}, upload=40555]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF Sep 8 11:37:27.587138266 (46h9m3.626711386s) [seg_pos={0 0}, upload=40555]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 11:37:27.587221124 (46h9m3.626794244s) [upload=40555]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 11:37:27.587225332 (46h9m3.626798442s) [upload=40555]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 11:37:27.911170040 (46h9m3.95074316s) [upload=40555]: Done uploading segments... Sep 8 11:37:27.911190279 (46h9m3.950763399s) [upload=40555]: Upload finished. err: <nil> Duration: 6.041564017s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.................................................X........X.] duration: 6.763016468s FAIL (2025-09-08 11:38:19 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 11:37:25.081921120 (46h9m1.12149424s) [upload=40555]: Starting upload Sep 8 11:37:25.081978961 (46h9m1.121552081s) [upload=40555]: Done starting upload Sep 8 11:37:25.082079863 (46h9m1.121652983s) [upload=40555]: Uploading segments... Sep 8 11:37:25.082211375 (46h9m1.121784495s) [upload=40555]: Got next segment. Inline: false Sep 8 11:37:25.082247265 (46h9m1.121820385s) [upload=40555]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 11:37:25.082251983 (46h9m1.121825103s) [upload=40555]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 11:37:25.342027742 (46h9m1.381600862s) [seg_pos={0 0}, upload=40555]: Begin upload segment... Sep 8 11:37:25.342076214 (46h9m1.381649335s) [seg_pos={0 0}, upload=40555]: Done begin upload segment. Sep 8 11:37:25.342101172 (46h9m1.381674292s) [noise=true , address=145.79.227.7:4295 , piece_id=TNYQWIPFR77FUOIF5757JHCS272HR4GTRCYPDYD4C7KBW7S2FGOQ, seg_pos={0 0}, upload=40555]: Uploading piece... Sep 8 11:37:25.342134696 (46h9m1.381707806s) [noise=true , address=45.91.116.14:4191 , piece_id=JFPLMMV44GYPFN22SJJH6TPYTF6YXZ7VXZGPY35CIRYETL4OO3AQ, seg_pos={0 0}, upload=40555]: Uploading piece... Sep 8 11:37:25.342596891 (46h9m1.382170011s) [noise=true , address=77.90.31.14:4663 , piece_id=YCWLHLDHQL25CGIPSAZX46JGFHHJZY7OFQRHRDW7X2IF2X4I4FFA, seg_pos={0 0}, upload=40555]: Uploading piece... Sep 8 11:37:25.342614113 (46h9m1.382187233s) [noise=true , address=77.90.31.10:4517 , piece_id=2TYSUTTXHG3VS2A3NLKIZY2EQKYRM7MMHAATWUWQDJHPLALUPHPA, seg_pos={0 0}, upload=40555]: Uploading piece... Sep 8 11:37:25.342971859 (46h9m1.382544979s) [noise=true , address=45.91.116.6:4974 , piece_id=FV3AOXWHXNIGICEA5XELGSMARSYNL3OWP2YN6SHKAHRTXOMWWB3A, seg_pos={0 0}, upload=40555]: Uploading piece... Sep 8 11:37:25.342981958 (46h9m1.382555078s) [noise=true , address=45.91.116.10:4081 , piece_id=WJCVNHTH3XWFIFZLKXI5LKHNKQNVUHVPYOJPEOD4O6XT2WS5GY4A, seg_pos={0 0}, upload=40555]: Uploading piece... Sep 8 11:37:25.343270138 (46h9m1.382843258s) [noise=true , address=145.79.227.17:4969 , piece_id=LW5ME2VDDSSPJHNUQGFDC532U5TPZX7JOBGPWM5R7PCWZX563CLA, seg_pos={0 0}, upload=40555]: Uploading piece... Sep 8 11:37:25.343314414 (46h9m1.382887524s) [noise=true , address=145.79.227.4:4185 , piece_id=HWAVOYQS3N32OA2ZVHZQ5CIVQMPM5ZKK76MY5KCCGM6WRMLJJ57Q, seg_pos={0 0}, upload=40555]: Uploading piece... Sep 8 11:37:25.343560044 (46h9m1.383133154s) [noise=true , address=45.91.116.12:4227 , piece_id=WML4UJJJDICTVFCQM57GQGHCS25Q424I2QLG3QD37USCGZOBWXWQ, seg_pos={0 0}, upload=40555]: Uploading piece... Sep 8 11:37:25.343600672 (46h9m1.383173792s) [noise=true , address=145.79.227.14:4839 , piece_id=ANEZW2FX3U2LFNAQNBE6LJ6VRA7X2NQ2HKTJ3DJB6LCIPDCF2TAQ, seg_pos={0 0}, upload=40555]: Uploading piece... Sep 8 11:37:25.343907829 (46h9m1.383480959s) [noise=true , address=45.91.116.8:4048 , piece_id=HWHMG7H7OA4QOE4TIGN7BSNVLYKKQVUJ3XMG5HNLYQREWOG45GFA, seg_pos={0 0}, upload=40555]: Uploading piece... Sep 8 11:37:25.344184659 (46h9m1.383757779s) [noise=true , address=77.90.31.16:4735 , piece_id=5ZMFLAS3EYR2ICYLRGOOJOY4ODZIGR2TGDV4CP7VLMC4VGN2NF3Q, seg_pos={0 0}, upload=40555]: Uploading piece... Sep 8 11:37:25.344532976 (46h9m1.384106096s) [noise=true , address=145.79.227.19:4078 , piece_id=UO4OFCU32OLCB7DAGZL3GG2Z34AONXQ6RLOCLY24WVMWKPGGQKIA, seg_pos={0 0}, upload=40555]: Uploading piece... Sep 8 11:37:25.344799615 (46h9m1.384372735s) [noise=true , address=77.90.31.12:4590 , piece_id=RS7FD353EQ5TNTYP2D7NXWX6RDOSKPPOAGMD7M7Z4WWLWGL5K7YA, seg_pos={0 0}, upload=40555]: Uploading piece... Sep 8 11:37:25.345033253 (46h9m1.384606363s) [noise=true , address=45.91.116.5:4299 , piece_id=SFNEPJOBOPLIVUFTGC4JH4PZDQERJHSIEDHFKRVWQGX6LY3FYAAQ, seg_pos={0 0}, upload=40555]: Uploading piece... Sep 8 11:37:25.345313408 (46h9m1.384886529s) [noise=true , address=77.90.31.10:4519 , piece_id=M5S6AQWQ3ZPD472OQQB4RS5N43J4CESVDRYHRIXWJHUSJNR7EFBA, seg_pos={0 0}, upload=40555]: Uploading piece... Sep 8 11:37:27.120751556 (46h9m3.160324666s) [upload=40555]: Next returned nil segment Sep 8 11:37:27.120769050 (46h9m3.16034217s) [upload=40555]: Waiting for error group managing segments... Sep 8 11:37:27.417612247 (46h9m3.457185367s) [noise=true , address=145.79.227.17:4969 , piece_id=LW5ME2VDDSSPJHNUQGFDC532U5TPZX7JOBGPWM5R7PCWZX563CLA, seg_pos={0 0}, upload=40555]: Done uploading piece. err: <nil> Sep 8 11:37:27.427792858 (46h9m3.467365978s) [noise=true , address=45.91.116.5:4299 , piece_id=SFNEPJOBOPLIVUFTGC4JH4PZDQERJHSIEDHFKRVWQGX6LY3FYAAQ, seg_pos={0 0}, upload=40555]: Done uploading piece. err: <nil> Sep 8 11:37:27.436322921 (46h9m3.475896031s) [noise=true , address=145.79.227.7:4295 , piece_id=TNYQWIPFR77FUOIF5757JHCS272HR4GTRCYPDYD4C7KBW7S2FGOQ, seg_pos={0 0}, upload=40555]: Done uploading piece. err: <nil> Sep 8 11:37:27.437585538 (46h9m3.477158658s) [noise=true , address=145.79.227.14:4839 , piece_id=ANEZW2FX3U2LFNAQNBE6LJ6VRA7X2NQ2HKTJ3DJB6LCIPDCF2TAQ, seg_pos={0 0}, upload=40555]: Done uploading piece. err: <nil> Sep 8 11:37:27.443817332 (46h9m3.483390452s) [noise=true , address=145.79.227.4:4185 , piece_id=HWAVOYQS3N32OA2ZVHZQ5CIVQMPM5ZKK76MY5KCCGM6WRMLJJ57Q, seg_pos={0 0}, upload=40555]: Done uploading piece. err: <nil> Sep 8 11:37:27.447638234 (46h9m3.487211354s) [noise=true , address=145.79.227.19:4078 , piece_id=UO4OFCU32OLCB7DAGZL3GG2Z34AONXQ6RLOCLY24WVMWKPGGQKIA, seg_pos={0 0}, upload=40555]: Done uploading piece. err: <nil> Sep 8 11:37:27.459634810 (46h9m3.49920793s) [noise=true , address=45.91.116.12:4227 , piece_id=WML4UJJJDICTVFCQM57GQGHCS25Q424I2QLG3QD37USCGZOBWXWQ, seg_pos={0 0}, upload=40555]: Done uploading piece. err: <nil> Sep 8 11:37:27.467864969 (46h9m3.507438089s) [noise=true , address=45.91.116.10:4081 , piece_id=WJCVNHTH3XWFIFZLKXI5LKHNKQNVUHVPYOJPEOD4O6XT2WS5GY4A, seg_pos={0 0}, upload=40555]: Done uploading piece. err: <nil> Sep 8 11:37:27.507893315 (46h9m3.547466435s) [noise=true , address=77.90.31.10:4519 , piece_id=M5S6AQWQ3ZPD472OQQB4RS5N43J4CESVDRYHRIXWJHUSJNR7EFBA, seg_pos={0 0}, upload=40555]: Done uploading piece. err: <nil> Sep 8 11:37:27.534138146 (46h9m3.573711266s) [noise=true , address=77.90.31.16:4735 , piece_id=5ZMFLAS3EYR2ICYLRGOOJOY4ODZIGR2TGDV4CP7VLMC4VGN2NF3Q, seg_pos={0 0}, upload=40555]: Done uploading piece. err: <nil> Sep 8 11:37:27.581930911 (46h9m3.621504021s) [noise=true , address=77.90.31.10:4517 , piece_id=2TYSUTTXHG3VS2A3NLKIZY2EQKYRM7MMHAATWUWQDJHPLALUPHPA, seg_pos={0 0}, upload=40555]: Done uploading piece. err: <nil> Sep 8 11:37:27.586834394 (46h9m3.626407544s) [noise=true , address=45.91.116.6:4974 , piece_id=FV3AOXWHXNIGICEA5XELGSMARSYNL3OWP2YN6SHKAHRTXOMWWB3A, seg_pos={0 0}, upload=40555]: Done uploading piece. err: <nil> Sep 8 11:37:27.586868139 (46h9m3.626441259s) [noise=true , address=77.90.31.12:4590 , piece_id=RS7FD353EQ5TNTYP2D7NXWX6RDOSKPPOAGMD7M7Z4WWLWGL5K7YA, seg_pos={0 0}, upload=40555]: Done uploading piece. err: <nil> Sep 8 11:37:27.586887886 (46h9m3.626461006s) [seg_pos={0 0}, upload=40555]: Segment reached optimal threshold of 13 pieces. Sep 8 11:37:27.586996504 (46h9m3.626569624s) [noise=true , address=45.91.116.8:4048 , piece_id=HWHMG7H7OA4QOE4TIGN7BSNVLYKKQVUJ3XMG5HNLYQREWOG45GFA, seg_pos={0 0}, upload=40555]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Sep 8 11:37:27.587114720 (46h9m3.626687841s) [noise=true , address=45.91.116.14:4191 , piece_id=JFPLMMV44GYPFN22SJJH6TPYTF6YXZ7VXZGPY35CIRYETL4OO3AQ, seg_pos={0 0}, upload=40555]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq): protocol: expected piece hash; context canceled; EOF Sep 8 11:37:27.587126122 (46h9m3.626699242s) [noise=true , address=77.90.31.14:4663 , piece_id=YCWLHLDHQL25CGIPSAZX46JGFHHJZY7OFQRHRDW7X2IF2X4I4FFA, seg_pos={0 0}, upload=40555]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF Sep 8 11:37:27.587138266 (46h9m3.626711386s) [seg_pos={0 0}, upload=40555]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 11:37:27.587221124 (46h9m3.626794244s) [upload=40555]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 11:37:27.587225332 (46h9m3.626798442s) [upload=40555]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 11:37:27.911170040 (46h9m3.95074316s) [upload=40555]: Done uploading segments... Sep 8 11:37:27.911190279 (46h9m3.950763399s) [upload=40555]: Upload finished. err: <nil> Duration: 6.763043209s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [X.................................................X........X] duration: 30.002581644s FAIL (2025-09-08 11:37:54 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 11:37:25.081921120 (46h9m1.12149424s) [upload=40555]: Starting upload Sep 8 11:37:25.081978961 (46h9m1.121552081s) [upload=40555]: Done starting upload Sep 8 11:37:25.082079863 (46h9m1.121652983s) [upload=40555]: Uploading segments... Sep 8 11:37:25.082211375 (46h9m1.121784495s) [upload=40555]: Got next segment. Inline: false Sep 8 11:37:25.082247265 (46h9m1.121820385s) [upload=40555]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 11:37:25.082251983 (46h9m1.121825103s) [upload=40555]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 11:37:25.342027742 (46h9m1.381600862s) [seg_pos={0 0}, upload=40555]: Begin upload segment... Sep 8 11:37:25.342076214 (46h9m1.381649335s) [seg_pos={0 0}, upload=40555]: Done begin upload segment. Sep 8 11:37:25.342101172 (46h9m1.381674292s) [noise=true , address=145.79.227.7:4295 , piece_id=TNYQWIPFR77FUOIF5757JHCS272HR4GTRCYPDYD4C7KBW7S2FGOQ, seg_pos={0 0}, upload=40555]: Uploading piece... Sep 8 11:37:25.342134696 (46h9m1.381707806s) [noise=true , address=45.91.116.14:4191 , piece_id=JFPLMMV44GYPFN22SJJH6TPYTF6YXZ7VXZGPY35CIRYETL4OO3AQ, seg_pos={0 0}, upload=40555]: Uploading piece... Sep 8 11:37:25.342596891 (46h9m1.382170011s) [noise=true , address=77.90.31.14:4663 , piece_id=YCWLHLDHQL25CGIPSAZX46JGFHHJZY7OFQRHRDW7X2IF2X4I4FFA, seg_pos={0 0}, upload=40555]: Uploading piece... Sep 8 11:37:25.342614113 (46h9m1.382187233s) [noise=true , address=77.90.31.10:4517 , piece_id=2TYSUTTXHG3VS2A3NLKIZY2EQKYRM7MMHAATWUWQDJHPLALUPHPA, seg_pos={0 0}, upload=40555]: Uploading piece... Sep 8 11:37:25.342971859 (46h9m1.382544979s) [noise=true , address=45.91.116.6:4974 , piece_id=FV3AOXWHXNIGICEA5XELGSMARSYNL3OWP2YN6SHKAHRTXOMWWB3A, seg_pos={0 0}, upload=40555]: Uploading piece... Sep 8 11:37:25.342981958 (46h9m1.382555078s) [noise=true , address=45.91.116.10:4081 , piece_id=WJCVNHTH3XWFIFZLKXI5LKHNKQNVUHVPYOJPEOD4O6XT2WS5GY4A, seg_pos={0 0}, upload=40555]: Uploading piece... Sep 8 11:37:25.343270138 (46h9m1.382843258s) [noise=true , address=145.79.227.17:4969 , piece_id=LW5ME2VDDSSPJHNUQGFDC532U5TPZX7JOBGPWM5R7PCWZX563CLA, seg_pos={0 0}, upload=40555]: Uploading piece... Sep 8 11:37:25.343314414 (46h9m1.382887524s) [noise=true , address=145.79.227.4:4185 , piece_id=HWAVOYQS3N32OA2ZVHZQ5CIVQMPM5ZKK76MY5KCCGM6WRMLJJ57Q, seg_pos={0 0}, upload=40555]: Uploading piece... Sep 8 11:37:25.343560044 (46h9m1.383133154s) [noise=true , address=45.91.116.12:4227 , piece_id=WML4UJJJDICTVFCQM57GQGHCS25Q424I2QLG3QD37USCGZOBWXWQ, seg_pos={0 0}, upload=40555]: Uploading piece... Sep 8 11:37:25.343600672 (46h9m1.383173792s) [noise=true , address=145.79.227.14:4839 , piece_id=ANEZW2FX3U2LFNAQNBE6LJ6VRA7X2NQ2HKTJ3DJB6LCIPDCF2TAQ, seg_pos={0 0}, upload=40555]: Uploading piece... Sep 8 11:37:25.343907829 (46h9m1.383480959s) [noise=true , address=45.91.116.8:4048 , piece_id=HWHMG7H7OA4QOE4TIGN7BSNVLYKKQVUJ3XMG5HNLYQREWOG45GFA, seg_pos={0 0}, upload=40555]: Uploading piece... Sep 8 11:37:25.344184659 (46h9m1.383757779s) [noise=true , address=77.90.31.16:4735 , piece_id=5ZMFLAS3EYR2ICYLRGOOJOY4ODZIGR2TGDV4CP7VLMC4VGN2NF3Q, seg_pos={0 0}, upload=40555]: Uploading piece... Sep 8 11:37:25.344532976 (46h9m1.384106096s) [noise=true , address=145.79.227.19:4078 , piece_id=UO4OFCU32OLCB7DAGZL3GG2Z34AONXQ6RLOCLY24WVMWKPGGQKIA, seg_pos={0 0}, upload=40555]: Uploading piece... Sep 8 11:37:25.344799615 (46h9m1.384372735s) [noise=true , address=77.90.31.12:4590 , piece_id=RS7FD353EQ5TNTYP2D7NXWX6RDOSKPPOAGMD7M7Z4WWLWGL5K7YA, seg_pos={0 0}, upload=40555]: Uploading piece... Sep 8 11:37:25.345033253 (46h9m1.384606363s) [noise=true , address=45.91.116.5:4299 , piece_id=SFNEPJOBOPLIVUFTGC4JH4PZDQERJHSIEDHFKRVWQGX6LY3FYAAQ, seg_pos={0 0}, upload=40555]: Uploading piece... Sep 8 11:37:25.345313408 (46h9m1.384886529s) [noise=true , address=77.90.31.10:4519 , piece_id=M5S6AQWQ3ZPD472OQQB4RS5N43J4CESVDRYHRIXWJHUSJNR7EFBA, seg_pos={0 0}, upload=40555]: Uploading piece... Sep 8 11:37:27.120751556 (46h9m3.160324666s) [upload=40555]: Next returned nil segment Sep 8 11:37:27.120769050 (46h9m3.16034217s) [upload=40555]: Waiting for error group managing segments... Sep 8 11:37:27.417612247 (46h9m3.457185367s) [noise=true , address=145.79.227.17:4969 , piece_id=LW5ME2VDDSSPJHNUQGFDC532U5TPZX7JOBGPWM5R7PCWZX563CLA, seg_pos={0 0}, upload=40555]: Done uploading piece. err: <nil> Sep 8 11:37:27.427792858 (46h9m3.467365978s) [noise=true , address=45.91.116.5:4299 , piece_id=SFNEPJOBOPLIVUFTGC4JH4PZDQERJHSIEDHFKRVWQGX6LY3FYAAQ, seg_pos={0 0}, upload=40555]: Done uploading piece. err: <nil> Sep 8 11:37:27.436322921 (46h9m3.475896031s) [noise=true , address=145.79.227.7:4295 , piece_id=TNYQWIPFR77FUOIF5757JHCS272HR4GTRCYPDYD4C7KBW7S2FGOQ, seg_pos={0 0}, upload=40555]: Done uploading piece. err: <nil> Sep 8 11:37:27.437585538 (46h9m3.477158658s) [noise=true , address=145.79.227.14:4839 , piece_id=ANEZW2FX3U2LFNAQNBE6LJ6VRA7X2NQ2HKTJ3DJB6LCIPDCF2TAQ, seg_pos={0 0}, upload=40555]: Done uploading piece. err: <nil> Sep 8 11:37:27.443817332 (46h9m3.483390452s) [noise=true , address=145.79.227.4:4185 , piece_id=HWAVOYQS3N32OA2ZVHZQ5CIVQMPM5ZKK76MY5KCCGM6WRMLJJ57Q, seg_pos={0 0}, upload=40555]: Done uploading piece. err: <nil> Sep 8 11:37:27.447638234 (46h9m3.487211354s) [noise=true , address=145.79.227.19:4078 , piece_id=UO4OFCU32OLCB7DAGZL3GG2Z34AONXQ6RLOCLY24WVMWKPGGQKIA, seg_pos={0 0}, upload=40555]: Done uploading piece. err: <nil> Sep 8 11:37:27.459634810 (46h9m3.49920793s) [noise=true , address=45.91.116.12:4227 , piece_id=WML4UJJJDICTVFCQM57GQGHCS25Q424I2QLG3QD37USCGZOBWXWQ, seg_pos={0 0}, upload=40555]: Done uploading piece. err: <nil> Sep 8 11:37:27.467864969 (46h9m3.507438089s) [noise=true , address=45.91.116.10:4081 , piece_id=WJCVNHTH3XWFIFZLKXI5LKHNKQNVUHVPYOJPEOD4O6XT2WS5GY4A, seg_pos={0 0}, upload=40555]: Done uploading piece. err: <nil> Sep 8 11:37:27.507893315 (46h9m3.547466435s) [noise=true , address=77.90.31.10:4519 , piece_id=M5S6AQWQ3ZPD472OQQB4RS5N43J4CESVDRYHRIXWJHUSJNR7EFBA, seg_pos={0 0}, upload=40555]: Done uploading piece. err: <nil> Sep 8 11:37:27.534138146 (46h9m3.573711266s) [noise=true , address=77.90.31.16:4735 , piece_id=5ZMFLAS3EYR2ICYLRGOOJOY4ODZIGR2TGDV4CP7VLMC4VGN2NF3Q, seg_pos={0 0}, upload=40555]: Done uploading piece. err: <nil> Sep 8 11:37:27.581930911 (46h9m3.621504021s) [noise=true , address=77.90.31.10:4517 , piece_id=2TYSUTTXHG3VS2A3NLKIZY2EQKYRM7MMHAATWUWQDJHPLALUPHPA, seg_pos={0 0}, upload=40555]: Done uploading piece. err: <nil> Sep 8 11:37:27.586834394 (46h9m3.626407544s) [noise=true , address=45.91.116.6:4974 , piece_id=FV3AOXWHXNIGICEA5XELGSMARSYNL3OWP2YN6SHKAHRTXOMWWB3A, seg_pos={0 0}, upload=40555]: Done uploading piece. err: <nil> Sep 8 11:37:27.586868139 (46h9m3.626441259s) [noise=true , address=77.90.31.12:4590 , piece_id=RS7FD353EQ5TNTYP2D7NXWX6RDOSKPPOAGMD7M7Z4WWLWGL5K7YA, seg_pos={0 0}, upload=40555]: Done uploading piece. err: <nil> Sep 8 11:37:27.586887886 (46h9m3.626461006s) [seg_pos={0 0}, upload=40555]: Segment reached optimal threshold of 13 pieces. Sep 8 11:37:27.586996504 (46h9m3.626569624s) [noise=true , address=45.91.116.8:4048 , piece_id=HWHMG7H7OA4QOE4TIGN7BSNVLYKKQVUJ3XMG5HNLYQREWOG45GFA, seg_pos={0 0}, upload=40555]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Sep 8 11:37:27.587114720 (46h9m3.626687841s) [noise=true , address=45.91.116.14:4191 , piece_id=JFPLMMV44GYPFN22SJJH6TPYTF6YXZ7VXZGPY35CIRYETL4OO3AQ, seg_pos={0 0}, upload=40555]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq): protocol: expected piece hash; context canceled; EOF Sep 8 11:37:27.587126122 (46h9m3.626699242s) [noise=true , address=77.90.31.14:4663 , piece_id=YCWLHLDHQL25CGIPSAZX46JGFHHJZY7OFQRHRDW7X2IF2X4I4FFA, seg_pos={0 0}, upload=40555]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF Sep 8 11:37:27.587138266 (46h9m3.626711386s) [seg_pos={0 0}, upload=40555]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 11:37:27.587221124 (46h9m3.626794244s) [upload=40555]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 11:37:27.587225332 (46h9m3.626798442s) [upload=40555]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 11:37:27.911170040 (46h9m3.95074316s) [upload=40555]: Done uploading segments... Sep 8 11:37:27.911190279 (46h9m3.950763399s) [upload=40555]: Upload finished. err: <nil> Duration: 30.002598797s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.X.................................................X........] duration: 6.159213967s FAIL (2025-09-08 11:36:15 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 11:30:22.397555623 (46h1m58.437128743s) [upload=40453]: Starting upload Sep 8 11:30:22.397662778 (46h1m58.437235898s) [upload=40453]: Done starting upload Sep 8 11:30:22.397761527 (46h1m58.437334657s) [upload=40453]: Uploading segments... Sep 8 11:30:22.398055119 (46h1m58.437628249s) [upload=40453]: Got next segment. Inline: false Sep 8 11:30:22.398100035 (46h1m58.437673155s) [upload=40453]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 11:30:22.398106146 (46h1m58.437679266s) [upload=40453]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 11:30:22.662668402 (46h1m58.702241543s) [seg_pos={0 0}, upload=40453]: Begin upload segment... Sep 8 11:30:22.662728728 (46h1m58.702301858s) [seg_pos={0 0}, upload=40453]: Done begin upload segment. Sep 8 11:30:22.662792650 (46h1m58.70236578s) [noise=true , address=145.79.227.13:4801 , piece_id=VMUW6CKBFDPMENEDXWVXJPPXUCBMWZIOYBEAPUJUX53LD7JMWXGA, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.663318356 (46h1m58.702891476s) [noise=true , address=45.91.116.10:4083 , piece_id=4OWU4AX7M44CFBFO6N4EHYRDMQJN3YWPRW6UMGXDHCYUTKQQR2HA, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.663693774 (46h1m58.703266904s) [noise=true , address=45.91.116.9:4263 , piece_id=MXX4TM66VY2AHGDO5YUVHVQ6KN65BIVLPJRM67NYXNFGUR446A5Q, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.664077208 (46h1m58.703650338s) [noise=true , address=145.79.227.5:4223 , piece_id=WRF4JTGTJNHR64JEX4RVSXKPIPXOP3VJNRT2SESC6BP3FMZASCVQ, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.664440393 (46h1m58.704013523s) [noise=true , address=45.91.116.6:4973 , piece_id=2MMR3OU3S6WADX46CEKH655N7ZBAX2UNOGINNW3VYC7EBPCYHEJQ, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.664888250 (46h1m58.70446138s) [noise=true , address=145.79.227.15:4875 , piece_id=DKMBQQTB2LUF5Z7CXKWXL6XFV364XROLJCFUAE4VVIEUL6UNZZ7A, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.665305769 (46h1m58.704878899s) [noise=true , address=45.91.116.11:4117 , piece_id=QVR7CUSX2TV42RIFZLSKEJH73AHTQHKHLBYR7U4LVJQXGWBOGE4Q, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.665639969 (46h1m58.705213089s) [noise=true , address=77.90.31.18:4806 , piece_id=ASQ5KAUORG4AIPO6T37L6AAR5K4TNMGL6HMYKIS42QARDMRD5C2Q, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.666126189 (46h1m58.705699319s) [noise=true , address=77.90.31.15:4697 , piece_id=EOEKYUYLMGPDPOA2Z36HXLRK6FKRGOKEYG7GUHW3RCGXNDYBKF3Q, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.666647376 (46h1m58.706220506s) [noise=true , address=45.91.116.5:4297 , piece_id=W5OYRS6OMFI7WYQ5IGTKL6KMFQ62MFZ4S7DSMESTXFJW35LJFLKQ, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.667173724 (46h1m58.706746844s) [noise=true , address=145.79.227.4:4186 , piece_id=2EZZOKL2WPS2ASPMVGXX5H3D2UNDZ7RHHBOUUXHKMWEYSJRURQLA, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.667547939 (46h1m58.707121069s) [noise=true , address=45.91.116.13:4154 , piece_id=XFA23JHIUFQC2XJDEWFI5TZVFHX5RCILEWIVNRGAX7EZOMS2HJHQ, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.667917126 (46h1m58.707490256s) [noise=true , address=45.91.116.4:4938 , piece_id=LIKWXIQE6MY35VX4ADH5R2DXWKLFVSEPJ5GZ6KURLYFHX6MJZXRQ, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.668276353 (46h1m58.707849473s) [noise=true , address=45.91.116.4:4939 , piece_id=BGUD5GLFTXWPQY4URTIRIYAVPM5UOVFYEY6ZHCNXSPD3OECXLXIQ, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.668698291 (46h1m58.708271421s) [noise=true , address=45.91.116.5:4299 , piece_id=5AHHS2XFG7Q5YAGMAEACHV3G53QAVWPBVJUYFE63ORHZXL4UKCTA, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.669073759 (46h1m58.708646879s) [noise=true , address=145.79.227.16:4911 , piece_id=HQXIWW7ZISR3OHEYEI5QJKJGHOE6GDJYKPI3DXCYIGGDSL6NWX2A, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:24.457346016 (46h2m0.496919136s) [upload=40453]: Next returned nil segment Sep 8 11:30:24.457368008 (46h2m0.496941129s) [upload=40453]: Waiting for error group managing segments... Sep 8 11:30:24.768032032 (46h2m0.807605152s) [noise=true , address=45.91.116.9:4263 , piece_id=MXX4TM66VY2AHGDO5YUVHVQ6KN65BIVLPJRM67NYXNFGUR446A5Q, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.790832322 (46h2m0.830405442s) [noise=true , address=145.79.227.5:4223 , piece_id=WRF4JTGTJNHR64JEX4RVSXKPIPXOP3VJNRT2SESC6BP3FMZASCVQ, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.791293394 (46h2m0.830866524s) [noise=true , address=45.91.116.4:4938 , piece_id=LIKWXIQE6MY35VX4ADH5R2DXWKLFVSEPJ5GZ6KURLYFHX6MJZXRQ, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.817409740 (46h2m0.85698286s) [noise=true , address=45.91.116.11:4117 , piece_id=QVR7CUSX2TV42RIFZLSKEJH73AHTQHKHLBYR7U4LVJQXGWBOGE4Q, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.818893940 (46h2m0.85846707s) [noise=true , address=145.79.227.16:4911 , piece_id=HQXIWW7ZISR3OHEYEI5QJKJGHOE6GDJYKPI3DXCYIGGDSL6NWX2A, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.840535593 (46h2m0.880108713s) [noise=true , address=45.91.116.5:4299 , piece_id=5AHHS2XFG7Q5YAGMAEACHV3G53QAVWPBVJUYFE63ORHZXL4UKCTA, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.844131393 (46h2m0.883704513s) [noise=true , address=145.79.227.15:4875 , piece_id=DKMBQQTB2LUF5Z7CXKWXL6XFV364XROLJCFUAE4VVIEUL6UNZZ7A, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.865872094 (46h2m0.905445214s) [noise=true , address=45.91.116.6:4973 , piece_id=2MMR3OU3S6WADX46CEKH655N7ZBAX2UNOGINNW3VYC7EBPCYHEJQ, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.867279658 (46h2m0.906852778s) [noise=true , address=145.79.227.13:4801 , piece_id=VMUW6CKBFDPMENEDXWVXJPPXUCBMWZIOYBEAPUJUX53LD7JMWXGA, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.874096092 (46h2m0.913669212s) [noise=true , address=145.79.227.4:4186 , piece_id=2EZZOKL2WPS2ASPMVGXX5H3D2UNDZ7RHHBOUUXHKMWEYSJRURQLA, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.879017710 (46h2m0.91859084s) [noise=true , address=45.91.116.13:4154 , piece_id=XFA23JHIUFQC2XJDEWFI5TZVFHX5RCILEWIVNRGAX7EZOMS2HJHQ, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.965838817 (46h2m1.005411937s) [noise=true , address=45.91.116.5:4297 , piece_id=W5OYRS6OMFI7WYQ5IGTKL6KMFQ62MFZ4S7DSMESTXFJW35LJFLKQ, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:25.114790605 (46h2m1.154363735s) [noise=true , address=77.90.31.15:4697 , piece_id=EOEKYUYLMGPDPOA2Z36HXLRK6FKRGOKEYG7GUHW3RCGXNDYBKF3Q, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:25.114815022 (46h2m1.154388152s) [seg_pos={0 0}, upload=40453]: Segment reached optimal threshold of 13 pieces. Sep 8 11:30:25.115095860 (46h2m1.15466899s) [noise=true , address=45.91.116.10:4083 , piece_id=4OWU4AX7M44CFBFO6N4EHYRDMQJN3YWPRW6UMGXDHCYUTKQQR2HA, seg_pos={0 0}, upload=40453]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Sep 8 11:30:25.115118473 (46h2m1.154691593s) [noise=true , address=45.91.116.4:4939 , piece_id=BGUD5GLFTXWPQY4URTIRIYAVPM5UOVFYEY6ZHCNXSPD3OECXLXIQ, seg_pos={0 0}, upload=40453]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: write tcp 188.166.225.170:37064->45.91.116.4:4939: use of closed network connection; write tcp 188.166.225.170:37064->45.91.116.4:4939: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37064->45.91.116.4:4939: use of closed network connection Sep 8 11:30:25.115167607 (46h2m1.154740727s) [noise=true , address=77.90.31.18:4806 , piece_id=ASQ5KAUORG4AIPO6T37L6AAR5K4TNMGL6HMYKIS42QARDMRD5C2Q, seg_pos={0 0}, upload=40453]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF Sep 8 11:30:25.115207323 (46h2m1.154780443s) [seg_pos={0 0}, upload=40453]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 11:30:25.115331711 (46h2m1.154904841s) [upload=40453]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 11:30:25.115338344 (46h2m1.154911504s) [upload=40453]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 11:30:25.441783696 (46h2m1.481356816s) [upload=40453]: Done uploading segments... Sep 8 11:30:25.441832048 (46h2m1.481405168s) [upload=40453]: Upload finished. err: <nil> Duration: 6.159240257s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..X.................................................X.......] duration: 6.112623645s FAIL (2025-09-08 11:35:24 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 11:30:22.397555623 (46h1m58.437128743s) [upload=40453]: Starting upload Sep 8 11:30:22.397662778 (46h1m58.437235898s) [upload=40453]: Done starting upload Sep 8 11:30:22.397761527 (46h1m58.437334657s) [upload=40453]: Uploading segments... Sep 8 11:30:22.398055119 (46h1m58.437628249s) [upload=40453]: Got next segment. Inline: false Sep 8 11:30:22.398100035 (46h1m58.437673155s) [upload=40453]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 11:30:22.398106146 (46h1m58.437679266s) [upload=40453]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 11:30:22.662668402 (46h1m58.702241543s) [seg_pos={0 0}, upload=40453]: Begin upload segment... Sep 8 11:30:22.662728728 (46h1m58.702301858s) [seg_pos={0 0}, upload=40453]: Done begin upload segment. Sep 8 11:30:22.662792650 (46h1m58.70236578s) [noise=true , address=145.79.227.13:4801 , piece_id=VMUW6CKBFDPMENEDXWVXJPPXUCBMWZIOYBEAPUJUX53LD7JMWXGA, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.663318356 (46h1m58.702891476s) [noise=true , address=45.91.116.10:4083 , piece_id=4OWU4AX7M44CFBFO6N4EHYRDMQJN3YWPRW6UMGXDHCYUTKQQR2HA, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.663693774 (46h1m58.703266904s) [noise=true , address=45.91.116.9:4263 , piece_id=MXX4TM66VY2AHGDO5YUVHVQ6KN65BIVLPJRM67NYXNFGUR446A5Q, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.664077208 (46h1m58.703650338s) [noise=true , address=145.79.227.5:4223 , piece_id=WRF4JTGTJNHR64JEX4RVSXKPIPXOP3VJNRT2SESC6BP3FMZASCVQ, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.664440393 (46h1m58.704013523s) [noise=true , address=45.91.116.6:4973 , piece_id=2MMR3OU3S6WADX46CEKH655N7ZBAX2UNOGINNW3VYC7EBPCYHEJQ, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.664888250 (46h1m58.70446138s) [noise=true , address=145.79.227.15:4875 , piece_id=DKMBQQTB2LUF5Z7CXKWXL6XFV364XROLJCFUAE4VVIEUL6UNZZ7A, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.665305769 (46h1m58.704878899s) [noise=true , address=45.91.116.11:4117 , piece_id=QVR7CUSX2TV42RIFZLSKEJH73AHTQHKHLBYR7U4LVJQXGWBOGE4Q, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.665639969 (46h1m58.705213089s) [noise=true , address=77.90.31.18:4806 , piece_id=ASQ5KAUORG4AIPO6T37L6AAR5K4TNMGL6HMYKIS42QARDMRD5C2Q, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.666126189 (46h1m58.705699319s) [noise=true , address=77.90.31.15:4697 , piece_id=EOEKYUYLMGPDPOA2Z36HXLRK6FKRGOKEYG7GUHW3RCGXNDYBKF3Q, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.666647376 (46h1m58.706220506s) [noise=true , address=45.91.116.5:4297 , piece_id=W5OYRS6OMFI7WYQ5IGTKL6KMFQ62MFZ4S7DSMESTXFJW35LJFLKQ, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.667173724 (46h1m58.706746844s) [noise=true , address=145.79.227.4:4186 , piece_id=2EZZOKL2WPS2ASPMVGXX5H3D2UNDZ7RHHBOUUXHKMWEYSJRURQLA, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.667547939 (46h1m58.707121069s) [noise=true , address=45.91.116.13:4154 , piece_id=XFA23JHIUFQC2XJDEWFI5TZVFHX5RCILEWIVNRGAX7EZOMS2HJHQ, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.667917126 (46h1m58.707490256s) [noise=true , address=45.91.116.4:4938 , piece_id=LIKWXIQE6MY35VX4ADH5R2DXWKLFVSEPJ5GZ6KURLYFHX6MJZXRQ, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.668276353 (46h1m58.707849473s) [noise=true , address=45.91.116.4:4939 , piece_id=BGUD5GLFTXWPQY4URTIRIYAVPM5UOVFYEY6ZHCNXSPD3OECXLXIQ, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.668698291 (46h1m58.708271421s) [noise=true , address=45.91.116.5:4299 , piece_id=5AHHS2XFG7Q5YAGMAEACHV3G53QAVWPBVJUYFE63ORHZXL4UKCTA, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.669073759 (46h1m58.708646879s) [noise=true , address=145.79.227.16:4911 , piece_id=HQXIWW7ZISR3OHEYEI5QJKJGHOE6GDJYKPI3DXCYIGGDSL6NWX2A, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:24.457346016 (46h2m0.496919136s) [upload=40453]: Next returned nil segment Sep 8 11:30:24.457368008 (46h2m0.496941129s) [upload=40453]: Waiting for error group managing segments... Sep 8 11:30:24.768032032 (46h2m0.807605152s) [noise=true , address=45.91.116.9:4263 , piece_id=MXX4TM66VY2AHGDO5YUVHVQ6KN65BIVLPJRM67NYXNFGUR446A5Q, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.790832322 (46h2m0.830405442s) [noise=true , address=145.79.227.5:4223 , piece_id=WRF4JTGTJNHR64JEX4RVSXKPIPXOP3VJNRT2SESC6BP3FMZASCVQ, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.791293394 (46h2m0.830866524s) [noise=true , address=45.91.116.4:4938 , piece_id=LIKWXIQE6MY35VX4ADH5R2DXWKLFVSEPJ5GZ6KURLYFHX6MJZXRQ, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.817409740 (46h2m0.85698286s) [noise=true , address=45.91.116.11:4117 , piece_id=QVR7CUSX2TV42RIFZLSKEJH73AHTQHKHLBYR7U4LVJQXGWBOGE4Q, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.818893940 (46h2m0.85846707s) [noise=true , address=145.79.227.16:4911 , piece_id=HQXIWW7ZISR3OHEYEI5QJKJGHOE6GDJYKPI3DXCYIGGDSL6NWX2A, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.840535593 (46h2m0.880108713s) [noise=true , address=45.91.116.5:4299 , piece_id=5AHHS2XFG7Q5YAGMAEACHV3G53QAVWPBVJUYFE63ORHZXL4UKCTA, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.844131393 (46h2m0.883704513s) [noise=true , address=145.79.227.15:4875 , piece_id=DKMBQQTB2LUF5Z7CXKWXL6XFV364XROLJCFUAE4VVIEUL6UNZZ7A, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.865872094 (46h2m0.905445214s) [noise=true , address=45.91.116.6:4973 , piece_id=2MMR3OU3S6WADX46CEKH655N7ZBAX2UNOGINNW3VYC7EBPCYHEJQ, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.867279658 (46h2m0.906852778s) [noise=true , address=145.79.227.13:4801 , piece_id=VMUW6CKBFDPMENEDXWVXJPPXUCBMWZIOYBEAPUJUX53LD7JMWXGA, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.874096092 (46h2m0.913669212s) [noise=true , address=145.79.227.4:4186 , piece_id=2EZZOKL2WPS2ASPMVGXX5H3D2UNDZ7RHHBOUUXHKMWEYSJRURQLA, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.879017710 (46h2m0.91859084s) [noise=true , address=45.91.116.13:4154 , piece_id=XFA23JHIUFQC2XJDEWFI5TZVFHX5RCILEWIVNRGAX7EZOMS2HJHQ, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.965838817 (46h2m1.005411937s) [noise=true , address=45.91.116.5:4297 , piece_id=W5OYRS6OMFI7WYQ5IGTKL6KMFQ62MFZ4S7DSMESTXFJW35LJFLKQ, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:25.114790605 (46h2m1.154363735s) [noise=true , address=77.90.31.15:4697 , piece_id=EOEKYUYLMGPDPOA2Z36HXLRK6FKRGOKEYG7GUHW3RCGXNDYBKF3Q, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:25.114815022 (46h2m1.154388152s) [seg_pos={0 0}, upload=40453]: Segment reached optimal threshold of 13 pieces. Sep 8 11:30:25.115095860 (46h2m1.15466899s) [noise=true , address=45.91.116.10:4083 , piece_id=4OWU4AX7M44CFBFO6N4EHYRDMQJN3YWPRW6UMGXDHCYUTKQQR2HA, seg_pos={0 0}, upload=40453]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Sep 8 11:30:25.115118473 (46h2m1.154691593s) [noise=true , address=45.91.116.4:4939 , piece_id=BGUD5GLFTXWPQY4URTIRIYAVPM5UOVFYEY6ZHCNXSPD3OECXLXIQ, seg_pos={0 0}, upload=40453]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: write tcp 188.166.225.170:37064->45.91.116.4:4939: use of closed network connection; write tcp 188.166.225.170:37064->45.91.116.4:4939: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37064->45.91.116.4:4939: use of closed network connection Sep 8 11:30:25.115167607 (46h2m1.154740727s) [noise=true , address=77.90.31.18:4806 , piece_id=ASQ5KAUORG4AIPO6T37L6AAR5K4TNMGL6HMYKIS42QARDMRD5C2Q, seg_pos={0 0}, upload=40453]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF Sep 8 11:30:25.115207323 (46h2m1.154780443s) [seg_pos={0 0}, upload=40453]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 11:30:25.115331711 (46h2m1.154904841s) [upload=40453]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 11:30:25.115338344 (46h2m1.154911504s) [upload=40453]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 11:30:25.441783696 (46h2m1.481356816s) [upload=40453]: Done uploading segments... Sep 8 11:30:25.441832048 (46h2m1.481405168s) [upload=40453]: Upload finished. err: <nil> Duration: 6.112859567s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...X.................................................X......] duration: 6.260183286s FAIL (2025-09-08 11:34:50 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 11:30:22.397555623 (46h1m58.437128743s) [upload=40453]: Starting upload Sep 8 11:30:22.397662778 (46h1m58.437235898s) [upload=40453]: Done starting upload Sep 8 11:30:22.397761527 (46h1m58.437334657s) [upload=40453]: Uploading segments... Sep 8 11:30:22.398055119 (46h1m58.437628249s) [upload=40453]: Got next segment. Inline: false Sep 8 11:30:22.398100035 (46h1m58.437673155s) [upload=40453]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 11:30:22.398106146 (46h1m58.437679266s) [upload=40453]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 11:30:22.662668402 (46h1m58.702241543s) [seg_pos={0 0}, upload=40453]: Begin upload segment... Sep 8 11:30:22.662728728 (46h1m58.702301858s) [seg_pos={0 0}, upload=40453]: Done begin upload segment. Sep 8 11:30:22.662792650 (46h1m58.70236578s) [noise=true , address=145.79.227.13:4801 , piece_id=VMUW6CKBFDPMENEDXWVXJPPXUCBMWZIOYBEAPUJUX53LD7JMWXGA, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.663318356 (46h1m58.702891476s) [noise=true , address=45.91.116.10:4083 , piece_id=4OWU4AX7M44CFBFO6N4EHYRDMQJN3YWPRW6UMGXDHCYUTKQQR2HA, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.663693774 (46h1m58.703266904s) [noise=true , address=45.91.116.9:4263 , piece_id=MXX4TM66VY2AHGDO5YUVHVQ6KN65BIVLPJRM67NYXNFGUR446A5Q, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.664077208 (46h1m58.703650338s) [noise=true , address=145.79.227.5:4223 , piece_id=WRF4JTGTJNHR64JEX4RVSXKPIPXOP3VJNRT2SESC6BP3FMZASCVQ, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.664440393 (46h1m58.704013523s) [noise=true , address=45.91.116.6:4973 , piece_id=2MMR3OU3S6WADX46CEKH655N7ZBAX2UNOGINNW3VYC7EBPCYHEJQ, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.664888250 (46h1m58.70446138s) [noise=true , address=145.79.227.15:4875 , piece_id=DKMBQQTB2LUF5Z7CXKWXL6XFV364XROLJCFUAE4VVIEUL6UNZZ7A, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.665305769 (46h1m58.704878899s) [noise=true , address=45.91.116.11:4117 , piece_id=QVR7CUSX2TV42RIFZLSKEJH73AHTQHKHLBYR7U4LVJQXGWBOGE4Q, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.665639969 (46h1m58.705213089s) [noise=true , address=77.90.31.18:4806 , piece_id=ASQ5KAUORG4AIPO6T37L6AAR5K4TNMGL6HMYKIS42QARDMRD5C2Q, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.666126189 (46h1m58.705699319s) [noise=true , address=77.90.31.15:4697 , piece_id=EOEKYUYLMGPDPOA2Z36HXLRK6FKRGOKEYG7GUHW3RCGXNDYBKF3Q, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.666647376 (46h1m58.706220506s) [noise=true , address=45.91.116.5:4297 , piece_id=W5OYRS6OMFI7WYQ5IGTKL6KMFQ62MFZ4S7DSMESTXFJW35LJFLKQ, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.667173724 (46h1m58.706746844s) [noise=true , address=145.79.227.4:4186 , piece_id=2EZZOKL2WPS2ASPMVGXX5H3D2UNDZ7RHHBOUUXHKMWEYSJRURQLA, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.667547939 (46h1m58.707121069s) [noise=true , address=45.91.116.13:4154 , piece_id=XFA23JHIUFQC2XJDEWFI5TZVFHX5RCILEWIVNRGAX7EZOMS2HJHQ, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.667917126 (46h1m58.707490256s) [noise=true , address=45.91.116.4:4938 , piece_id=LIKWXIQE6MY35VX4ADH5R2DXWKLFVSEPJ5GZ6KURLYFHX6MJZXRQ, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.668276353 (46h1m58.707849473s) [noise=true , address=45.91.116.4:4939 , piece_id=BGUD5GLFTXWPQY4URTIRIYAVPM5UOVFYEY6ZHCNXSPD3OECXLXIQ, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.668698291 (46h1m58.708271421s) [noise=true , address=45.91.116.5:4299 , piece_id=5AHHS2XFG7Q5YAGMAEACHV3G53QAVWPBVJUYFE63ORHZXL4UKCTA, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.669073759 (46h1m58.708646879s) [noise=true , address=145.79.227.16:4911 , piece_id=HQXIWW7ZISR3OHEYEI5QJKJGHOE6GDJYKPI3DXCYIGGDSL6NWX2A, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:24.457346016 (46h2m0.496919136s) [upload=40453]: Next returned nil segment Sep 8 11:30:24.457368008 (46h2m0.496941129s) [upload=40453]: Waiting for error group managing segments... Sep 8 11:30:24.768032032 (46h2m0.807605152s) [noise=true , address=45.91.116.9:4263 , piece_id=MXX4TM66VY2AHGDO5YUVHVQ6KN65BIVLPJRM67NYXNFGUR446A5Q, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.790832322 (46h2m0.830405442s) [noise=true , address=145.79.227.5:4223 , piece_id=WRF4JTGTJNHR64JEX4RVSXKPIPXOP3VJNRT2SESC6BP3FMZASCVQ, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.791293394 (46h2m0.830866524s) [noise=true , address=45.91.116.4:4938 , piece_id=LIKWXIQE6MY35VX4ADH5R2DXWKLFVSEPJ5GZ6KURLYFHX6MJZXRQ, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.817409740 (46h2m0.85698286s) [noise=true , address=45.91.116.11:4117 , piece_id=QVR7CUSX2TV42RIFZLSKEJH73AHTQHKHLBYR7U4LVJQXGWBOGE4Q, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.818893940 (46h2m0.85846707s) [noise=true , address=145.79.227.16:4911 , piece_id=HQXIWW7ZISR3OHEYEI5QJKJGHOE6GDJYKPI3DXCYIGGDSL6NWX2A, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.840535593 (46h2m0.880108713s) [noise=true , address=45.91.116.5:4299 , piece_id=5AHHS2XFG7Q5YAGMAEACHV3G53QAVWPBVJUYFE63ORHZXL4UKCTA, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.844131393 (46h2m0.883704513s) [noise=true , address=145.79.227.15:4875 , piece_id=DKMBQQTB2LUF5Z7CXKWXL6XFV364XROLJCFUAE4VVIEUL6UNZZ7A, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.865872094 (46h2m0.905445214s) [noise=true , address=45.91.116.6:4973 , piece_id=2MMR3OU3S6WADX46CEKH655N7ZBAX2UNOGINNW3VYC7EBPCYHEJQ, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.867279658 (46h2m0.906852778s) [noise=true , address=145.79.227.13:4801 , piece_id=VMUW6CKBFDPMENEDXWVXJPPXUCBMWZIOYBEAPUJUX53LD7JMWXGA, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.874096092 (46h2m0.913669212s) [noise=true , address=145.79.227.4:4186 , piece_id=2EZZOKL2WPS2ASPMVGXX5H3D2UNDZ7RHHBOUUXHKMWEYSJRURQLA, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.879017710 (46h2m0.91859084s) [noise=true , address=45.91.116.13:4154 , piece_id=XFA23JHIUFQC2XJDEWFI5TZVFHX5RCILEWIVNRGAX7EZOMS2HJHQ, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.965838817 (46h2m1.005411937s) [noise=true , address=45.91.116.5:4297 , piece_id=W5OYRS6OMFI7WYQ5IGTKL6KMFQ62MFZ4S7DSMESTXFJW35LJFLKQ, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:25.114790605 (46h2m1.154363735s) [noise=true , address=77.90.31.15:4697 , piece_id=EOEKYUYLMGPDPOA2Z36HXLRK6FKRGOKEYG7GUHW3RCGXNDYBKF3Q, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:25.114815022 (46h2m1.154388152s) [seg_pos={0 0}, upload=40453]: Segment reached optimal threshold of 13 pieces. Sep 8 11:30:25.115095860 (46h2m1.15466899s) [noise=true , address=45.91.116.10:4083 , piece_id=4OWU4AX7M44CFBFO6N4EHYRDMQJN3YWPRW6UMGXDHCYUTKQQR2HA, seg_pos={0 0}, upload=40453]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Sep 8 11:30:25.115118473 (46h2m1.154691593s) [noise=true , address=45.91.116.4:4939 , piece_id=BGUD5GLFTXWPQY4URTIRIYAVPM5UOVFYEY6ZHCNXSPD3OECXLXIQ, seg_pos={0 0}, upload=40453]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: write tcp 188.166.225.170:37064->45.91.116.4:4939: use of closed network connection; write tcp 188.166.225.170:37064->45.91.116.4:4939: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37064->45.91.116.4:4939: use of closed network connection Sep 8 11:30:25.115167607 (46h2m1.154740727s) [noise=true , address=77.90.31.18:4806 , piece_id=ASQ5KAUORG4AIPO6T37L6AAR5K4TNMGL6HMYKIS42QARDMRD5C2Q, seg_pos={0 0}, upload=40453]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF Sep 8 11:30:25.115207323 (46h2m1.154780443s) [seg_pos={0 0}, upload=40453]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 11:30:25.115331711 (46h2m1.154904841s) [upload=40453]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 11:30:25.115338344 (46h2m1.154911504s) [upload=40453]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 11:30:25.441783696 (46h2m1.481356816s) [upload=40453]: Done uploading segments... Sep 8 11:30:25.441832048 (46h2m1.481405168s) [upload=40453]: Upload finished. err: <nil> Duration: 6.260203975s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [....X.................................................X.....] duration: 6.130395301s FAIL (2025-09-08 11:34:13 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 11:30:22.397555623 (46h1m58.437128743s) [upload=40453]: Starting upload Sep 8 11:30:22.397662778 (46h1m58.437235898s) [upload=40453]: Done starting upload Sep 8 11:30:22.397761527 (46h1m58.437334657s) [upload=40453]: Uploading segments... Sep 8 11:30:22.398055119 (46h1m58.437628249s) [upload=40453]: Got next segment. Inline: false Sep 8 11:30:22.398100035 (46h1m58.437673155s) [upload=40453]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 11:30:22.398106146 (46h1m58.437679266s) [upload=40453]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 11:30:22.662668402 (46h1m58.702241543s) [seg_pos={0 0}, upload=40453]: Begin upload segment... Sep 8 11:30:22.662728728 (46h1m58.702301858s) [seg_pos={0 0}, upload=40453]: Done begin upload segment. Sep 8 11:30:22.662792650 (46h1m58.70236578s) [noise=true , address=145.79.227.13:4801 , piece_id=VMUW6CKBFDPMENEDXWVXJPPXUCBMWZIOYBEAPUJUX53LD7JMWXGA, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.663318356 (46h1m58.702891476s) [noise=true , address=45.91.116.10:4083 , piece_id=4OWU4AX7M44CFBFO6N4EHYRDMQJN3YWPRW6UMGXDHCYUTKQQR2HA, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.663693774 (46h1m58.703266904s) [noise=true , address=45.91.116.9:4263 , piece_id=MXX4TM66VY2AHGDO5YUVHVQ6KN65BIVLPJRM67NYXNFGUR446A5Q, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.664077208 (46h1m58.703650338s) [noise=true , address=145.79.227.5:4223 , piece_id=WRF4JTGTJNHR64JEX4RVSXKPIPXOP3VJNRT2SESC6BP3FMZASCVQ, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.664440393 (46h1m58.704013523s) [noise=true , address=45.91.116.6:4973 , piece_id=2MMR3OU3S6WADX46CEKH655N7ZBAX2UNOGINNW3VYC7EBPCYHEJQ, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.664888250 (46h1m58.70446138s) [noise=true , address=145.79.227.15:4875 , piece_id=DKMBQQTB2LUF5Z7CXKWXL6XFV364XROLJCFUAE4VVIEUL6UNZZ7A, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.665305769 (46h1m58.704878899s) [noise=true , address=45.91.116.11:4117 , piece_id=QVR7CUSX2TV42RIFZLSKEJH73AHTQHKHLBYR7U4LVJQXGWBOGE4Q, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.665639969 (46h1m58.705213089s) [noise=true , address=77.90.31.18:4806 , piece_id=ASQ5KAUORG4AIPO6T37L6AAR5K4TNMGL6HMYKIS42QARDMRD5C2Q, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.666126189 (46h1m58.705699319s) [noise=true , address=77.90.31.15:4697 , piece_id=EOEKYUYLMGPDPOA2Z36HXLRK6FKRGOKEYG7GUHW3RCGXNDYBKF3Q, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.666647376 (46h1m58.706220506s) [noise=true , address=45.91.116.5:4297 , piece_id=W5OYRS6OMFI7WYQ5IGTKL6KMFQ62MFZ4S7DSMESTXFJW35LJFLKQ, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.667173724 (46h1m58.706746844s) [noise=true , address=145.79.227.4:4186 , piece_id=2EZZOKL2WPS2ASPMVGXX5H3D2UNDZ7RHHBOUUXHKMWEYSJRURQLA, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.667547939 (46h1m58.707121069s) [noise=true , address=45.91.116.13:4154 , piece_id=XFA23JHIUFQC2XJDEWFI5TZVFHX5RCILEWIVNRGAX7EZOMS2HJHQ, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.667917126 (46h1m58.707490256s) [noise=true , address=45.91.116.4:4938 , piece_id=LIKWXIQE6MY35VX4ADH5R2DXWKLFVSEPJ5GZ6KURLYFHX6MJZXRQ, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.668276353 (46h1m58.707849473s) [noise=true , address=45.91.116.4:4939 , piece_id=BGUD5GLFTXWPQY4URTIRIYAVPM5UOVFYEY6ZHCNXSPD3OECXLXIQ, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.668698291 (46h1m58.708271421s) [noise=true , address=45.91.116.5:4299 , piece_id=5AHHS2XFG7Q5YAGMAEACHV3G53QAVWPBVJUYFE63ORHZXL4UKCTA, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.669073759 (46h1m58.708646879s) [noise=true , address=145.79.227.16:4911 , piece_id=HQXIWW7ZISR3OHEYEI5QJKJGHOE6GDJYKPI3DXCYIGGDSL6NWX2A, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:24.457346016 (46h2m0.496919136s) [upload=40453]: Next returned nil segment Sep 8 11:30:24.457368008 (46h2m0.496941129s) [upload=40453]: Waiting for error group managing segments... Sep 8 11:30:24.768032032 (46h2m0.807605152s) [noise=true , address=45.91.116.9:4263 , piece_id=MXX4TM66VY2AHGDO5YUVHVQ6KN65BIVLPJRM67NYXNFGUR446A5Q, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.790832322 (46h2m0.830405442s) [noise=true , address=145.79.227.5:4223 , piece_id=WRF4JTGTJNHR64JEX4RVSXKPIPXOP3VJNRT2SESC6BP3FMZASCVQ, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.791293394 (46h2m0.830866524s) [noise=true , address=45.91.116.4:4938 , piece_id=LIKWXIQE6MY35VX4ADH5R2DXWKLFVSEPJ5GZ6KURLYFHX6MJZXRQ, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.817409740 (46h2m0.85698286s) [noise=true , address=45.91.116.11:4117 , piece_id=QVR7CUSX2TV42RIFZLSKEJH73AHTQHKHLBYR7U4LVJQXGWBOGE4Q, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.818893940 (46h2m0.85846707s) [noise=true , address=145.79.227.16:4911 , piece_id=HQXIWW7ZISR3OHEYEI5QJKJGHOE6GDJYKPI3DXCYIGGDSL6NWX2A, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.840535593 (46h2m0.880108713s) [noise=true , address=45.91.116.5:4299 , piece_id=5AHHS2XFG7Q5YAGMAEACHV3G53QAVWPBVJUYFE63ORHZXL4UKCTA, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.844131393 (46h2m0.883704513s) [noise=true , address=145.79.227.15:4875 , piece_id=DKMBQQTB2LUF5Z7CXKWXL6XFV364XROLJCFUAE4VVIEUL6UNZZ7A, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.865872094 (46h2m0.905445214s) [noise=true , address=45.91.116.6:4973 , piece_id=2MMR3OU3S6WADX46CEKH655N7ZBAX2UNOGINNW3VYC7EBPCYHEJQ, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.867279658 (46h2m0.906852778s) [noise=true , address=145.79.227.13:4801 , piece_id=VMUW6CKBFDPMENEDXWVXJPPXUCBMWZIOYBEAPUJUX53LD7JMWXGA, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.874096092 (46h2m0.913669212s) [noise=true , address=145.79.227.4:4186 , piece_id=2EZZOKL2WPS2ASPMVGXX5H3D2UNDZ7RHHBOUUXHKMWEYSJRURQLA, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.879017710 (46h2m0.91859084s) [noise=true , address=45.91.116.13:4154 , piece_id=XFA23JHIUFQC2XJDEWFI5TZVFHX5RCILEWIVNRGAX7EZOMS2HJHQ, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.965838817 (46h2m1.005411937s) [noise=true , address=45.91.116.5:4297 , piece_id=W5OYRS6OMFI7WYQ5IGTKL6KMFQ62MFZ4S7DSMESTXFJW35LJFLKQ, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:25.114790605 (46h2m1.154363735s) [noise=true , address=77.90.31.15:4697 , piece_id=EOEKYUYLMGPDPOA2Z36HXLRK6FKRGOKEYG7GUHW3RCGXNDYBKF3Q, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:25.114815022 (46h2m1.154388152s) [seg_pos={0 0}, upload=40453]: Segment reached optimal threshold of 13 pieces. Sep 8 11:30:25.115095860 (46h2m1.15466899s) [noise=true , address=45.91.116.10:4083 , piece_id=4OWU4AX7M44CFBFO6N4EHYRDMQJN3YWPRW6UMGXDHCYUTKQQR2HA, seg_pos={0 0}, upload=40453]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Sep 8 11:30:25.115118473 (46h2m1.154691593s) [noise=true , address=45.91.116.4:4939 , piece_id=BGUD5GLFTXWPQY4URTIRIYAVPM5UOVFYEY6ZHCNXSPD3OECXLXIQ, seg_pos={0 0}, upload=40453]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: write tcp 188.166.225.170:37064->45.91.116.4:4939: use of closed network connection; write tcp 188.166.225.170:37064->45.91.116.4:4939: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37064->45.91.116.4:4939: use of closed network connection Sep 8 11:30:25.115167607 (46h2m1.154740727s) [noise=true , address=77.90.31.18:4806 , piece_id=ASQ5KAUORG4AIPO6T37L6AAR5K4TNMGL6HMYKIS42QARDMRD5C2Q, seg_pos={0 0}, upload=40453]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF Sep 8 11:30:25.115207323 (46h2m1.154780443s) [seg_pos={0 0}, upload=40453]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 11:30:25.115331711 (46h2m1.154904841s) [upload=40453]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 11:30:25.115338344 (46h2m1.154911504s) [upload=40453]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 11:30:25.441783696 (46h2m1.481356816s) [upload=40453]: Done uploading segments... Sep 8 11:30:25.441832048 (46h2m1.481405168s) [upload=40453]: Upload finished. err: <nil> Duration: 6.130422542s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....X.................................................X....] duration: 6.345299346s FAIL (2025-09-08 11:33:29 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 11:30:22.397555623 (46h1m58.437128743s) [upload=40453]: Starting upload Sep 8 11:30:22.397662778 (46h1m58.437235898s) [upload=40453]: Done starting upload Sep 8 11:30:22.397761527 (46h1m58.437334657s) [upload=40453]: Uploading segments... Sep 8 11:30:22.398055119 (46h1m58.437628249s) [upload=40453]: Got next segment. Inline: false Sep 8 11:30:22.398100035 (46h1m58.437673155s) [upload=40453]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 11:30:22.398106146 (46h1m58.437679266s) [upload=40453]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 11:30:22.662668402 (46h1m58.702241543s) [seg_pos={0 0}, upload=40453]: Begin upload segment... Sep 8 11:30:22.662728728 (46h1m58.702301858s) [seg_pos={0 0}, upload=40453]: Done begin upload segment. Sep 8 11:30:22.662792650 (46h1m58.70236578s) [noise=true , address=145.79.227.13:4801 , piece_id=VMUW6CKBFDPMENEDXWVXJPPXUCBMWZIOYBEAPUJUX53LD7JMWXGA, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.663318356 (46h1m58.702891476s) [noise=true , address=45.91.116.10:4083 , piece_id=4OWU4AX7M44CFBFO6N4EHYRDMQJN3YWPRW6UMGXDHCYUTKQQR2HA, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.663693774 (46h1m58.703266904s) [noise=true , address=45.91.116.9:4263 , piece_id=MXX4TM66VY2AHGDO5YUVHVQ6KN65BIVLPJRM67NYXNFGUR446A5Q, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.664077208 (46h1m58.703650338s) [noise=true , address=145.79.227.5:4223 , piece_id=WRF4JTGTJNHR64JEX4RVSXKPIPXOP3VJNRT2SESC6BP3FMZASCVQ, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.664440393 (46h1m58.704013523s) [noise=true , address=45.91.116.6:4973 , piece_id=2MMR3OU3S6WADX46CEKH655N7ZBAX2UNOGINNW3VYC7EBPCYHEJQ, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.664888250 (46h1m58.70446138s) [noise=true , address=145.79.227.15:4875 , piece_id=DKMBQQTB2LUF5Z7CXKWXL6XFV364XROLJCFUAE4VVIEUL6UNZZ7A, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.665305769 (46h1m58.704878899s) [noise=true , address=45.91.116.11:4117 , piece_id=QVR7CUSX2TV42RIFZLSKEJH73AHTQHKHLBYR7U4LVJQXGWBOGE4Q, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.665639969 (46h1m58.705213089s) [noise=true , address=77.90.31.18:4806 , piece_id=ASQ5KAUORG4AIPO6T37L6AAR5K4TNMGL6HMYKIS42QARDMRD5C2Q, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.666126189 (46h1m58.705699319s) [noise=true , address=77.90.31.15:4697 , piece_id=EOEKYUYLMGPDPOA2Z36HXLRK6FKRGOKEYG7GUHW3RCGXNDYBKF3Q, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.666647376 (46h1m58.706220506s) [noise=true , address=45.91.116.5:4297 , piece_id=W5OYRS6OMFI7WYQ5IGTKL6KMFQ62MFZ4S7DSMESTXFJW35LJFLKQ, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.667173724 (46h1m58.706746844s) [noise=true , address=145.79.227.4:4186 , piece_id=2EZZOKL2WPS2ASPMVGXX5H3D2UNDZ7RHHBOUUXHKMWEYSJRURQLA, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.667547939 (46h1m58.707121069s) [noise=true , address=45.91.116.13:4154 , piece_id=XFA23JHIUFQC2XJDEWFI5TZVFHX5RCILEWIVNRGAX7EZOMS2HJHQ, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.667917126 (46h1m58.707490256s) [noise=true , address=45.91.116.4:4938 , piece_id=LIKWXIQE6MY35VX4ADH5R2DXWKLFVSEPJ5GZ6KURLYFHX6MJZXRQ, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.668276353 (46h1m58.707849473s) [noise=true , address=45.91.116.4:4939 , piece_id=BGUD5GLFTXWPQY4URTIRIYAVPM5UOVFYEY6ZHCNXSPD3OECXLXIQ, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.668698291 (46h1m58.708271421s) [noise=true , address=45.91.116.5:4299 , piece_id=5AHHS2XFG7Q5YAGMAEACHV3G53QAVWPBVJUYFE63ORHZXL4UKCTA, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.669073759 (46h1m58.708646879s) [noise=true , address=145.79.227.16:4911 , piece_id=HQXIWW7ZISR3OHEYEI5QJKJGHOE6GDJYKPI3DXCYIGGDSL6NWX2A, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:24.457346016 (46h2m0.496919136s) [upload=40453]: Next returned nil segment Sep 8 11:30:24.457368008 (46h2m0.496941129s) [upload=40453]: Waiting for error group managing segments... Sep 8 11:30:24.768032032 (46h2m0.807605152s) [noise=true , address=45.91.116.9:4263 , piece_id=MXX4TM66VY2AHGDO5YUVHVQ6KN65BIVLPJRM67NYXNFGUR446A5Q, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.790832322 (46h2m0.830405442s) [noise=true , address=145.79.227.5:4223 , piece_id=WRF4JTGTJNHR64JEX4RVSXKPIPXOP3VJNRT2SESC6BP3FMZASCVQ, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.791293394 (46h2m0.830866524s) [noise=true , address=45.91.116.4:4938 , piece_id=LIKWXIQE6MY35VX4ADH5R2DXWKLFVSEPJ5GZ6KURLYFHX6MJZXRQ, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.817409740 (46h2m0.85698286s) [noise=true , address=45.91.116.11:4117 , piece_id=QVR7CUSX2TV42RIFZLSKEJH73AHTQHKHLBYR7U4LVJQXGWBOGE4Q, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.818893940 (46h2m0.85846707s) [noise=true , address=145.79.227.16:4911 , piece_id=HQXIWW7ZISR3OHEYEI5QJKJGHOE6GDJYKPI3DXCYIGGDSL6NWX2A, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.840535593 (46h2m0.880108713s) [noise=true , address=45.91.116.5:4299 , piece_id=5AHHS2XFG7Q5YAGMAEACHV3G53QAVWPBVJUYFE63ORHZXL4UKCTA, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.844131393 (46h2m0.883704513s) [noise=true , address=145.79.227.15:4875 , piece_id=DKMBQQTB2LUF5Z7CXKWXL6XFV364XROLJCFUAE4VVIEUL6UNZZ7A, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.865872094 (46h2m0.905445214s) [noise=true , address=45.91.116.6:4973 , piece_id=2MMR3OU3S6WADX46CEKH655N7ZBAX2UNOGINNW3VYC7EBPCYHEJQ, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.867279658 (46h2m0.906852778s) [noise=true , address=145.79.227.13:4801 , piece_id=VMUW6CKBFDPMENEDXWVXJPPXUCBMWZIOYBEAPUJUX53LD7JMWXGA, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.874096092 (46h2m0.913669212s) [noise=true , address=145.79.227.4:4186 , piece_id=2EZZOKL2WPS2ASPMVGXX5H3D2UNDZ7RHHBOUUXHKMWEYSJRURQLA, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.879017710 (46h2m0.91859084s) [noise=true , address=45.91.116.13:4154 , piece_id=XFA23JHIUFQC2XJDEWFI5TZVFHX5RCILEWIVNRGAX7EZOMS2HJHQ, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.965838817 (46h2m1.005411937s) [noise=true , address=45.91.116.5:4297 , piece_id=W5OYRS6OMFI7WYQ5IGTKL6KMFQ62MFZ4S7DSMESTXFJW35LJFLKQ, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:25.114790605 (46h2m1.154363735s) [noise=true , address=77.90.31.15:4697 , piece_id=EOEKYUYLMGPDPOA2Z36HXLRK6FKRGOKEYG7GUHW3RCGXNDYBKF3Q, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:25.114815022 (46h2m1.154388152s) [seg_pos={0 0}, upload=40453]: Segment reached optimal threshold of 13 pieces. Sep 8 11:30:25.115095860 (46h2m1.15466899s) [noise=true , address=45.91.116.10:4083 , piece_id=4OWU4AX7M44CFBFO6N4EHYRDMQJN3YWPRW6UMGXDHCYUTKQQR2HA, seg_pos={0 0}, upload=40453]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Sep 8 11:30:25.115118473 (46h2m1.154691593s) [noise=true , address=45.91.116.4:4939 , piece_id=BGUD5GLFTXWPQY4URTIRIYAVPM5UOVFYEY6ZHCNXSPD3OECXLXIQ, seg_pos={0 0}, upload=40453]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: write tcp 188.166.225.170:37064->45.91.116.4:4939: use of closed network connection; write tcp 188.166.225.170:37064->45.91.116.4:4939: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37064->45.91.116.4:4939: use of closed network connection Sep 8 11:30:25.115167607 (46h2m1.154740727s) [noise=true , address=77.90.31.18:4806 , piece_id=ASQ5KAUORG4AIPO6T37L6AAR5K4TNMGL6HMYKIS42QARDMRD5C2Q, seg_pos={0 0}, upload=40453]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF Sep 8 11:30:25.115207323 (46h2m1.154780443s) [seg_pos={0 0}, upload=40453]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 11:30:25.115331711 (46h2m1.154904841s) [upload=40453]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 11:30:25.115338344 (46h2m1.154911504s) [upload=40453]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 11:30:25.441783696 (46h2m1.481356816s) [upload=40453]: Done uploading segments... Sep 8 11:30:25.441832048 (46h2m1.481405168s) [upload=40453]: Upload finished. err: <nil> Duration: 6.345328993s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [......X.................................................X...] duration: 6.096195185s FAIL (2025-09-08 11:32:38 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 11:30:22.397555623 (46h1m58.437128743s) [upload=40453]: Starting upload Sep 8 11:30:22.397662778 (46h1m58.437235898s) [upload=40453]: Done starting upload Sep 8 11:30:22.397761527 (46h1m58.437334657s) [upload=40453]: Uploading segments... Sep 8 11:30:22.398055119 (46h1m58.437628249s) [upload=40453]: Got next segment. Inline: false Sep 8 11:30:22.398100035 (46h1m58.437673155s) [upload=40453]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 11:30:22.398106146 (46h1m58.437679266s) [upload=40453]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 11:30:22.662668402 (46h1m58.702241543s) [seg_pos={0 0}, upload=40453]: Begin upload segment... Sep 8 11:30:22.662728728 (46h1m58.702301858s) [seg_pos={0 0}, upload=40453]: Done begin upload segment. Sep 8 11:30:22.662792650 (46h1m58.70236578s) [noise=true , address=145.79.227.13:4801 , piece_id=VMUW6CKBFDPMENEDXWVXJPPXUCBMWZIOYBEAPUJUX53LD7JMWXGA, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.663318356 (46h1m58.702891476s) [noise=true , address=45.91.116.10:4083 , piece_id=4OWU4AX7M44CFBFO6N4EHYRDMQJN3YWPRW6UMGXDHCYUTKQQR2HA, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.663693774 (46h1m58.703266904s) [noise=true , address=45.91.116.9:4263 , piece_id=MXX4TM66VY2AHGDO5YUVHVQ6KN65BIVLPJRM67NYXNFGUR446A5Q, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.664077208 (46h1m58.703650338s) [noise=true , address=145.79.227.5:4223 , piece_id=WRF4JTGTJNHR64JEX4RVSXKPIPXOP3VJNRT2SESC6BP3FMZASCVQ, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.664440393 (46h1m58.704013523s) [noise=true , address=45.91.116.6:4973 , piece_id=2MMR3OU3S6WADX46CEKH655N7ZBAX2UNOGINNW3VYC7EBPCYHEJQ, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.664888250 (46h1m58.70446138s) [noise=true , address=145.79.227.15:4875 , piece_id=DKMBQQTB2LUF5Z7CXKWXL6XFV364XROLJCFUAE4VVIEUL6UNZZ7A, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.665305769 (46h1m58.704878899s) [noise=true , address=45.91.116.11:4117 , piece_id=QVR7CUSX2TV42RIFZLSKEJH73AHTQHKHLBYR7U4LVJQXGWBOGE4Q, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.665639969 (46h1m58.705213089s) [noise=true , address=77.90.31.18:4806 , piece_id=ASQ5KAUORG4AIPO6T37L6AAR5K4TNMGL6HMYKIS42QARDMRD5C2Q, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.666126189 (46h1m58.705699319s) [noise=true , address=77.90.31.15:4697 , piece_id=EOEKYUYLMGPDPOA2Z36HXLRK6FKRGOKEYG7GUHW3RCGXNDYBKF3Q, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.666647376 (46h1m58.706220506s) [noise=true , address=45.91.116.5:4297 , piece_id=W5OYRS6OMFI7WYQ5IGTKL6KMFQ62MFZ4S7DSMESTXFJW35LJFLKQ, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.667173724 (46h1m58.706746844s) [noise=true , address=145.79.227.4:4186 , piece_id=2EZZOKL2WPS2ASPMVGXX5H3D2UNDZ7RHHBOUUXHKMWEYSJRURQLA, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.667547939 (46h1m58.707121069s) [noise=true , address=45.91.116.13:4154 , piece_id=XFA23JHIUFQC2XJDEWFI5TZVFHX5RCILEWIVNRGAX7EZOMS2HJHQ, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.667917126 (46h1m58.707490256s) [noise=true , address=45.91.116.4:4938 , piece_id=LIKWXIQE6MY35VX4ADH5R2DXWKLFVSEPJ5GZ6KURLYFHX6MJZXRQ, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.668276353 (46h1m58.707849473s) [noise=true , address=45.91.116.4:4939 , piece_id=BGUD5GLFTXWPQY4URTIRIYAVPM5UOVFYEY6ZHCNXSPD3OECXLXIQ, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.668698291 (46h1m58.708271421s) [noise=true , address=45.91.116.5:4299 , piece_id=5AHHS2XFG7Q5YAGMAEACHV3G53QAVWPBVJUYFE63ORHZXL4UKCTA, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.669073759 (46h1m58.708646879s) [noise=true , address=145.79.227.16:4911 , piece_id=HQXIWW7ZISR3OHEYEI5QJKJGHOE6GDJYKPI3DXCYIGGDSL6NWX2A, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:24.457346016 (46h2m0.496919136s) [upload=40453]: Next returned nil segment Sep 8 11:30:24.457368008 (46h2m0.496941129s) [upload=40453]: Waiting for error group managing segments... Sep 8 11:30:24.768032032 (46h2m0.807605152s) [noise=true , address=45.91.116.9:4263 , piece_id=MXX4TM66VY2AHGDO5YUVHVQ6KN65BIVLPJRM67NYXNFGUR446A5Q, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.790832322 (46h2m0.830405442s) [noise=true , address=145.79.227.5:4223 , piece_id=WRF4JTGTJNHR64JEX4RVSXKPIPXOP3VJNRT2SESC6BP3FMZASCVQ, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.791293394 (46h2m0.830866524s) [noise=true , address=45.91.116.4:4938 , piece_id=LIKWXIQE6MY35VX4ADH5R2DXWKLFVSEPJ5GZ6KURLYFHX6MJZXRQ, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.817409740 (46h2m0.85698286s) [noise=true , address=45.91.116.11:4117 , piece_id=QVR7CUSX2TV42RIFZLSKEJH73AHTQHKHLBYR7U4LVJQXGWBOGE4Q, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.818893940 (46h2m0.85846707s) [noise=true , address=145.79.227.16:4911 , piece_id=HQXIWW7ZISR3OHEYEI5QJKJGHOE6GDJYKPI3DXCYIGGDSL6NWX2A, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.840535593 (46h2m0.880108713s) [noise=true , address=45.91.116.5:4299 , piece_id=5AHHS2XFG7Q5YAGMAEACHV3G53QAVWPBVJUYFE63ORHZXL4UKCTA, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.844131393 (46h2m0.883704513s) [noise=true , address=145.79.227.15:4875 , piece_id=DKMBQQTB2LUF5Z7CXKWXL6XFV364XROLJCFUAE4VVIEUL6UNZZ7A, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.865872094 (46h2m0.905445214s) [noise=true , address=45.91.116.6:4973 , piece_id=2MMR3OU3S6WADX46CEKH655N7ZBAX2UNOGINNW3VYC7EBPCYHEJQ, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.867279658 (46h2m0.906852778s) [noise=true , address=145.79.227.13:4801 , piece_id=VMUW6CKBFDPMENEDXWVXJPPXUCBMWZIOYBEAPUJUX53LD7JMWXGA, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.874096092 (46h2m0.913669212s) [noise=true , address=145.79.227.4:4186 , piece_id=2EZZOKL2WPS2ASPMVGXX5H3D2UNDZ7RHHBOUUXHKMWEYSJRURQLA, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.879017710 (46h2m0.91859084s) [noise=true , address=45.91.116.13:4154 , piece_id=XFA23JHIUFQC2XJDEWFI5TZVFHX5RCILEWIVNRGAX7EZOMS2HJHQ, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.965838817 (46h2m1.005411937s) [noise=true , address=45.91.116.5:4297 , piece_id=W5OYRS6OMFI7WYQ5IGTKL6KMFQ62MFZ4S7DSMESTXFJW35LJFLKQ, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:25.114790605 (46h2m1.154363735s) [noise=true , address=77.90.31.15:4697 , piece_id=EOEKYUYLMGPDPOA2Z36HXLRK6FKRGOKEYG7GUHW3RCGXNDYBKF3Q, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:25.114815022 (46h2m1.154388152s) [seg_pos={0 0}, upload=40453]: Segment reached optimal threshold of 13 pieces. Sep 8 11:30:25.115095860 (46h2m1.15466899s) [noise=true , address=45.91.116.10:4083 , piece_id=4OWU4AX7M44CFBFO6N4EHYRDMQJN3YWPRW6UMGXDHCYUTKQQR2HA, seg_pos={0 0}, upload=40453]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Sep 8 11:30:25.115118473 (46h2m1.154691593s) [noise=true , address=45.91.116.4:4939 , piece_id=BGUD5GLFTXWPQY4URTIRIYAVPM5UOVFYEY6ZHCNXSPD3OECXLXIQ, seg_pos={0 0}, upload=40453]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: write tcp 188.166.225.170:37064->45.91.116.4:4939: use of closed network connection; write tcp 188.166.225.170:37064->45.91.116.4:4939: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37064->45.91.116.4:4939: use of closed network connection Sep 8 11:30:25.115167607 (46h2m1.154740727s) [noise=true , address=77.90.31.18:4806 , piece_id=ASQ5KAUORG4AIPO6T37L6AAR5K4TNMGL6HMYKIS42QARDMRD5C2Q, seg_pos={0 0}, upload=40453]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF Sep 8 11:30:25.115207323 (46h2m1.154780443s) [seg_pos={0 0}, upload=40453]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 11:30:25.115331711 (46h2m1.154904841s) [upload=40453]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 11:30:25.115338344 (46h2m1.154911504s) [upload=40453]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 11:30:25.441783696 (46h2m1.481356816s) [upload=40453]: Done uploading segments... Sep 8 11:30:25.441832048 (46h2m1.481405168s) [upload=40453]: Upload finished. err: <nil> Duration: 6.096226584s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......X.................................................X..] duration: 6.059893393s FAIL (2025-09-08 11:32:12 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 11:30:22.397555623 (46h1m58.437128743s) [upload=40453]: Starting upload Sep 8 11:30:22.397662778 (46h1m58.437235898s) [upload=40453]: Done starting upload Sep 8 11:30:22.397761527 (46h1m58.437334657s) [upload=40453]: Uploading segments... Sep 8 11:30:22.398055119 (46h1m58.437628249s) [upload=40453]: Got next segment. Inline: false Sep 8 11:30:22.398100035 (46h1m58.437673155s) [upload=40453]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 11:30:22.398106146 (46h1m58.437679266s) [upload=40453]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 11:30:22.662668402 (46h1m58.702241543s) [seg_pos={0 0}, upload=40453]: Begin upload segment... Sep 8 11:30:22.662728728 (46h1m58.702301858s) [seg_pos={0 0}, upload=40453]: Done begin upload segment. Sep 8 11:30:22.662792650 (46h1m58.70236578s) [noise=true , address=145.79.227.13:4801 , piece_id=VMUW6CKBFDPMENEDXWVXJPPXUCBMWZIOYBEAPUJUX53LD7JMWXGA, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.663318356 (46h1m58.702891476s) [noise=true , address=45.91.116.10:4083 , piece_id=4OWU4AX7M44CFBFO6N4EHYRDMQJN3YWPRW6UMGXDHCYUTKQQR2HA, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.663693774 (46h1m58.703266904s) [noise=true , address=45.91.116.9:4263 , piece_id=MXX4TM66VY2AHGDO5YUVHVQ6KN65BIVLPJRM67NYXNFGUR446A5Q, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.664077208 (46h1m58.703650338s) [noise=true , address=145.79.227.5:4223 , piece_id=WRF4JTGTJNHR64JEX4RVSXKPIPXOP3VJNRT2SESC6BP3FMZASCVQ, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.664440393 (46h1m58.704013523s) [noise=true , address=45.91.116.6:4973 , piece_id=2MMR3OU3S6WADX46CEKH655N7ZBAX2UNOGINNW3VYC7EBPCYHEJQ, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.664888250 (46h1m58.70446138s) [noise=true , address=145.79.227.15:4875 , piece_id=DKMBQQTB2LUF5Z7CXKWXL6XFV364XROLJCFUAE4VVIEUL6UNZZ7A, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.665305769 (46h1m58.704878899s) [noise=true , address=45.91.116.11:4117 , piece_id=QVR7CUSX2TV42RIFZLSKEJH73AHTQHKHLBYR7U4LVJQXGWBOGE4Q, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.665639969 (46h1m58.705213089s) [noise=true , address=77.90.31.18:4806 , piece_id=ASQ5KAUORG4AIPO6T37L6AAR5K4TNMGL6HMYKIS42QARDMRD5C2Q, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.666126189 (46h1m58.705699319s) [noise=true , address=77.90.31.15:4697 , piece_id=EOEKYUYLMGPDPOA2Z36HXLRK6FKRGOKEYG7GUHW3RCGXNDYBKF3Q, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.666647376 (46h1m58.706220506s) [noise=true , address=45.91.116.5:4297 , piece_id=W5OYRS6OMFI7WYQ5IGTKL6KMFQ62MFZ4S7DSMESTXFJW35LJFLKQ, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.667173724 (46h1m58.706746844s) [noise=true , address=145.79.227.4:4186 , piece_id=2EZZOKL2WPS2ASPMVGXX5H3D2UNDZ7RHHBOUUXHKMWEYSJRURQLA, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.667547939 (46h1m58.707121069s) [noise=true , address=45.91.116.13:4154 , piece_id=XFA23JHIUFQC2XJDEWFI5TZVFHX5RCILEWIVNRGAX7EZOMS2HJHQ, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.667917126 (46h1m58.707490256s) [noise=true , address=45.91.116.4:4938 , piece_id=LIKWXIQE6MY35VX4ADH5R2DXWKLFVSEPJ5GZ6KURLYFHX6MJZXRQ, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.668276353 (46h1m58.707849473s) [noise=true , address=45.91.116.4:4939 , piece_id=BGUD5GLFTXWPQY4URTIRIYAVPM5UOVFYEY6ZHCNXSPD3OECXLXIQ, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.668698291 (46h1m58.708271421s) [noise=true , address=45.91.116.5:4299 , piece_id=5AHHS2XFG7Q5YAGMAEACHV3G53QAVWPBVJUYFE63ORHZXL4UKCTA, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.669073759 (46h1m58.708646879s) [noise=true , address=145.79.227.16:4911 , piece_id=HQXIWW7ZISR3OHEYEI5QJKJGHOE6GDJYKPI3DXCYIGGDSL6NWX2A, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:24.457346016 (46h2m0.496919136s) [upload=40453]: Next returned nil segment Sep 8 11:30:24.457368008 (46h2m0.496941129s) [upload=40453]: Waiting for error group managing segments... Sep 8 11:30:24.768032032 (46h2m0.807605152s) [noise=true , address=45.91.116.9:4263 , piece_id=MXX4TM66VY2AHGDO5YUVHVQ6KN65BIVLPJRM67NYXNFGUR446A5Q, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.790832322 (46h2m0.830405442s) [noise=true , address=145.79.227.5:4223 , piece_id=WRF4JTGTJNHR64JEX4RVSXKPIPXOP3VJNRT2SESC6BP3FMZASCVQ, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.791293394 (46h2m0.830866524s) [noise=true , address=45.91.116.4:4938 , piece_id=LIKWXIQE6MY35VX4ADH5R2DXWKLFVSEPJ5GZ6KURLYFHX6MJZXRQ, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.817409740 (46h2m0.85698286s) [noise=true , address=45.91.116.11:4117 , piece_id=QVR7CUSX2TV42RIFZLSKEJH73AHTQHKHLBYR7U4LVJQXGWBOGE4Q, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.818893940 (46h2m0.85846707s) [noise=true , address=145.79.227.16:4911 , piece_id=HQXIWW7ZISR3OHEYEI5QJKJGHOE6GDJYKPI3DXCYIGGDSL6NWX2A, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.840535593 (46h2m0.880108713s) [noise=true , address=45.91.116.5:4299 , piece_id=5AHHS2XFG7Q5YAGMAEACHV3G53QAVWPBVJUYFE63ORHZXL4UKCTA, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.844131393 (46h2m0.883704513s) [noise=true , address=145.79.227.15:4875 , piece_id=DKMBQQTB2LUF5Z7CXKWXL6XFV364XROLJCFUAE4VVIEUL6UNZZ7A, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.865872094 (46h2m0.905445214s) [noise=true , address=45.91.116.6:4973 , piece_id=2MMR3OU3S6WADX46CEKH655N7ZBAX2UNOGINNW3VYC7EBPCYHEJQ, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.867279658 (46h2m0.906852778s) [noise=true , address=145.79.227.13:4801 , piece_id=VMUW6CKBFDPMENEDXWVXJPPXUCBMWZIOYBEAPUJUX53LD7JMWXGA, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.874096092 (46h2m0.913669212s) [noise=true , address=145.79.227.4:4186 , piece_id=2EZZOKL2WPS2ASPMVGXX5H3D2UNDZ7RHHBOUUXHKMWEYSJRURQLA, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.879017710 (46h2m0.91859084s) [noise=true , address=45.91.116.13:4154 , piece_id=XFA23JHIUFQC2XJDEWFI5TZVFHX5RCILEWIVNRGAX7EZOMS2HJHQ, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.965838817 (46h2m1.005411937s) [noise=true , address=45.91.116.5:4297 , piece_id=W5OYRS6OMFI7WYQ5IGTKL6KMFQ62MFZ4S7DSMESTXFJW35LJFLKQ, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:25.114790605 (46h2m1.154363735s) [noise=true , address=77.90.31.15:4697 , piece_id=EOEKYUYLMGPDPOA2Z36HXLRK6FKRGOKEYG7GUHW3RCGXNDYBKF3Q, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:25.114815022 (46h2m1.154388152s) [seg_pos={0 0}, upload=40453]: Segment reached optimal threshold of 13 pieces. Sep 8 11:30:25.115095860 (46h2m1.15466899s) [noise=true , address=45.91.116.10:4083 , piece_id=4OWU4AX7M44CFBFO6N4EHYRDMQJN3YWPRW6UMGXDHCYUTKQQR2HA, seg_pos={0 0}, upload=40453]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Sep 8 11:30:25.115118473 (46h2m1.154691593s) [noise=true , address=45.91.116.4:4939 , piece_id=BGUD5GLFTXWPQY4URTIRIYAVPM5UOVFYEY6ZHCNXSPD3OECXLXIQ, seg_pos={0 0}, upload=40453]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: write tcp 188.166.225.170:37064->45.91.116.4:4939: use of closed network connection; write tcp 188.166.225.170:37064->45.91.116.4:4939: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37064->45.91.116.4:4939: use of closed network connection Sep 8 11:30:25.115167607 (46h2m1.154740727s) [noise=true , address=77.90.31.18:4806 , piece_id=ASQ5KAUORG4AIPO6T37L6AAR5K4TNMGL6HMYKIS42QARDMRD5C2Q, seg_pos={0 0}, upload=40453]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF Sep 8 11:30:25.115207323 (46h2m1.154780443s) [seg_pos={0 0}, upload=40453]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 11:30:25.115331711 (46h2m1.154904841s) [upload=40453]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 11:30:25.115338344 (46h2m1.154911504s) [upload=40453]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 11:30:25.441783696 (46h2m1.481356816s) [upload=40453]: Done uploading segments... Sep 8 11:30:25.441832048 (46h2m1.481405168s) [upload=40453]: Upload finished. err: <nil> Duration: 6.059920444s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [........X.................................................X.] duration: 6.299365537s FAIL (2025-09-08 11:30:58 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 11:30:22.397555623 (46h1m58.437128743s) [upload=40453]: Starting upload Sep 8 11:30:22.397662778 (46h1m58.437235898s) [upload=40453]: Done starting upload Sep 8 11:30:22.397761527 (46h1m58.437334657s) [upload=40453]: Uploading segments... Sep 8 11:30:22.398055119 (46h1m58.437628249s) [upload=40453]: Got next segment. Inline: false Sep 8 11:30:22.398100035 (46h1m58.437673155s) [upload=40453]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 11:30:22.398106146 (46h1m58.437679266s) [upload=40453]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 11:30:22.662668402 (46h1m58.702241543s) [seg_pos={0 0}, upload=40453]: Begin upload segment... Sep 8 11:30:22.662728728 (46h1m58.702301858s) [seg_pos={0 0}, upload=40453]: Done begin upload segment. Sep 8 11:30:22.662792650 (46h1m58.70236578s) [noise=true , address=145.79.227.13:4801 , piece_id=VMUW6CKBFDPMENEDXWVXJPPXUCBMWZIOYBEAPUJUX53LD7JMWXGA, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.663318356 (46h1m58.702891476s) [noise=true , address=45.91.116.10:4083 , piece_id=4OWU4AX7M44CFBFO6N4EHYRDMQJN3YWPRW6UMGXDHCYUTKQQR2HA, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.663693774 (46h1m58.703266904s) [noise=true , address=45.91.116.9:4263 , piece_id=MXX4TM66VY2AHGDO5YUVHVQ6KN65BIVLPJRM67NYXNFGUR446A5Q, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.664077208 (46h1m58.703650338s) [noise=true , address=145.79.227.5:4223 , piece_id=WRF4JTGTJNHR64JEX4RVSXKPIPXOP3VJNRT2SESC6BP3FMZASCVQ, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.664440393 (46h1m58.704013523s) [noise=true , address=45.91.116.6:4973 , piece_id=2MMR3OU3S6WADX46CEKH655N7ZBAX2UNOGINNW3VYC7EBPCYHEJQ, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.664888250 (46h1m58.70446138s) [noise=true , address=145.79.227.15:4875 , piece_id=DKMBQQTB2LUF5Z7CXKWXL6XFV364XROLJCFUAE4VVIEUL6UNZZ7A, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.665305769 (46h1m58.704878899s) [noise=true , address=45.91.116.11:4117 , piece_id=QVR7CUSX2TV42RIFZLSKEJH73AHTQHKHLBYR7U4LVJQXGWBOGE4Q, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.665639969 (46h1m58.705213089s) [noise=true , address=77.90.31.18:4806 , piece_id=ASQ5KAUORG4AIPO6T37L6AAR5K4TNMGL6HMYKIS42QARDMRD5C2Q, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.666126189 (46h1m58.705699319s) [noise=true , address=77.90.31.15:4697 , piece_id=EOEKYUYLMGPDPOA2Z36HXLRK6FKRGOKEYG7GUHW3RCGXNDYBKF3Q, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.666647376 (46h1m58.706220506s) [noise=true , address=45.91.116.5:4297 , piece_id=W5OYRS6OMFI7WYQ5IGTKL6KMFQ62MFZ4S7DSMESTXFJW35LJFLKQ, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.667173724 (46h1m58.706746844s) [noise=true , address=145.79.227.4:4186 , piece_id=2EZZOKL2WPS2ASPMVGXX5H3D2UNDZ7RHHBOUUXHKMWEYSJRURQLA, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.667547939 (46h1m58.707121069s) [noise=true , address=45.91.116.13:4154 , piece_id=XFA23JHIUFQC2XJDEWFI5TZVFHX5RCILEWIVNRGAX7EZOMS2HJHQ, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.667917126 (46h1m58.707490256s) [noise=true , address=45.91.116.4:4938 , piece_id=LIKWXIQE6MY35VX4ADH5R2DXWKLFVSEPJ5GZ6KURLYFHX6MJZXRQ, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.668276353 (46h1m58.707849473s) [noise=true , address=45.91.116.4:4939 , piece_id=BGUD5GLFTXWPQY4URTIRIYAVPM5UOVFYEY6ZHCNXSPD3OECXLXIQ, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.668698291 (46h1m58.708271421s) [noise=true , address=45.91.116.5:4299 , piece_id=5AHHS2XFG7Q5YAGMAEACHV3G53QAVWPBVJUYFE63ORHZXL4UKCTA, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.669073759 (46h1m58.708646879s) [noise=true , address=145.79.227.16:4911 , piece_id=HQXIWW7ZISR3OHEYEI5QJKJGHOE6GDJYKPI3DXCYIGGDSL6NWX2A, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:24.457346016 (46h2m0.496919136s) [upload=40453]: Next returned nil segment Sep 8 11:30:24.457368008 (46h2m0.496941129s) [upload=40453]: Waiting for error group managing segments... Sep 8 11:30:24.768032032 (46h2m0.807605152s) [noise=true , address=45.91.116.9:4263 , piece_id=MXX4TM66VY2AHGDO5YUVHVQ6KN65BIVLPJRM67NYXNFGUR446A5Q, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.790832322 (46h2m0.830405442s) [noise=true , address=145.79.227.5:4223 , piece_id=WRF4JTGTJNHR64JEX4RVSXKPIPXOP3VJNRT2SESC6BP3FMZASCVQ, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.791293394 (46h2m0.830866524s) [noise=true , address=45.91.116.4:4938 , piece_id=LIKWXIQE6MY35VX4ADH5R2DXWKLFVSEPJ5GZ6KURLYFHX6MJZXRQ, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.817409740 (46h2m0.85698286s) [noise=true , address=45.91.116.11:4117 , piece_id=QVR7CUSX2TV42RIFZLSKEJH73AHTQHKHLBYR7U4LVJQXGWBOGE4Q, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.818893940 (46h2m0.85846707s) [noise=true , address=145.79.227.16:4911 , piece_id=HQXIWW7ZISR3OHEYEI5QJKJGHOE6GDJYKPI3DXCYIGGDSL6NWX2A, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.840535593 (46h2m0.880108713s) [noise=true , address=45.91.116.5:4299 , piece_id=5AHHS2XFG7Q5YAGMAEACHV3G53QAVWPBVJUYFE63ORHZXL4UKCTA, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.844131393 (46h2m0.883704513s) [noise=true , address=145.79.227.15:4875 , piece_id=DKMBQQTB2LUF5Z7CXKWXL6XFV364XROLJCFUAE4VVIEUL6UNZZ7A, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.865872094 (46h2m0.905445214s) [noise=true , address=45.91.116.6:4973 , piece_id=2MMR3OU3S6WADX46CEKH655N7ZBAX2UNOGINNW3VYC7EBPCYHEJQ, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.867279658 (46h2m0.906852778s) [noise=true , address=145.79.227.13:4801 , piece_id=VMUW6CKBFDPMENEDXWVXJPPXUCBMWZIOYBEAPUJUX53LD7JMWXGA, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.874096092 (46h2m0.913669212s) [noise=true , address=145.79.227.4:4186 , piece_id=2EZZOKL2WPS2ASPMVGXX5H3D2UNDZ7RHHBOUUXHKMWEYSJRURQLA, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.879017710 (46h2m0.91859084s) [noise=true , address=45.91.116.13:4154 , piece_id=XFA23JHIUFQC2XJDEWFI5TZVFHX5RCILEWIVNRGAX7EZOMS2HJHQ, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.965838817 (46h2m1.005411937s) [noise=true , address=45.91.116.5:4297 , piece_id=W5OYRS6OMFI7WYQ5IGTKL6KMFQ62MFZ4S7DSMESTXFJW35LJFLKQ, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:25.114790605 (46h2m1.154363735s) [noise=true , address=77.90.31.15:4697 , piece_id=EOEKYUYLMGPDPOA2Z36HXLRK6FKRGOKEYG7GUHW3RCGXNDYBKF3Q, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:25.114815022 (46h2m1.154388152s) [seg_pos={0 0}, upload=40453]: Segment reached optimal threshold of 13 pieces. Sep 8 11:30:25.115095860 (46h2m1.15466899s) [noise=true , address=45.91.116.10:4083 , piece_id=4OWU4AX7M44CFBFO6N4EHYRDMQJN3YWPRW6UMGXDHCYUTKQQR2HA, seg_pos={0 0}, upload=40453]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Sep 8 11:30:25.115118473 (46h2m1.154691593s) [noise=true , address=45.91.116.4:4939 , piece_id=BGUD5GLFTXWPQY4URTIRIYAVPM5UOVFYEY6ZHCNXSPD3OECXLXIQ, seg_pos={0 0}, upload=40453]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: write tcp 188.166.225.170:37064->45.91.116.4:4939: use of closed network connection; write tcp 188.166.225.170:37064->45.91.116.4:4939: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37064->45.91.116.4:4939: use of closed network connection Sep 8 11:30:25.115167607 (46h2m1.154740727s) [noise=true , address=77.90.31.18:4806 , piece_id=ASQ5KAUORG4AIPO6T37L6AAR5K4TNMGL6HMYKIS42QARDMRD5C2Q, seg_pos={0 0}, upload=40453]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF Sep 8 11:30:25.115207323 (46h2m1.154780443s) [seg_pos={0 0}, upload=40453]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 11:30:25.115331711 (46h2m1.154904841s) [upload=40453]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 11:30:25.115338344 (46h2m1.154911504s) [upload=40453]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 11:30:25.441783696 (46h2m1.481356816s) [upload=40453]: Done uploading segments... Sep 8 11:30:25.441832048 (46h2m1.481405168s) [upload=40453]: Upload finished. err: <nil> Duration: 6.299383099s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........X.................................................X] duration: 30.002676035s FAIL (2025-09-08 11:30:51 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 11:30:22.397555623 (46h1m58.437128743s) [upload=40453]: Starting upload Sep 8 11:30:22.397662778 (46h1m58.437235898s) [upload=40453]: Done starting upload Sep 8 11:30:22.397761527 (46h1m58.437334657s) [upload=40453]: Uploading segments... Sep 8 11:30:22.398055119 (46h1m58.437628249s) [upload=40453]: Got next segment. Inline: false Sep 8 11:30:22.398100035 (46h1m58.437673155s) [upload=40453]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 11:30:22.398106146 (46h1m58.437679266s) [upload=40453]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 11:30:22.662668402 (46h1m58.702241543s) [seg_pos={0 0}, upload=40453]: Begin upload segment... Sep 8 11:30:22.662728728 (46h1m58.702301858s) [seg_pos={0 0}, upload=40453]: Done begin upload segment. Sep 8 11:30:22.662792650 (46h1m58.70236578s) [noise=true , address=145.79.227.13:4801 , piece_id=VMUW6CKBFDPMENEDXWVXJPPXUCBMWZIOYBEAPUJUX53LD7JMWXGA, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.663318356 (46h1m58.702891476s) [noise=true , address=45.91.116.10:4083 , piece_id=4OWU4AX7M44CFBFO6N4EHYRDMQJN3YWPRW6UMGXDHCYUTKQQR2HA, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.663693774 (46h1m58.703266904s) [noise=true , address=45.91.116.9:4263 , piece_id=MXX4TM66VY2AHGDO5YUVHVQ6KN65BIVLPJRM67NYXNFGUR446A5Q, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.664077208 (46h1m58.703650338s) [noise=true , address=145.79.227.5:4223 , piece_id=WRF4JTGTJNHR64JEX4RVSXKPIPXOP3VJNRT2SESC6BP3FMZASCVQ, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.664440393 (46h1m58.704013523s) [noise=true , address=45.91.116.6:4973 , piece_id=2MMR3OU3S6WADX46CEKH655N7ZBAX2UNOGINNW3VYC7EBPCYHEJQ, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.664888250 (46h1m58.70446138s) [noise=true , address=145.79.227.15:4875 , piece_id=DKMBQQTB2LUF5Z7CXKWXL6XFV364XROLJCFUAE4VVIEUL6UNZZ7A, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.665305769 (46h1m58.704878899s) [noise=true , address=45.91.116.11:4117 , piece_id=QVR7CUSX2TV42RIFZLSKEJH73AHTQHKHLBYR7U4LVJQXGWBOGE4Q, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.665639969 (46h1m58.705213089s) [noise=true , address=77.90.31.18:4806 , piece_id=ASQ5KAUORG4AIPO6T37L6AAR5K4TNMGL6HMYKIS42QARDMRD5C2Q, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.666126189 (46h1m58.705699319s) [noise=true , address=77.90.31.15:4697 , piece_id=EOEKYUYLMGPDPOA2Z36HXLRK6FKRGOKEYG7GUHW3RCGXNDYBKF3Q, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.666647376 (46h1m58.706220506s) [noise=true , address=45.91.116.5:4297 , piece_id=W5OYRS6OMFI7WYQ5IGTKL6KMFQ62MFZ4S7DSMESTXFJW35LJFLKQ, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.667173724 (46h1m58.706746844s) [noise=true , address=145.79.227.4:4186 , piece_id=2EZZOKL2WPS2ASPMVGXX5H3D2UNDZ7RHHBOUUXHKMWEYSJRURQLA, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.667547939 (46h1m58.707121069s) [noise=true , address=45.91.116.13:4154 , piece_id=XFA23JHIUFQC2XJDEWFI5TZVFHX5RCILEWIVNRGAX7EZOMS2HJHQ, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.667917126 (46h1m58.707490256s) [noise=true , address=45.91.116.4:4938 , piece_id=LIKWXIQE6MY35VX4ADH5R2DXWKLFVSEPJ5GZ6KURLYFHX6MJZXRQ, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.668276353 (46h1m58.707849473s) [noise=true , address=45.91.116.4:4939 , piece_id=BGUD5GLFTXWPQY4URTIRIYAVPM5UOVFYEY6ZHCNXSPD3OECXLXIQ, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.668698291 (46h1m58.708271421s) [noise=true , address=45.91.116.5:4299 , piece_id=5AHHS2XFG7Q5YAGMAEACHV3G53QAVWPBVJUYFE63ORHZXL4UKCTA, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:22.669073759 (46h1m58.708646879s) [noise=true , address=145.79.227.16:4911 , piece_id=HQXIWW7ZISR3OHEYEI5QJKJGHOE6GDJYKPI3DXCYIGGDSL6NWX2A, seg_pos={0 0}, upload=40453]: Uploading piece... Sep 8 11:30:24.457346016 (46h2m0.496919136s) [upload=40453]: Next returned nil segment Sep 8 11:30:24.457368008 (46h2m0.496941129s) [upload=40453]: Waiting for error group managing segments... Sep 8 11:30:24.768032032 (46h2m0.807605152s) [noise=true , address=45.91.116.9:4263 , piece_id=MXX4TM66VY2AHGDO5YUVHVQ6KN65BIVLPJRM67NYXNFGUR446A5Q, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.790832322 (46h2m0.830405442s) [noise=true , address=145.79.227.5:4223 , piece_id=WRF4JTGTJNHR64JEX4RVSXKPIPXOP3VJNRT2SESC6BP3FMZASCVQ, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.791293394 (46h2m0.830866524s) [noise=true , address=45.91.116.4:4938 , piece_id=LIKWXIQE6MY35VX4ADH5R2DXWKLFVSEPJ5GZ6KURLYFHX6MJZXRQ, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.817409740 (46h2m0.85698286s) [noise=true , address=45.91.116.11:4117 , piece_id=QVR7CUSX2TV42RIFZLSKEJH73AHTQHKHLBYR7U4LVJQXGWBOGE4Q, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.818893940 (46h2m0.85846707s) [noise=true , address=145.79.227.16:4911 , piece_id=HQXIWW7ZISR3OHEYEI5QJKJGHOE6GDJYKPI3DXCYIGGDSL6NWX2A, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.840535593 (46h2m0.880108713s) [noise=true , address=45.91.116.5:4299 , piece_id=5AHHS2XFG7Q5YAGMAEACHV3G53QAVWPBVJUYFE63ORHZXL4UKCTA, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.844131393 (46h2m0.883704513s) [noise=true , address=145.79.227.15:4875 , piece_id=DKMBQQTB2LUF5Z7CXKWXL6XFV364XROLJCFUAE4VVIEUL6UNZZ7A, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.865872094 (46h2m0.905445214s) [noise=true , address=45.91.116.6:4973 , piece_id=2MMR3OU3S6WADX46CEKH655N7ZBAX2UNOGINNW3VYC7EBPCYHEJQ, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.867279658 (46h2m0.906852778s) [noise=true , address=145.79.227.13:4801 , piece_id=VMUW6CKBFDPMENEDXWVXJPPXUCBMWZIOYBEAPUJUX53LD7JMWXGA, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.874096092 (46h2m0.913669212s) [noise=true , address=145.79.227.4:4186 , piece_id=2EZZOKL2WPS2ASPMVGXX5H3D2UNDZ7RHHBOUUXHKMWEYSJRURQLA, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.879017710 (46h2m0.91859084s) [noise=true , address=45.91.116.13:4154 , piece_id=XFA23JHIUFQC2XJDEWFI5TZVFHX5RCILEWIVNRGAX7EZOMS2HJHQ, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:24.965838817 (46h2m1.005411937s) [noise=true , address=45.91.116.5:4297 , piece_id=W5OYRS6OMFI7WYQ5IGTKL6KMFQ62MFZ4S7DSMESTXFJW35LJFLKQ, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:25.114790605 (46h2m1.154363735s) [noise=true , address=77.90.31.15:4697 , piece_id=EOEKYUYLMGPDPOA2Z36HXLRK6FKRGOKEYG7GUHW3RCGXNDYBKF3Q, seg_pos={0 0}, upload=40453]: Done uploading piece. err: <nil> Sep 8 11:30:25.114815022 (46h2m1.154388152s) [seg_pos={0 0}, upload=40453]: Segment reached optimal threshold of 13 pieces. Sep 8 11:30:25.115095860 (46h2m1.15466899s) [noise=true , address=45.91.116.10:4083 , piece_id=4OWU4AX7M44CFBFO6N4EHYRDMQJN3YWPRW6UMGXDHCYUTKQQR2HA, seg_pos={0 0}, upload=40453]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Sep 8 11:30:25.115118473 (46h2m1.154691593s) [noise=true , address=45.91.116.4:4939 , piece_id=BGUD5GLFTXWPQY4URTIRIYAVPM5UOVFYEY6ZHCNXSPD3OECXLXIQ, seg_pos={0 0}, upload=40453]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: write tcp 188.166.225.170:37064->45.91.116.4:4939: use of closed network connection; write tcp 188.166.225.170:37064->45.91.116.4:4939: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37064->45.91.116.4:4939: use of closed network connection Sep 8 11:30:25.115167607 (46h2m1.154740727s) [noise=true , address=77.90.31.18:4806 , piece_id=ASQ5KAUORG4AIPO6T37L6AAR5K4TNMGL6HMYKIS42QARDMRD5C2Q, seg_pos={0 0}, upload=40453]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF Sep 8 11:30:25.115207323 (46h2m1.154780443s) [seg_pos={0 0}, upload=40453]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 11:30:25.115331711 (46h2m1.154904841s) [upload=40453]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 11:30:25.115338344 (46h2m1.154911504s) [upload=40453]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 11:30:25.441783696 (46h2m1.481356816s) [upload=40453]: Done uploading segments... Sep 8 11:30:25.441832048 (46h2m1.481405168s) [upload=40453]: Upload finished. err: <nil> Duration: 30.00269924s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 5.983283472s FAIL (2025-09-08 11:29:50 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 10:50:54.996737456 (45h22m31.036310576s) [upload=39871]: Starting upload Sep 8 10:50:54.996796369 (45h22m31.036369499s) [upload=39871]: Done starting upload Sep 8 10:50:54.996927921 (45h22m31.036501041s) [upload=39871]: Uploading segments... Sep 8 10:50:54.997046097 (45h22m31.036619217s) [upload=39871]: Got next segment. Inline: false Sep 8 10:50:54.997085543 (45h22m31.036658703s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 10:50:54.997093277 (45h22m31.036666427s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 10:50:55.262079152 (45h22m31.301652283s) [seg_pos={0 0}, upload=39871]: Begin upload segment... Sep 8 10:50:55.262128356 (45h22m31.301701476s) [seg_pos={0 0}, upload=39871]: Done begin upload segment. Sep 8 10:50:55.262146942 (45h22m31.301720062s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262156830 (45h22m31.30172995s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262502612 (45h22m31.302075732s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262872480 (45h22m31.302445601s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263230676 (45h22m31.302803796s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263492266 (45h22m31.303065386s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263718008 (45h22m31.303291129s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263781820 (45h22m31.30335494s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263953148 (45h22m31.303526268s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264180223 (45h22m31.303753343s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264391336 (45h22m31.303964456s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264787515 (45h22m31.304360655s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265102637 (45h22m31.304675757s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265414084 (45h22m31.304987204s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265622652 (45h22m31.305195772s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.266156605 (45h22m31.305729745s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:57.069064983 (45h22m33.108638103s) [upload=39871]: Next returned nil segment Sep 8 10:50:57.069083619 (45h22m33.108656729s) [upload=39871]: Waiting for error group managing segments... Sep 8 10:50:57.358709524 (45h22m33.398282644s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.418851458 (45h22m33.458424578s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.422887822 (45h22m33.462460942s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.426244124 (45h22m33.465817244s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.438594908 (45h22m33.478168028s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.477758539 (45h22m33.517331659s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.478283144 (45h22m33.517856264s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.494427878 (45h22m33.534000998s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.498758564 (45h22m33.538331684s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.519426042 (45h22m33.558999163s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.537375701 (45h22m33.576948811s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.544671341 (45h22m33.584244461s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553767086 (45h22m33.593340206s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553786884 (45h22m33.593360004s) [seg_pos={0 0}, upload=39871]: Segment reached optimal threshold of 13 pieces. Sep 8 10:50:57.553982909 (45h22m33.593556029s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554038305 (45h22m33.593611425s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554102648 (45h22m33.593675768s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE): protocol: write tcp 188.166.225.170:38400->104.36.82.2:4732: use of closed network connection; conn closed: op Sep 8 10:50:57.554156411 (45h22m33.593729531s) [seg_pos={0 0}, upload=39871]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 10:50:57.554221035 (45h22m33.593794155s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 10:50:57.554225534 (45h22m33.593798654s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 10:50:57.879588342 (45h22m33.919161462s) [upload=39871]: Done uploading segments... Sep 8 10:50:57.879607679 (45h22m33.9191808s) [upload=39871]: Upload finished. err: <nil> Duration: 5.98330344s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 27.899869006s FAIL (2025-09-08 11:29:44 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 10:50:54.996737456 (45h22m31.036310576s) [upload=39871]: Starting upload Sep 8 10:50:54.996796369 (45h22m31.036369499s) [upload=39871]: Done starting upload Sep 8 10:50:54.996927921 (45h22m31.036501041s) [upload=39871]: Uploading segments... Sep 8 10:50:54.997046097 (45h22m31.036619217s) [upload=39871]: Got next segment. Inline: false Sep 8 10:50:54.997085543 (45h22m31.036658703s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 10:50:54.997093277 (45h22m31.036666427s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 10:50:55.262079152 (45h22m31.301652283s) [seg_pos={0 0}, upload=39871]: Begin upload segment... Sep 8 10:50:55.262128356 (45h22m31.301701476s) [seg_pos={0 0}, upload=39871]: Done begin upload segment. Sep 8 10:50:55.262146942 (45h22m31.301720062s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262156830 (45h22m31.30172995s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262502612 (45h22m31.302075732s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262872480 (45h22m31.302445601s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263230676 (45h22m31.302803796s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263492266 (45h22m31.303065386s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263718008 (45h22m31.303291129s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263781820 (45h22m31.30335494s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263953148 (45h22m31.303526268s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264180223 (45h22m31.303753343s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264391336 (45h22m31.303964456s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264787515 (45h22m31.304360655s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265102637 (45h22m31.304675757s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265414084 (45h22m31.304987204s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265622652 (45h22m31.305195772s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.266156605 (45h22m31.305729745s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:57.069064983 (45h22m33.108638103s) [upload=39871]: Next returned nil segment Sep 8 10:50:57.069083619 (45h22m33.108656729s) [upload=39871]: Waiting for error group managing segments... Sep 8 10:50:57.358709524 (45h22m33.398282644s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.418851458 (45h22m33.458424578s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.422887822 (45h22m33.462460942s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.426244124 (45h22m33.465817244s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.438594908 (45h22m33.478168028s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.477758539 (45h22m33.517331659s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.478283144 (45h22m33.517856264s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.494427878 (45h22m33.534000998s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.498758564 (45h22m33.538331684s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.519426042 (45h22m33.558999163s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.537375701 (45h22m33.576948811s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.544671341 (45h22m33.584244461s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553767086 (45h22m33.593340206s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553786884 (45h22m33.593360004s) [seg_pos={0 0}, upload=39871]: Segment reached optimal threshold of 13 pieces. Sep 8 10:50:57.553982909 (45h22m33.593556029s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554038305 (45h22m33.593611425s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554102648 (45h22m33.593675768s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE): protocol: write tcp 188.166.225.170:38400->104.36.82.2:4732: use of closed network connection; conn closed: op Sep 8 10:50:57.554156411 (45h22m33.593729531s) [seg_pos={0 0}, upload=39871]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 10:50:57.554221035 (45h22m33.593794155s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 10:50:57.554225534 (45h22m33.593798654s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 10:50:57.879588342 (45h22m33.919161462s) [upload=39871]: Done uploading segments... Sep 8 10:50:57.879607679 (45h22m33.9191808s) [upload=39871]: Upload finished. err: <nil> Duration: 27.899897551s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 6.660514287s FAIL (2025-09-08 11:29:00 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 10:50:54.996737456 (45h22m31.036310576s) [upload=39871]: Starting upload Sep 8 10:50:54.996796369 (45h22m31.036369499s) [upload=39871]: Done starting upload Sep 8 10:50:54.996927921 (45h22m31.036501041s) [upload=39871]: Uploading segments... Sep 8 10:50:54.997046097 (45h22m31.036619217s) [upload=39871]: Got next segment. Inline: false Sep 8 10:50:54.997085543 (45h22m31.036658703s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 10:50:54.997093277 (45h22m31.036666427s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 10:50:55.262079152 (45h22m31.301652283s) [seg_pos={0 0}, upload=39871]: Begin upload segment... Sep 8 10:50:55.262128356 (45h22m31.301701476s) [seg_pos={0 0}, upload=39871]: Done begin upload segment. Sep 8 10:50:55.262146942 (45h22m31.301720062s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262156830 (45h22m31.30172995s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262502612 (45h22m31.302075732s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262872480 (45h22m31.302445601s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263230676 (45h22m31.302803796s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263492266 (45h22m31.303065386s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263718008 (45h22m31.303291129s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263781820 (45h22m31.30335494s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263953148 (45h22m31.303526268s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264180223 (45h22m31.303753343s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264391336 (45h22m31.303964456s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264787515 (45h22m31.304360655s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265102637 (45h22m31.304675757s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265414084 (45h22m31.304987204s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265622652 (45h22m31.305195772s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.266156605 (45h22m31.305729745s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:57.069064983 (45h22m33.108638103s) [upload=39871]: Next returned nil segment Sep 8 10:50:57.069083619 (45h22m33.108656729s) [upload=39871]: Waiting for error group managing segments... Sep 8 10:50:57.358709524 (45h22m33.398282644s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.418851458 (45h22m33.458424578s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.422887822 (45h22m33.462460942s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.426244124 (45h22m33.465817244s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.438594908 (45h22m33.478168028s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.477758539 (45h22m33.517331659s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.478283144 (45h22m33.517856264s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.494427878 (45h22m33.534000998s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.498758564 (45h22m33.538331684s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.519426042 (45h22m33.558999163s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.537375701 (45h22m33.576948811s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.544671341 (45h22m33.584244461s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553767086 (45h22m33.593340206s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553786884 (45h22m33.593360004s) [seg_pos={0 0}, upload=39871]: Segment reached optimal threshold of 13 pieces. Sep 8 10:50:57.553982909 (45h22m33.593556029s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554038305 (45h22m33.593611425s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554102648 (45h22m33.593675768s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE): protocol: write tcp 188.166.225.170:38400->104.36.82.2:4732: use of closed network connection; conn closed: op Sep 8 10:50:57.554156411 (45h22m33.593729531s) [seg_pos={0 0}, upload=39871]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 10:50:57.554221035 (45h22m33.593794155s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 10:50:57.554225534 (45h22m33.593798654s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 10:50:57.879588342 (45h22m33.919161462s) [upload=39871]: Done uploading segments... Sep 8 10:50:57.879607679 (45h22m33.9191808s) [upload=39871]: Upload finished. err: <nil> Duration: 6.660543403s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 6.622771425s FAIL (2025-09-08 11:27:58 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 10:50:54.996737456 (45h22m31.036310576s) [upload=39871]: Starting upload Sep 8 10:50:54.996796369 (45h22m31.036369499s) [upload=39871]: Done starting upload Sep 8 10:50:54.996927921 (45h22m31.036501041s) [upload=39871]: Uploading segments... Sep 8 10:50:54.997046097 (45h22m31.036619217s) [upload=39871]: Got next segment. Inline: false Sep 8 10:50:54.997085543 (45h22m31.036658703s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 10:50:54.997093277 (45h22m31.036666427s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 10:50:55.262079152 (45h22m31.301652283s) [seg_pos={0 0}, upload=39871]: Begin upload segment... Sep 8 10:50:55.262128356 (45h22m31.301701476s) [seg_pos={0 0}, upload=39871]: Done begin upload segment. Sep 8 10:50:55.262146942 (45h22m31.301720062s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262156830 (45h22m31.30172995s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262502612 (45h22m31.302075732s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262872480 (45h22m31.302445601s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263230676 (45h22m31.302803796s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263492266 (45h22m31.303065386s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263718008 (45h22m31.303291129s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263781820 (45h22m31.30335494s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263953148 (45h22m31.303526268s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264180223 (45h22m31.303753343s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264391336 (45h22m31.303964456s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264787515 (45h22m31.304360655s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265102637 (45h22m31.304675757s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265414084 (45h22m31.304987204s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265622652 (45h22m31.305195772s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.266156605 (45h22m31.305729745s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:57.069064983 (45h22m33.108638103s) [upload=39871]: Next returned nil segment Sep 8 10:50:57.069083619 (45h22m33.108656729s) [upload=39871]: Waiting for error group managing segments... Sep 8 10:50:57.358709524 (45h22m33.398282644s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.418851458 (45h22m33.458424578s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.422887822 (45h22m33.462460942s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.426244124 (45h22m33.465817244s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.438594908 (45h22m33.478168028s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.477758539 (45h22m33.517331659s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.478283144 (45h22m33.517856264s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.494427878 (45h22m33.534000998s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.498758564 (45h22m33.538331684s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.519426042 (45h22m33.558999163s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.537375701 (45h22m33.576948811s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.544671341 (45h22m33.584244461s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553767086 (45h22m33.593340206s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553786884 (45h22m33.593360004s) [seg_pos={0 0}, upload=39871]: Segment reached optimal threshold of 13 pieces. Sep 8 10:50:57.553982909 (45h22m33.593556029s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554038305 (45h22m33.593611425s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554102648 (45h22m33.593675768s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE): protocol: write tcp 188.166.225.170:38400->104.36.82.2:4732: use of closed network connection; conn closed: op Sep 8 10:50:57.554156411 (45h22m33.593729531s) [seg_pos={0 0}, upload=39871]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 10:50:57.554221035 (45h22m33.593794155s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 10:50:57.554225534 (45h22m33.593798654s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 10:50:57.879588342 (45h22m33.919161462s) [upload=39871]: Done uploading segments... Sep 8 10:50:57.879607679 (45h22m33.9191808s) [upload=39871]: Upload finished. err: <nil> Duration: 6.622804559s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 6.043002529s FAIL (2025-09-08 11:27:34 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 10:50:54.996737456 (45h22m31.036310576s) [upload=39871]: Starting upload Sep 8 10:50:54.996796369 (45h22m31.036369499s) [upload=39871]: Done starting upload Sep 8 10:50:54.996927921 (45h22m31.036501041s) [upload=39871]: Uploading segments... Sep 8 10:50:54.997046097 (45h22m31.036619217s) [upload=39871]: Got next segment. Inline: false Sep 8 10:50:54.997085543 (45h22m31.036658703s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 10:50:54.997093277 (45h22m31.036666427s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 10:50:55.262079152 (45h22m31.301652283s) [seg_pos={0 0}, upload=39871]: Begin upload segment... Sep 8 10:50:55.262128356 (45h22m31.301701476s) [seg_pos={0 0}, upload=39871]: Done begin upload segment. Sep 8 10:50:55.262146942 (45h22m31.301720062s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262156830 (45h22m31.30172995s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262502612 (45h22m31.302075732s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262872480 (45h22m31.302445601s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263230676 (45h22m31.302803796s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263492266 (45h22m31.303065386s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263718008 (45h22m31.303291129s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263781820 (45h22m31.30335494s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263953148 (45h22m31.303526268s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264180223 (45h22m31.303753343s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264391336 (45h22m31.303964456s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264787515 (45h22m31.304360655s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265102637 (45h22m31.304675757s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265414084 (45h22m31.304987204s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265622652 (45h22m31.305195772s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.266156605 (45h22m31.305729745s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:57.069064983 (45h22m33.108638103s) [upload=39871]: Next returned nil segment Sep 8 10:50:57.069083619 (45h22m33.108656729s) [upload=39871]: Waiting for error group managing segments... Sep 8 10:50:57.358709524 (45h22m33.398282644s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.418851458 (45h22m33.458424578s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.422887822 (45h22m33.462460942s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.426244124 (45h22m33.465817244s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.438594908 (45h22m33.478168028s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.477758539 (45h22m33.517331659s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.478283144 (45h22m33.517856264s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.494427878 (45h22m33.534000998s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.498758564 (45h22m33.538331684s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.519426042 (45h22m33.558999163s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.537375701 (45h22m33.576948811s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.544671341 (45h22m33.584244461s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553767086 (45h22m33.593340206s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553786884 (45h22m33.593360004s) [seg_pos={0 0}, upload=39871]: Segment reached optimal threshold of 13 pieces. Sep 8 10:50:57.553982909 (45h22m33.593556029s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554038305 (45h22m33.593611425s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554102648 (45h22m33.593675768s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE): protocol: write tcp 188.166.225.170:38400->104.36.82.2:4732: use of closed network connection; conn closed: op Sep 8 10:50:57.554156411 (45h22m33.593729531s) [seg_pos={0 0}, upload=39871]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 10:50:57.554221035 (45h22m33.593794155s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 10:50:57.554225534 (45h22m33.593798654s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 10:50:57.879588342 (45h22m33.919161462s) [upload=39871]: Done uploading segments... Sep 8 10:50:57.879607679 (45h22m33.9191808s) [upload=39871]: Upload finished. err: <nil> Duration: 6.04302935s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 6.013898465s FAIL (2025-09-08 11:26:22 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 10:50:54.996737456 (45h22m31.036310576s) [upload=39871]: Starting upload Sep 8 10:50:54.996796369 (45h22m31.036369499s) [upload=39871]: Done starting upload Sep 8 10:50:54.996927921 (45h22m31.036501041s) [upload=39871]: Uploading segments... Sep 8 10:50:54.997046097 (45h22m31.036619217s) [upload=39871]: Got next segment. Inline: false Sep 8 10:50:54.997085543 (45h22m31.036658703s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 10:50:54.997093277 (45h22m31.036666427s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 10:50:55.262079152 (45h22m31.301652283s) [seg_pos={0 0}, upload=39871]: Begin upload segment... Sep 8 10:50:55.262128356 (45h22m31.301701476s) [seg_pos={0 0}, upload=39871]: Done begin upload segment. Sep 8 10:50:55.262146942 (45h22m31.301720062s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262156830 (45h22m31.30172995s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262502612 (45h22m31.302075732s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262872480 (45h22m31.302445601s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263230676 (45h22m31.302803796s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263492266 (45h22m31.303065386s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263718008 (45h22m31.303291129s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263781820 (45h22m31.30335494s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263953148 (45h22m31.303526268s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264180223 (45h22m31.303753343s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264391336 (45h22m31.303964456s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264787515 (45h22m31.304360655s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265102637 (45h22m31.304675757s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265414084 (45h22m31.304987204s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265622652 (45h22m31.305195772s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.266156605 (45h22m31.305729745s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:57.069064983 (45h22m33.108638103s) [upload=39871]: Next returned nil segment Sep 8 10:50:57.069083619 (45h22m33.108656729s) [upload=39871]: Waiting for error group managing segments... Sep 8 10:50:57.358709524 (45h22m33.398282644s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.418851458 (45h22m33.458424578s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.422887822 (45h22m33.462460942s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.426244124 (45h22m33.465817244s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.438594908 (45h22m33.478168028s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.477758539 (45h22m33.517331659s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.478283144 (45h22m33.517856264s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.494427878 (45h22m33.534000998s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.498758564 (45h22m33.538331684s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.519426042 (45h22m33.558999163s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.537375701 (45h22m33.576948811s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.544671341 (45h22m33.584244461s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553767086 (45h22m33.593340206s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553786884 (45h22m33.593360004s) [seg_pos={0 0}, upload=39871]: Segment reached optimal threshold of 13 pieces. Sep 8 10:50:57.553982909 (45h22m33.593556029s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554038305 (45h22m33.593611425s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554102648 (45h22m33.593675768s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE): protocol: write tcp 188.166.225.170:38400->104.36.82.2:4732: use of closed network connection; conn closed: op Sep 8 10:50:57.554156411 (45h22m33.593729531s) [seg_pos={0 0}, upload=39871]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 10:50:57.554221035 (45h22m33.593794155s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 10:50:57.554225534 (45h22m33.593798654s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 10:50:57.879588342 (45h22m33.919161462s) [upload=39871]: Done uploading segments... Sep 8 10:50:57.879607679 (45h22m33.9191808s) [upload=39871]: Upload finished. err: <nil> Duration: 6.013928664s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 6.405325204s FAIL (2025-09-08 11:25:34 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 10:50:54.996737456 (45h22m31.036310576s) [upload=39871]: Starting upload Sep 8 10:50:54.996796369 (45h22m31.036369499s) [upload=39871]: Done starting upload Sep 8 10:50:54.996927921 (45h22m31.036501041s) [upload=39871]: Uploading segments... Sep 8 10:50:54.997046097 (45h22m31.036619217s) [upload=39871]: Got next segment. Inline: false Sep 8 10:50:54.997085543 (45h22m31.036658703s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 10:50:54.997093277 (45h22m31.036666427s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 10:50:55.262079152 (45h22m31.301652283s) [seg_pos={0 0}, upload=39871]: Begin upload segment... Sep 8 10:50:55.262128356 (45h22m31.301701476s) [seg_pos={0 0}, upload=39871]: Done begin upload segment. Sep 8 10:50:55.262146942 (45h22m31.301720062s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262156830 (45h22m31.30172995s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262502612 (45h22m31.302075732s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262872480 (45h22m31.302445601s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263230676 (45h22m31.302803796s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263492266 (45h22m31.303065386s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263718008 (45h22m31.303291129s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263781820 (45h22m31.30335494s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263953148 (45h22m31.303526268s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264180223 (45h22m31.303753343s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264391336 (45h22m31.303964456s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264787515 (45h22m31.304360655s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265102637 (45h22m31.304675757s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265414084 (45h22m31.304987204s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265622652 (45h22m31.305195772s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.266156605 (45h22m31.305729745s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:57.069064983 (45h22m33.108638103s) [upload=39871]: Next returned nil segment Sep 8 10:50:57.069083619 (45h22m33.108656729s) [upload=39871]: Waiting for error group managing segments... Sep 8 10:50:57.358709524 (45h22m33.398282644s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.418851458 (45h22m33.458424578s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.422887822 (45h22m33.462460942s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.426244124 (45h22m33.465817244s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.438594908 (45h22m33.478168028s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.477758539 (45h22m33.517331659s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.478283144 (45h22m33.517856264s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.494427878 (45h22m33.534000998s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.498758564 (45h22m33.538331684s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.519426042 (45h22m33.558999163s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.537375701 (45h22m33.576948811s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.544671341 (45h22m33.584244461s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553767086 (45h22m33.593340206s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553786884 (45h22m33.593360004s) [seg_pos={0 0}, upload=39871]: Segment reached optimal threshold of 13 pieces. Sep 8 10:50:57.553982909 (45h22m33.593556029s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554038305 (45h22m33.593611425s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554102648 (45h22m33.593675768s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE): protocol: write tcp 188.166.225.170:38400->104.36.82.2:4732: use of closed network connection; conn closed: op Sep 8 10:50:57.554156411 (45h22m33.593729531s) [seg_pos={0 0}, upload=39871]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 10:50:57.554221035 (45h22m33.593794155s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 10:50:57.554225534 (45h22m33.593798654s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 10:50:57.879588342 (45h22m33.919161462s) [upload=39871]: Done uploading segments... Sep 8 10:50:57.879607679 (45h22m33.9191808s) [upload=39871]: Upload finished. err: <nil> Duration: 6.405352616s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 7.047073742s FAIL (2025-09-08 11:24:38 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 10:50:54.996737456 (45h22m31.036310576s) [upload=39871]: Starting upload Sep 8 10:50:54.996796369 (45h22m31.036369499s) [upload=39871]: Done starting upload Sep 8 10:50:54.996927921 (45h22m31.036501041s) [upload=39871]: Uploading segments... Sep 8 10:50:54.997046097 (45h22m31.036619217s) [upload=39871]: Got next segment. Inline: false Sep 8 10:50:54.997085543 (45h22m31.036658703s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 10:50:54.997093277 (45h22m31.036666427s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 10:50:55.262079152 (45h22m31.301652283s) [seg_pos={0 0}, upload=39871]: Begin upload segment... Sep 8 10:50:55.262128356 (45h22m31.301701476s) [seg_pos={0 0}, upload=39871]: Done begin upload segment. Sep 8 10:50:55.262146942 (45h22m31.301720062s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262156830 (45h22m31.30172995s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262502612 (45h22m31.302075732s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262872480 (45h22m31.302445601s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263230676 (45h22m31.302803796s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263492266 (45h22m31.303065386s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263718008 (45h22m31.303291129s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263781820 (45h22m31.30335494s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263953148 (45h22m31.303526268s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264180223 (45h22m31.303753343s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264391336 (45h22m31.303964456s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264787515 (45h22m31.304360655s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265102637 (45h22m31.304675757s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265414084 (45h22m31.304987204s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265622652 (45h22m31.305195772s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.266156605 (45h22m31.305729745s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:57.069064983 (45h22m33.108638103s) [upload=39871]: Next returned nil segment Sep 8 10:50:57.069083619 (45h22m33.108656729s) [upload=39871]: Waiting for error group managing segments... Sep 8 10:50:57.358709524 (45h22m33.398282644s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.418851458 (45h22m33.458424578s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.422887822 (45h22m33.462460942s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.426244124 (45h22m33.465817244s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.438594908 (45h22m33.478168028s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.477758539 (45h22m33.517331659s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.478283144 (45h22m33.517856264s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.494427878 (45h22m33.534000998s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.498758564 (45h22m33.538331684s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.519426042 (45h22m33.558999163s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.537375701 (45h22m33.576948811s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.544671341 (45h22m33.584244461s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553767086 (45h22m33.593340206s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553786884 (45h22m33.593360004s) [seg_pos={0 0}, upload=39871]: Segment reached optimal threshold of 13 pieces. Sep 8 10:50:57.553982909 (45h22m33.593556029s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554038305 (45h22m33.593611425s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554102648 (45h22m33.593675768s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE): protocol: write tcp 188.166.225.170:38400->104.36.82.2:4732: use of closed network connection; conn closed: op Sep 8 10:50:57.554156411 (45h22m33.593729531s) [seg_pos={0 0}, upload=39871]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 10:50:57.554221035 (45h22m33.593794155s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 10:50:57.554225534 (45h22m33.593798654s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 10:50:57.879588342 (45h22m33.919161462s) [upload=39871]: Done uploading segments... Sep 8 10:50:57.879607679 (45h22m33.9191808s) [upload=39871]: Upload finished. err: <nil> Duration: 7.047096386s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 8.675212045s FAIL (2025-09-08 11:24:16 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 10:50:54.996737456 (45h22m31.036310576s) [upload=39871]: Starting upload Sep 8 10:50:54.996796369 (45h22m31.036369499s) [upload=39871]: Done starting upload Sep 8 10:50:54.996927921 (45h22m31.036501041s) [upload=39871]: Uploading segments... Sep 8 10:50:54.997046097 (45h22m31.036619217s) [upload=39871]: Got next segment. Inline: false Sep 8 10:50:54.997085543 (45h22m31.036658703s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 10:50:54.997093277 (45h22m31.036666427s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 10:50:55.262079152 (45h22m31.301652283s) [seg_pos={0 0}, upload=39871]: Begin upload segment... Sep 8 10:50:55.262128356 (45h22m31.301701476s) [seg_pos={0 0}, upload=39871]: Done begin upload segment. Sep 8 10:50:55.262146942 (45h22m31.301720062s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262156830 (45h22m31.30172995s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262502612 (45h22m31.302075732s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262872480 (45h22m31.302445601s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263230676 (45h22m31.302803796s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263492266 (45h22m31.303065386s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263718008 (45h22m31.303291129s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263781820 (45h22m31.30335494s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263953148 (45h22m31.303526268s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264180223 (45h22m31.303753343s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264391336 (45h22m31.303964456s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264787515 (45h22m31.304360655s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265102637 (45h22m31.304675757s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265414084 (45h22m31.304987204s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265622652 (45h22m31.305195772s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.266156605 (45h22m31.305729745s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:57.069064983 (45h22m33.108638103s) [upload=39871]: Next returned nil segment Sep 8 10:50:57.069083619 (45h22m33.108656729s) [upload=39871]: Waiting for error group managing segments... Sep 8 10:50:57.358709524 (45h22m33.398282644s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.418851458 (45h22m33.458424578s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.422887822 (45h22m33.462460942s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.426244124 (45h22m33.465817244s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.438594908 (45h22m33.478168028s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.477758539 (45h22m33.517331659s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.478283144 (45h22m33.517856264s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.494427878 (45h22m33.534000998s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.498758564 (45h22m33.538331684s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.519426042 (45h22m33.558999163s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.537375701 (45h22m33.576948811s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.544671341 (45h22m33.584244461s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553767086 (45h22m33.593340206s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553786884 (45h22m33.593360004s) [seg_pos={0 0}, upload=39871]: Segment reached optimal threshold of 13 pieces. Sep 8 10:50:57.553982909 (45h22m33.593556029s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554038305 (45h22m33.593611425s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554102648 (45h22m33.593675768s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE): protocol: write tcp 188.166.225.170:38400->104.36.82.2:4732: use of closed network connection; conn closed: op Sep 8 10:50:57.554156411 (45h22m33.593729531s) [seg_pos={0 0}, upload=39871]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 10:50:57.554221035 (45h22m33.593794155s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 10:50:57.554225534 (45h22m33.593798654s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 10:50:57.879588342 (45h22m33.919161462s) [upload=39871]: Done uploading segments... Sep 8 10:50:57.879607679 (45h22m33.9191808s) [upload=39871]: Upload finished. err: <nil> Duration: 8.675242624s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 22.50291814s FAIL (2025-09-08 11:23:20 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 10:50:54.996737456 (45h22m31.036310576s) [upload=39871]: Starting upload Sep 8 10:50:54.996796369 (45h22m31.036369499s) [upload=39871]: Done starting upload Sep 8 10:50:54.996927921 (45h22m31.036501041s) [upload=39871]: Uploading segments... Sep 8 10:50:54.997046097 (45h22m31.036619217s) [upload=39871]: Got next segment. Inline: false Sep 8 10:50:54.997085543 (45h22m31.036658703s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 10:50:54.997093277 (45h22m31.036666427s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 10:50:55.262079152 (45h22m31.301652283s) [seg_pos={0 0}, upload=39871]: Begin upload segment... Sep 8 10:50:55.262128356 (45h22m31.301701476s) [seg_pos={0 0}, upload=39871]: Done begin upload segment. Sep 8 10:50:55.262146942 (45h22m31.301720062s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262156830 (45h22m31.30172995s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262502612 (45h22m31.302075732s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262872480 (45h22m31.302445601s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263230676 (45h22m31.302803796s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263492266 (45h22m31.303065386s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263718008 (45h22m31.303291129s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263781820 (45h22m31.30335494s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263953148 (45h22m31.303526268s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264180223 (45h22m31.303753343s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264391336 (45h22m31.303964456s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264787515 (45h22m31.304360655s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265102637 (45h22m31.304675757s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265414084 (45h22m31.304987204s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265622652 (45h22m31.305195772s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.266156605 (45h22m31.305729745s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:57.069064983 (45h22m33.108638103s) [upload=39871]: Next returned nil segment Sep 8 10:50:57.069083619 (45h22m33.108656729s) [upload=39871]: Waiting for error group managing segments... Sep 8 10:50:57.358709524 (45h22m33.398282644s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.418851458 (45h22m33.458424578s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.422887822 (45h22m33.462460942s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.426244124 (45h22m33.465817244s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.438594908 (45h22m33.478168028s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.477758539 (45h22m33.517331659s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.478283144 (45h22m33.517856264s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.494427878 (45h22m33.534000998s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.498758564 (45h22m33.538331684s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.519426042 (45h22m33.558999163s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.537375701 (45h22m33.576948811s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.544671341 (45h22m33.584244461s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553767086 (45h22m33.593340206s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553786884 (45h22m33.593360004s) [seg_pos={0 0}, upload=39871]: Segment reached optimal threshold of 13 pieces. Sep 8 10:50:57.553982909 (45h22m33.593556029s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554038305 (45h22m33.593611425s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554102648 (45h22m33.593675768s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE): protocol: write tcp 188.166.225.170:38400->104.36.82.2:4732: use of closed network connection; conn closed: op Sep 8 10:50:57.554156411 (45h22m33.593729531s) [seg_pos={0 0}, upload=39871]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 10:50:57.554221035 (45h22m33.593794155s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 10:50:57.554225534 (45h22m33.593798654s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 10:50:57.879588342 (45h22m33.919161462s) [upload=39871]: Done uploading segments... Sep 8 10:50:57.879607679 (45h22m33.9191808s) [upload=39871]: Upload finished. err: <nil> Duration: 22.502946715s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 6.174365692s FAIL (2025-09-08 11:22:32 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 10:50:54.996737456 (45h22m31.036310576s) [upload=39871]: Starting upload Sep 8 10:50:54.996796369 (45h22m31.036369499s) [upload=39871]: Done starting upload Sep 8 10:50:54.996927921 (45h22m31.036501041s) [upload=39871]: Uploading segments... Sep 8 10:50:54.997046097 (45h22m31.036619217s) [upload=39871]: Got next segment. Inline: false Sep 8 10:50:54.997085543 (45h22m31.036658703s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 10:50:54.997093277 (45h22m31.036666427s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 10:50:55.262079152 (45h22m31.301652283s) [seg_pos={0 0}, upload=39871]: Begin upload segment... Sep 8 10:50:55.262128356 (45h22m31.301701476s) [seg_pos={0 0}, upload=39871]: Done begin upload segment. Sep 8 10:50:55.262146942 (45h22m31.301720062s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262156830 (45h22m31.30172995s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262502612 (45h22m31.302075732s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262872480 (45h22m31.302445601s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263230676 (45h22m31.302803796s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263492266 (45h22m31.303065386s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263718008 (45h22m31.303291129s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263781820 (45h22m31.30335494s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263953148 (45h22m31.303526268s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264180223 (45h22m31.303753343s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264391336 (45h22m31.303964456s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264787515 (45h22m31.304360655s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265102637 (45h22m31.304675757s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265414084 (45h22m31.304987204s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265622652 (45h22m31.305195772s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.266156605 (45h22m31.305729745s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:57.069064983 (45h22m33.108638103s) [upload=39871]: Next returned nil segment Sep 8 10:50:57.069083619 (45h22m33.108656729s) [upload=39871]: Waiting for error group managing segments... Sep 8 10:50:57.358709524 (45h22m33.398282644s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.418851458 (45h22m33.458424578s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.422887822 (45h22m33.462460942s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.426244124 (45h22m33.465817244s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.438594908 (45h22m33.478168028s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.477758539 (45h22m33.517331659s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.478283144 (45h22m33.517856264s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.494427878 (45h22m33.534000998s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.498758564 (45h22m33.538331684s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.519426042 (45h22m33.558999163s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.537375701 (45h22m33.576948811s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.544671341 (45h22m33.584244461s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553767086 (45h22m33.593340206s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553786884 (45h22m33.593360004s) [seg_pos={0 0}, upload=39871]: Segment reached optimal threshold of 13 pieces. Sep 8 10:50:57.553982909 (45h22m33.593556029s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554038305 (45h22m33.593611425s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554102648 (45h22m33.593675768s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE): protocol: write tcp 188.166.225.170:38400->104.36.82.2:4732: use of closed network connection; conn closed: op Sep 8 10:50:57.554156411 (45h22m33.593729531s) [seg_pos={0 0}, upload=39871]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 10:50:57.554221035 (45h22m33.593794155s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 10:50:57.554225534 (45h22m33.593798654s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 10:50:57.879588342 (45h22m33.919161462s) [upload=39871]: Done uploading segments... Sep 8 10:50:57.879607679 (45h22m33.9191808s) [upload=39871]: Upload finished. err: <nil> Duration: 6.174444282s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 6.29081785s FAIL (2025-09-08 11:21:32 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 10:50:54.996737456 (45h22m31.036310576s) [upload=39871]: Starting upload Sep 8 10:50:54.996796369 (45h22m31.036369499s) [upload=39871]: Done starting upload Sep 8 10:50:54.996927921 (45h22m31.036501041s) [upload=39871]: Uploading segments... Sep 8 10:50:54.997046097 (45h22m31.036619217s) [upload=39871]: Got next segment. Inline: false Sep 8 10:50:54.997085543 (45h22m31.036658703s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 10:50:54.997093277 (45h22m31.036666427s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 10:50:55.262079152 (45h22m31.301652283s) [seg_pos={0 0}, upload=39871]: Begin upload segment... Sep 8 10:50:55.262128356 (45h22m31.301701476s) [seg_pos={0 0}, upload=39871]: Done begin upload segment. Sep 8 10:50:55.262146942 (45h22m31.301720062s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262156830 (45h22m31.30172995s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262502612 (45h22m31.302075732s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262872480 (45h22m31.302445601s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263230676 (45h22m31.302803796s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263492266 (45h22m31.303065386s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263718008 (45h22m31.303291129s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263781820 (45h22m31.30335494s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263953148 (45h22m31.303526268s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264180223 (45h22m31.303753343s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264391336 (45h22m31.303964456s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264787515 (45h22m31.304360655s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265102637 (45h22m31.304675757s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265414084 (45h22m31.304987204s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265622652 (45h22m31.305195772s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.266156605 (45h22m31.305729745s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:57.069064983 (45h22m33.108638103s) [upload=39871]: Next returned nil segment Sep 8 10:50:57.069083619 (45h22m33.108656729s) [upload=39871]: Waiting for error group managing segments... Sep 8 10:50:57.358709524 (45h22m33.398282644s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.418851458 (45h22m33.458424578s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.422887822 (45h22m33.462460942s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.426244124 (45h22m33.465817244s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.438594908 (45h22m33.478168028s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.477758539 (45h22m33.517331659s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.478283144 (45h22m33.517856264s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.494427878 (45h22m33.534000998s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.498758564 (45h22m33.538331684s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.519426042 (45h22m33.558999163s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.537375701 (45h22m33.576948811s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.544671341 (45h22m33.584244461s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553767086 (45h22m33.593340206s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553786884 (45h22m33.593360004s) [seg_pos={0 0}, upload=39871]: Segment reached optimal threshold of 13 pieces. Sep 8 10:50:57.553982909 (45h22m33.593556029s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554038305 (45h22m33.593611425s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554102648 (45h22m33.593675768s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE): protocol: write tcp 188.166.225.170:38400->104.36.82.2:4732: use of closed network connection; conn closed: op Sep 8 10:50:57.554156411 (45h22m33.593729531s) [seg_pos={0 0}, upload=39871]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 10:50:57.554221035 (45h22m33.593794155s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 10:50:57.554225534 (45h22m33.593798654s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 10:50:57.879588342 (45h22m33.919161462s) [upload=39871]: Done uploading segments... Sep 8 10:50:57.879607679 (45h22m33.9191808s) [upload=39871]: Upload finished. err: <nil> Duration: 6.290848279s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 6.128661014s FAIL (2025-09-08 11:20:25 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 10:50:54.996737456 (45h22m31.036310576s) [upload=39871]: Starting upload Sep 8 10:50:54.996796369 (45h22m31.036369499s) [upload=39871]: Done starting upload Sep 8 10:50:54.996927921 (45h22m31.036501041s) [upload=39871]: Uploading segments... Sep 8 10:50:54.997046097 (45h22m31.036619217s) [upload=39871]: Got next segment. Inline: false Sep 8 10:50:54.997085543 (45h22m31.036658703s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 10:50:54.997093277 (45h22m31.036666427s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 10:50:55.262079152 (45h22m31.301652283s) [seg_pos={0 0}, upload=39871]: Begin upload segment... Sep 8 10:50:55.262128356 (45h22m31.301701476s) [seg_pos={0 0}, upload=39871]: Done begin upload segment. Sep 8 10:50:55.262146942 (45h22m31.301720062s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262156830 (45h22m31.30172995s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262502612 (45h22m31.302075732s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262872480 (45h22m31.302445601s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263230676 (45h22m31.302803796s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263492266 (45h22m31.303065386s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263718008 (45h22m31.303291129s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263781820 (45h22m31.30335494s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263953148 (45h22m31.303526268s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264180223 (45h22m31.303753343s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264391336 (45h22m31.303964456s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264787515 (45h22m31.304360655s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265102637 (45h22m31.304675757s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265414084 (45h22m31.304987204s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265622652 (45h22m31.305195772s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.266156605 (45h22m31.305729745s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:57.069064983 (45h22m33.108638103s) [upload=39871]: Next returned nil segment Sep 8 10:50:57.069083619 (45h22m33.108656729s) [upload=39871]: Waiting for error group managing segments... Sep 8 10:50:57.358709524 (45h22m33.398282644s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.418851458 (45h22m33.458424578s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.422887822 (45h22m33.462460942s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.426244124 (45h22m33.465817244s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.438594908 (45h22m33.478168028s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.477758539 (45h22m33.517331659s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.478283144 (45h22m33.517856264s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.494427878 (45h22m33.534000998s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.498758564 (45h22m33.538331684s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.519426042 (45h22m33.558999163s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.537375701 (45h22m33.576948811s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.544671341 (45h22m33.584244461s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553767086 (45h22m33.593340206s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553786884 (45h22m33.593360004s) [seg_pos={0 0}, upload=39871]: Segment reached optimal threshold of 13 pieces. Sep 8 10:50:57.553982909 (45h22m33.593556029s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554038305 (45h22m33.593611425s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554102648 (45h22m33.593675768s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE): protocol: write tcp 188.166.225.170:38400->104.36.82.2:4732: use of closed network connection; conn closed: op Sep 8 10:50:57.554156411 (45h22m33.593729531s) [seg_pos={0 0}, upload=39871]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 10:50:57.554221035 (45h22m33.593794155s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 10:50:57.554225534 (45h22m33.593798654s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 10:50:57.879588342 (45h22m33.919161462s) [upload=39871]: Done uploading segments... Sep 8 10:50:57.879607679 (45h22m33.9191808s) [upload=39871]: Upload finished. err: <nil> Duration: 6.128696612s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 6.128962286s FAIL (2025-09-08 11:19:12 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 10:50:54.996737456 (45h22m31.036310576s) [upload=39871]: Starting upload Sep 8 10:50:54.996796369 (45h22m31.036369499s) [upload=39871]: Done starting upload Sep 8 10:50:54.996927921 (45h22m31.036501041s) [upload=39871]: Uploading segments... Sep 8 10:50:54.997046097 (45h22m31.036619217s) [upload=39871]: Got next segment. Inline: false Sep 8 10:50:54.997085543 (45h22m31.036658703s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 10:50:54.997093277 (45h22m31.036666427s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 10:50:55.262079152 (45h22m31.301652283s) [seg_pos={0 0}, upload=39871]: Begin upload segment... Sep 8 10:50:55.262128356 (45h22m31.301701476s) [seg_pos={0 0}, upload=39871]: Done begin upload segment. Sep 8 10:50:55.262146942 (45h22m31.301720062s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262156830 (45h22m31.30172995s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262502612 (45h22m31.302075732s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262872480 (45h22m31.302445601s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263230676 (45h22m31.302803796s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263492266 (45h22m31.303065386s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263718008 (45h22m31.303291129s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263781820 (45h22m31.30335494s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263953148 (45h22m31.303526268s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264180223 (45h22m31.303753343s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264391336 (45h22m31.303964456s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264787515 (45h22m31.304360655s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265102637 (45h22m31.304675757s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265414084 (45h22m31.304987204s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265622652 (45h22m31.305195772s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.266156605 (45h22m31.305729745s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:57.069064983 (45h22m33.108638103s) [upload=39871]: Next returned nil segment Sep 8 10:50:57.069083619 (45h22m33.108656729s) [upload=39871]: Waiting for error group managing segments... Sep 8 10:50:57.358709524 (45h22m33.398282644s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.418851458 (45h22m33.458424578s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.422887822 (45h22m33.462460942s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.426244124 (45h22m33.465817244s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.438594908 (45h22m33.478168028s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.477758539 (45h22m33.517331659s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.478283144 (45h22m33.517856264s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.494427878 (45h22m33.534000998s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.498758564 (45h22m33.538331684s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.519426042 (45h22m33.558999163s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.537375701 (45h22m33.576948811s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.544671341 (45h22m33.584244461s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553767086 (45h22m33.593340206s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553786884 (45h22m33.593360004s) [seg_pos={0 0}, upload=39871]: Segment reached optimal threshold of 13 pieces. Sep 8 10:50:57.553982909 (45h22m33.593556029s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554038305 (45h22m33.593611425s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554102648 (45h22m33.593675768s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE): protocol: write tcp 188.166.225.170:38400->104.36.82.2:4732: use of closed network connection; conn closed: op Sep 8 10:50:57.554156411 (45h22m33.593729531s) [seg_pos={0 0}, upload=39871]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 10:50:57.554221035 (45h22m33.593794155s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 10:50:57.554225534 (45h22m33.593798654s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 10:50:57.879588342 (45h22m33.919161462s) [upload=39871]: Done uploading segments... Sep 8 10:50:57.879607679 (45h22m33.9191808s) [upload=39871]: Upload finished. err: <nil> Duration: 6.128987343s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 6.444149901s FAIL (2025-09-08 11:18:09 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 10:50:54.996737456 (45h22m31.036310576s) [upload=39871]: Starting upload Sep 8 10:50:54.996796369 (45h22m31.036369499s) [upload=39871]: Done starting upload Sep 8 10:50:54.996927921 (45h22m31.036501041s) [upload=39871]: Uploading segments... Sep 8 10:50:54.997046097 (45h22m31.036619217s) [upload=39871]: Got next segment. Inline: false Sep 8 10:50:54.997085543 (45h22m31.036658703s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 10:50:54.997093277 (45h22m31.036666427s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 10:50:55.262079152 (45h22m31.301652283s) [seg_pos={0 0}, upload=39871]: Begin upload segment... Sep 8 10:50:55.262128356 (45h22m31.301701476s) [seg_pos={0 0}, upload=39871]: Done begin upload segment. Sep 8 10:50:55.262146942 (45h22m31.301720062s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262156830 (45h22m31.30172995s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262502612 (45h22m31.302075732s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262872480 (45h22m31.302445601s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263230676 (45h22m31.302803796s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263492266 (45h22m31.303065386s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263718008 (45h22m31.303291129s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263781820 (45h22m31.30335494s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263953148 (45h22m31.303526268s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264180223 (45h22m31.303753343s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264391336 (45h22m31.303964456s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264787515 (45h22m31.304360655s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265102637 (45h22m31.304675757s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265414084 (45h22m31.304987204s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265622652 (45h22m31.305195772s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.266156605 (45h22m31.305729745s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:57.069064983 (45h22m33.108638103s) [upload=39871]: Next returned nil segment Sep 8 10:50:57.069083619 (45h22m33.108656729s) [upload=39871]: Waiting for error group managing segments... Sep 8 10:50:57.358709524 (45h22m33.398282644s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.418851458 (45h22m33.458424578s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.422887822 (45h22m33.462460942s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.426244124 (45h22m33.465817244s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.438594908 (45h22m33.478168028s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.477758539 (45h22m33.517331659s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.478283144 (45h22m33.517856264s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.494427878 (45h22m33.534000998s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.498758564 (45h22m33.538331684s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.519426042 (45h22m33.558999163s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.537375701 (45h22m33.576948811s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.544671341 (45h22m33.584244461s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553767086 (45h22m33.593340206s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553786884 (45h22m33.593360004s) [seg_pos={0 0}, upload=39871]: Segment reached optimal threshold of 13 pieces. Sep 8 10:50:57.553982909 (45h22m33.593556029s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554038305 (45h22m33.593611425s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554102648 (45h22m33.593675768s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE): protocol: write tcp 188.166.225.170:38400->104.36.82.2:4732: use of closed network connection; conn closed: op Sep 8 10:50:57.554156411 (45h22m33.593729531s) [seg_pos={0 0}, upload=39871]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 10:50:57.554221035 (45h22m33.593794155s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 10:50:57.554225534 (45h22m33.593798654s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 10:50:57.879588342 (45h22m33.919161462s) [upload=39871]: Done uploading segments... Sep 8 10:50:57.879607679 (45h22m33.9191808s) [upload=39871]: Upload finished. err: <nil> Duration: 6.444177615s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 6.788838264s FAIL (2025-09-08 11:17:04 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 10:50:54.996737456 (45h22m31.036310576s) [upload=39871]: Starting upload Sep 8 10:50:54.996796369 (45h22m31.036369499s) [upload=39871]: Done starting upload Sep 8 10:50:54.996927921 (45h22m31.036501041s) [upload=39871]: Uploading segments... Sep 8 10:50:54.997046097 (45h22m31.036619217s) [upload=39871]: Got next segment. Inline: false Sep 8 10:50:54.997085543 (45h22m31.036658703s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 10:50:54.997093277 (45h22m31.036666427s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 10:50:55.262079152 (45h22m31.301652283s) [seg_pos={0 0}, upload=39871]: Begin upload segment... Sep 8 10:50:55.262128356 (45h22m31.301701476s) [seg_pos={0 0}, upload=39871]: Done begin upload segment. Sep 8 10:50:55.262146942 (45h22m31.301720062s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262156830 (45h22m31.30172995s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262502612 (45h22m31.302075732s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262872480 (45h22m31.302445601s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263230676 (45h22m31.302803796s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263492266 (45h22m31.303065386s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263718008 (45h22m31.303291129s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263781820 (45h22m31.30335494s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263953148 (45h22m31.303526268s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264180223 (45h22m31.303753343s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264391336 (45h22m31.303964456s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264787515 (45h22m31.304360655s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265102637 (45h22m31.304675757s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265414084 (45h22m31.304987204s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265622652 (45h22m31.305195772s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.266156605 (45h22m31.305729745s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:57.069064983 (45h22m33.108638103s) [upload=39871]: Next returned nil segment Sep 8 10:50:57.069083619 (45h22m33.108656729s) [upload=39871]: Waiting for error group managing segments... Sep 8 10:50:57.358709524 (45h22m33.398282644s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.418851458 (45h22m33.458424578s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.422887822 (45h22m33.462460942s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.426244124 (45h22m33.465817244s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.438594908 (45h22m33.478168028s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.477758539 (45h22m33.517331659s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.478283144 (45h22m33.517856264s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.494427878 (45h22m33.534000998s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.498758564 (45h22m33.538331684s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.519426042 (45h22m33.558999163s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.537375701 (45h22m33.576948811s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.544671341 (45h22m33.584244461s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553767086 (45h22m33.593340206s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553786884 (45h22m33.593360004s) [seg_pos={0 0}, upload=39871]: Segment reached optimal threshold of 13 pieces. Sep 8 10:50:57.553982909 (45h22m33.593556029s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554038305 (45h22m33.593611425s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554102648 (45h22m33.593675768s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE): protocol: write tcp 188.166.225.170:38400->104.36.82.2:4732: use of closed network connection; conn closed: op Sep 8 10:50:57.554156411 (45h22m33.593729531s) [seg_pos={0 0}, upload=39871]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 10:50:57.554221035 (45h22m33.593794155s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 10:50:57.554225534 (45h22m33.593798654s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 10:50:57.879588342 (45h22m33.919161462s) [upload=39871]: Done uploading segments... Sep 8 10:50:57.879607679 (45h22m33.9191808s) [upload=39871]: Upload finished. err: <nil> Duration: 6.788868291s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 6.235005462s FAIL (2025-09-08 11:16:25 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 10:50:54.996737456 (45h22m31.036310576s) [upload=39871]: Starting upload Sep 8 10:50:54.996796369 (45h22m31.036369499s) [upload=39871]: Done starting upload Sep 8 10:50:54.996927921 (45h22m31.036501041s) [upload=39871]: Uploading segments... Sep 8 10:50:54.997046097 (45h22m31.036619217s) [upload=39871]: Got next segment. Inline: false Sep 8 10:50:54.997085543 (45h22m31.036658703s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 10:50:54.997093277 (45h22m31.036666427s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 10:50:55.262079152 (45h22m31.301652283s) [seg_pos={0 0}, upload=39871]: Begin upload segment... Sep 8 10:50:55.262128356 (45h22m31.301701476s) [seg_pos={0 0}, upload=39871]: Done begin upload segment. Sep 8 10:50:55.262146942 (45h22m31.301720062s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262156830 (45h22m31.30172995s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262502612 (45h22m31.302075732s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262872480 (45h22m31.302445601s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263230676 (45h22m31.302803796s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263492266 (45h22m31.303065386s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263718008 (45h22m31.303291129s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263781820 (45h22m31.30335494s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263953148 (45h22m31.303526268s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264180223 (45h22m31.303753343s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264391336 (45h22m31.303964456s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264787515 (45h22m31.304360655s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265102637 (45h22m31.304675757s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265414084 (45h22m31.304987204s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265622652 (45h22m31.305195772s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.266156605 (45h22m31.305729745s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:57.069064983 (45h22m33.108638103s) [upload=39871]: Next returned nil segment Sep 8 10:50:57.069083619 (45h22m33.108656729s) [upload=39871]: Waiting for error group managing segments... Sep 8 10:50:57.358709524 (45h22m33.398282644s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.418851458 (45h22m33.458424578s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.422887822 (45h22m33.462460942s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.426244124 (45h22m33.465817244s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.438594908 (45h22m33.478168028s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.477758539 (45h22m33.517331659s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.478283144 (45h22m33.517856264s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.494427878 (45h22m33.534000998s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.498758564 (45h22m33.538331684s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.519426042 (45h22m33.558999163s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.537375701 (45h22m33.576948811s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.544671341 (45h22m33.584244461s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553767086 (45h22m33.593340206s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553786884 (45h22m33.593360004s) [seg_pos={0 0}, upload=39871]: Segment reached optimal threshold of 13 pieces. Sep 8 10:50:57.553982909 (45h22m33.593556029s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554038305 (45h22m33.593611425s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554102648 (45h22m33.593675768s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE): protocol: write tcp 188.166.225.170:38400->104.36.82.2:4732: use of closed network connection; conn closed: op Sep 8 10:50:57.554156411 (45h22m33.593729531s) [seg_pos={0 0}, upload=39871]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 10:50:57.554221035 (45h22m33.593794155s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 10:50:57.554225534 (45h22m33.593798654s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 10:50:57.879588342 (45h22m33.919161462s) [upload=39871]: Done uploading segments... Sep 8 10:50:57.879607679 (45h22m33.9191808s) [upload=39871]: Upload finished. err: <nil> Duration: 6.235042561s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 6.086857279s FAIL (2025-09-08 11:15:42 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 10:50:54.996737456 (45h22m31.036310576s) [upload=39871]: Starting upload Sep 8 10:50:54.996796369 (45h22m31.036369499s) [upload=39871]: Done starting upload Sep 8 10:50:54.996927921 (45h22m31.036501041s) [upload=39871]: Uploading segments... Sep 8 10:50:54.997046097 (45h22m31.036619217s) [upload=39871]: Got next segment. Inline: false Sep 8 10:50:54.997085543 (45h22m31.036658703s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 10:50:54.997093277 (45h22m31.036666427s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 10:50:55.262079152 (45h22m31.301652283s) [seg_pos={0 0}, upload=39871]: Begin upload segment... Sep 8 10:50:55.262128356 (45h22m31.301701476s) [seg_pos={0 0}, upload=39871]: Done begin upload segment. Sep 8 10:50:55.262146942 (45h22m31.301720062s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262156830 (45h22m31.30172995s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262502612 (45h22m31.302075732s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262872480 (45h22m31.302445601s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263230676 (45h22m31.302803796s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263492266 (45h22m31.303065386s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263718008 (45h22m31.303291129s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263781820 (45h22m31.30335494s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263953148 (45h22m31.303526268s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264180223 (45h22m31.303753343s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264391336 (45h22m31.303964456s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264787515 (45h22m31.304360655s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265102637 (45h22m31.304675757s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265414084 (45h22m31.304987204s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265622652 (45h22m31.305195772s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.266156605 (45h22m31.305729745s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:57.069064983 (45h22m33.108638103s) [upload=39871]: Next returned nil segment Sep 8 10:50:57.069083619 (45h22m33.108656729s) [upload=39871]: Waiting for error group managing segments... Sep 8 10:50:57.358709524 (45h22m33.398282644s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.418851458 (45h22m33.458424578s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.422887822 (45h22m33.462460942s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.426244124 (45h22m33.465817244s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.438594908 (45h22m33.478168028s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.477758539 (45h22m33.517331659s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.478283144 (45h22m33.517856264s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.494427878 (45h22m33.534000998s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.498758564 (45h22m33.538331684s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.519426042 (45h22m33.558999163s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.537375701 (45h22m33.576948811s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.544671341 (45h22m33.584244461s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553767086 (45h22m33.593340206s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553786884 (45h22m33.593360004s) [seg_pos={0 0}, upload=39871]: Segment reached optimal threshold of 13 pieces. Sep 8 10:50:57.553982909 (45h22m33.593556029s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554038305 (45h22m33.593611425s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554102648 (45h22m33.593675768s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE): protocol: write tcp 188.166.225.170:38400->104.36.82.2:4732: use of closed network connection; conn closed: op Sep 8 10:50:57.554156411 (45h22m33.593729531s) [seg_pos={0 0}, upload=39871]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 10:50:57.554221035 (45h22m33.593794155s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 10:50:57.554225534 (45h22m33.593798654s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 10:50:57.879588342 (45h22m33.919161462s) [upload=39871]: Done uploading segments... Sep 8 10:50:57.879607679 (45h22m33.9191808s) [upload=39871]: Upload finished. err: <nil> Duration: 6.08687894s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 6.189370046s FAIL (2025-09-08 11:14:28 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 10:50:54.996737456 (45h22m31.036310576s) [upload=39871]: Starting upload Sep 8 10:50:54.996796369 (45h22m31.036369499s) [upload=39871]: Done starting upload Sep 8 10:50:54.996927921 (45h22m31.036501041s) [upload=39871]: Uploading segments... Sep 8 10:50:54.997046097 (45h22m31.036619217s) [upload=39871]: Got next segment. Inline: false Sep 8 10:50:54.997085543 (45h22m31.036658703s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 10:50:54.997093277 (45h22m31.036666427s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 10:50:55.262079152 (45h22m31.301652283s) [seg_pos={0 0}, upload=39871]: Begin upload segment... Sep 8 10:50:55.262128356 (45h22m31.301701476s) [seg_pos={0 0}, upload=39871]: Done begin upload segment. Sep 8 10:50:55.262146942 (45h22m31.301720062s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262156830 (45h22m31.30172995s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262502612 (45h22m31.302075732s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262872480 (45h22m31.302445601s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263230676 (45h22m31.302803796s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263492266 (45h22m31.303065386s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263718008 (45h22m31.303291129s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263781820 (45h22m31.30335494s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263953148 (45h22m31.303526268s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264180223 (45h22m31.303753343s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264391336 (45h22m31.303964456s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264787515 (45h22m31.304360655s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265102637 (45h22m31.304675757s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265414084 (45h22m31.304987204s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265622652 (45h22m31.305195772s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.266156605 (45h22m31.305729745s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:57.069064983 (45h22m33.108638103s) [upload=39871]: Next returned nil segment Sep 8 10:50:57.069083619 (45h22m33.108656729s) [upload=39871]: Waiting for error group managing segments... Sep 8 10:50:57.358709524 (45h22m33.398282644s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.418851458 (45h22m33.458424578s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.422887822 (45h22m33.462460942s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.426244124 (45h22m33.465817244s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.438594908 (45h22m33.478168028s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.477758539 (45h22m33.517331659s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.478283144 (45h22m33.517856264s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.494427878 (45h22m33.534000998s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.498758564 (45h22m33.538331684s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.519426042 (45h22m33.558999163s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.537375701 (45h22m33.576948811s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.544671341 (45h22m33.584244461s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553767086 (45h22m33.593340206s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553786884 (45h22m33.593360004s) [seg_pos={0 0}, upload=39871]: Segment reached optimal threshold of 13 pieces. Sep 8 10:50:57.553982909 (45h22m33.593556029s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554038305 (45h22m33.593611425s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554102648 (45h22m33.593675768s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE): protocol: write tcp 188.166.225.170:38400->104.36.82.2:4732: use of closed network connection; conn closed: op Sep 8 10:50:57.554156411 (45h22m33.593729531s) [seg_pos={0 0}, upload=39871]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 10:50:57.554221035 (45h22m33.593794155s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 10:50:57.554225534 (45h22m33.593798654s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 10:50:57.879588342 (45h22m33.919161462s) [upload=39871]: Done uploading segments... Sep 8 10:50:57.879607679 (45h22m33.9191808s) [upload=39871]: Upload finished. err: <nil> Duration: 6.189400393s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 6.177130804s FAIL (2025-09-08 11:13:32 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 10:50:54.996737456 (45h22m31.036310576s) [upload=39871]: Starting upload Sep 8 10:50:54.996796369 (45h22m31.036369499s) [upload=39871]: Done starting upload Sep 8 10:50:54.996927921 (45h22m31.036501041s) [upload=39871]: Uploading segments... Sep 8 10:50:54.997046097 (45h22m31.036619217s) [upload=39871]: Got next segment. Inline: false Sep 8 10:50:54.997085543 (45h22m31.036658703s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 10:50:54.997093277 (45h22m31.036666427s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 10:50:55.262079152 (45h22m31.301652283s) [seg_pos={0 0}, upload=39871]: Begin upload segment... Sep 8 10:50:55.262128356 (45h22m31.301701476s) [seg_pos={0 0}, upload=39871]: Done begin upload segment. Sep 8 10:50:55.262146942 (45h22m31.301720062s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262156830 (45h22m31.30172995s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262502612 (45h22m31.302075732s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262872480 (45h22m31.302445601s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263230676 (45h22m31.302803796s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263492266 (45h22m31.303065386s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263718008 (45h22m31.303291129s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263781820 (45h22m31.30335494s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263953148 (45h22m31.303526268s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264180223 (45h22m31.303753343s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264391336 (45h22m31.303964456s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264787515 (45h22m31.304360655s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265102637 (45h22m31.304675757s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265414084 (45h22m31.304987204s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265622652 (45h22m31.305195772s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.266156605 (45h22m31.305729745s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:57.069064983 (45h22m33.108638103s) [upload=39871]: Next returned nil segment Sep 8 10:50:57.069083619 (45h22m33.108656729s) [upload=39871]: Waiting for error group managing segments... Sep 8 10:50:57.358709524 (45h22m33.398282644s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.418851458 (45h22m33.458424578s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.422887822 (45h22m33.462460942s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.426244124 (45h22m33.465817244s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.438594908 (45h22m33.478168028s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.477758539 (45h22m33.517331659s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.478283144 (45h22m33.517856264s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.494427878 (45h22m33.534000998s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.498758564 (45h22m33.538331684s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.519426042 (45h22m33.558999163s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.537375701 (45h22m33.576948811s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.544671341 (45h22m33.584244461s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553767086 (45h22m33.593340206s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553786884 (45h22m33.593360004s) [seg_pos={0 0}, upload=39871]: Segment reached optimal threshold of 13 pieces. Sep 8 10:50:57.553982909 (45h22m33.593556029s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554038305 (45h22m33.593611425s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554102648 (45h22m33.593675768s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE): protocol: write tcp 188.166.225.170:38400->104.36.82.2:4732: use of closed network connection; conn closed: op Sep 8 10:50:57.554156411 (45h22m33.593729531s) [seg_pos={0 0}, upload=39871]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 10:50:57.554221035 (45h22m33.593794155s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 10:50:57.554225534 (45h22m33.593798654s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 10:50:57.879588342 (45h22m33.919161462s) [upload=39871]: Done uploading segments... Sep 8 10:50:57.879607679 (45h22m33.9191808s) [upload=39871]: Upload finished. err: <nil> Duration: 6.177154991s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 6.318845355s FAIL (2025-09-08 11:12:26 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 10:50:54.996737456 (45h22m31.036310576s) [upload=39871]: Starting upload Sep 8 10:50:54.996796369 (45h22m31.036369499s) [upload=39871]: Done starting upload Sep 8 10:50:54.996927921 (45h22m31.036501041s) [upload=39871]: Uploading segments... Sep 8 10:50:54.997046097 (45h22m31.036619217s) [upload=39871]: Got next segment. Inline: false Sep 8 10:50:54.997085543 (45h22m31.036658703s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 10:50:54.997093277 (45h22m31.036666427s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 10:50:55.262079152 (45h22m31.301652283s) [seg_pos={0 0}, upload=39871]: Begin upload segment... Sep 8 10:50:55.262128356 (45h22m31.301701476s) [seg_pos={0 0}, upload=39871]: Done begin upload segment. Sep 8 10:50:55.262146942 (45h22m31.301720062s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262156830 (45h22m31.30172995s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262502612 (45h22m31.302075732s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262872480 (45h22m31.302445601s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263230676 (45h22m31.302803796s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263492266 (45h22m31.303065386s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263718008 (45h22m31.303291129s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263781820 (45h22m31.30335494s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263953148 (45h22m31.303526268s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264180223 (45h22m31.303753343s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264391336 (45h22m31.303964456s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264787515 (45h22m31.304360655s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265102637 (45h22m31.304675757s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265414084 (45h22m31.304987204s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265622652 (45h22m31.305195772s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.266156605 (45h22m31.305729745s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:57.069064983 (45h22m33.108638103s) [upload=39871]: Next returned nil segment Sep 8 10:50:57.069083619 (45h22m33.108656729s) [upload=39871]: Waiting for error group managing segments... Sep 8 10:50:57.358709524 (45h22m33.398282644s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.418851458 (45h22m33.458424578s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.422887822 (45h22m33.462460942s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.426244124 (45h22m33.465817244s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.438594908 (45h22m33.478168028s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.477758539 (45h22m33.517331659s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.478283144 (45h22m33.517856264s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.494427878 (45h22m33.534000998s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.498758564 (45h22m33.538331684s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.519426042 (45h22m33.558999163s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.537375701 (45h22m33.576948811s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.544671341 (45h22m33.584244461s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553767086 (45h22m33.593340206s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553786884 (45h22m33.593360004s) [seg_pos={0 0}, upload=39871]: Segment reached optimal threshold of 13 pieces. Sep 8 10:50:57.553982909 (45h22m33.593556029s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554038305 (45h22m33.593611425s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554102648 (45h22m33.593675768s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE): protocol: write tcp 188.166.225.170:38400->104.36.82.2:4732: use of closed network connection; conn closed: op Sep 8 10:50:57.554156411 (45h22m33.593729531s) [seg_pos={0 0}, upload=39871]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 10:50:57.554221035 (45h22m33.593794155s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 10:50:57.554225534 (45h22m33.593798654s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 10:50:57.879588342 (45h22m33.919161462s) [upload=39871]: Done uploading segments... Sep 8 10:50:57.879607679 (45h22m33.9191808s) [upload=39871]: Upload finished. err: <nil> Duration: 6.318864512s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 6.316815407s FAIL (2025-09-08 11:11:37 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 10:50:54.996737456 (45h22m31.036310576s) [upload=39871]: Starting upload Sep 8 10:50:54.996796369 (45h22m31.036369499s) [upload=39871]: Done starting upload Sep 8 10:50:54.996927921 (45h22m31.036501041s) [upload=39871]: Uploading segments... Sep 8 10:50:54.997046097 (45h22m31.036619217s) [upload=39871]: Got next segment. Inline: false Sep 8 10:50:54.997085543 (45h22m31.036658703s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 10:50:54.997093277 (45h22m31.036666427s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 10:50:55.262079152 (45h22m31.301652283s) [seg_pos={0 0}, upload=39871]: Begin upload segment... Sep 8 10:50:55.262128356 (45h22m31.301701476s) [seg_pos={0 0}, upload=39871]: Done begin upload segment. Sep 8 10:50:55.262146942 (45h22m31.301720062s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262156830 (45h22m31.30172995s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262502612 (45h22m31.302075732s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262872480 (45h22m31.302445601s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263230676 (45h22m31.302803796s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263492266 (45h22m31.303065386s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263718008 (45h22m31.303291129s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263781820 (45h22m31.30335494s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263953148 (45h22m31.303526268s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264180223 (45h22m31.303753343s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264391336 (45h22m31.303964456s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264787515 (45h22m31.304360655s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265102637 (45h22m31.304675757s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265414084 (45h22m31.304987204s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265622652 (45h22m31.305195772s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.266156605 (45h22m31.305729745s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:57.069064983 (45h22m33.108638103s) [upload=39871]: Next returned nil segment Sep 8 10:50:57.069083619 (45h22m33.108656729s) [upload=39871]: Waiting for error group managing segments... Sep 8 10:50:57.358709524 (45h22m33.398282644s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.418851458 (45h22m33.458424578s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.422887822 (45h22m33.462460942s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.426244124 (45h22m33.465817244s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.438594908 (45h22m33.478168028s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.477758539 (45h22m33.517331659s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.478283144 (45h22m33.517856264s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.494427878 (45h22m33.534000998s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.498758564 (45h22m33.538331684s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.519426042 (45h22m33.558999163s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.537375701 (45h22m33.576948811s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.544671341 (45h22m33.584244461s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553767086 (45h22m33.593340206s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553786884 (45h22m33.593360004s) [seg_pos={0 0}, upload=39871]: Segment reached optimal threshold of 13 pieces. Sep 8 10:50:57.553982909 (45h22m33.593556029s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554038305 (45h22m33.593611425s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554102648 (45h22m33.593675768s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE): protocol: write tcp 188.166.225.170:38400->104.36.82.2:4732: use of closed network connection; conn closed: op Sep 8 10:50:57.554156411 (45h22m33.593729531s) [seg_pos={0 0}, upload=39871]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 10:50:57.554221035 (45h22m33.593794155s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 10:50:57.554225534 (45h22m33.593798654s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 10:50:57.879588342 (45h22m33.919161462s) [upload=39871]: Done uploading segments... Sep 8 10:50:57.879607679 (45h22m33.9191808s) [upload=39871]: Upload finished. err: <nil> Duration: 6.316850985s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 6.206363302s FAIL (2025-09-08 11:11:21 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 10:50:54.996737456 (45h22m31.036310576s) [upload=39871]: Starting upload Sep 8 10:50:54.996796369 (45h22m31.036369499s) [upload=39871]: Done starting upload Sep 8 10:50:54.996927921 (45h22m31.036501041s) [upload=39871]: Uploading segments... Sep 8 10:50:54.997046097 (45h22m31.036619217s) [upload=39871]: Got next segment. Inline: false Sep 8 10:50:54.997085543 (45h22m31.036658703s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 10:50:54.997093277 (45h22m31.036666427s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 10:50:55.262079152 (45h22m31.301652283s) [seg_pos={0 0}, upload=39871]: Begin upload segment... Sep 8 10:50:55.262128356 (45h22m31.301701476s) [seg_pos={0 0}, upload=39871]: Done begin upload segment. Sep 8 10:50:55.262146942 (45h22m31.301720062s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262156830 (45h22m31.30172995s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262502612 (45h22m31.302075732s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262872480 (45h22m31.302445601s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263230676 (45h22m31.302803796s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263492266 (45h22m31.303065386s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263718008 (45h22m31.303291129s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263781820 (45h22m31.30335494s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263953148 (45h22m31.303526268s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264180223 (45h22m31.303753343s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264391336 (45h22m31.303964456s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264787515 (45h22m31.304360655s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265102637 (45h22m31.304675757s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265414084 (45h22m31.304987204s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265622652 (45h22m31.305195772s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.266156605 (45h22m31.305729745s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:57.069064983 (45h22m33.108638103s) [upload=39871]: Next returned nil segment Sep 8 10:50:57.069083619 (45h22m33.108656729s) [upload=39871]: Waiting for error group managing segments... Sep 8 10:50:57.358709524 (45h22m33.398282644s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.418851458 (45h22m33.458424578s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.422887822 (45h22m33.462460942s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.426244124 (45h22m33.465817244s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.438594908 (45h22m33.478168028s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.477758539 (45h22m33.517331659s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.478283144 (45h22m33.517856264s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.494427878 (45h22m33.534000998s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.498758564 (45h22m33.538331684s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.519426042 (45h22m33.558999163s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.537375701 (45h22m33.576948811s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.544671341 (45h22m33.584244461s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553767086 (45h22m33.593340206s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553786884 (45h22m33.593360004s) [seg_pos={0 0}, upload=39871]: Segment reached optimal threshold of 13 pieces. Sep 8 10:50:57.553982909 (45h22m33.593556029s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554038305 (45h22m33.593611425s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554102648 (45h22m33.593675768s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE): protocol: write tcp 188.166.225.170:38400->104.36.82.2:4732: use of closed network connection; conn closed: op Sep 8 10:50:57.554156411 (45h22m33.593729531s) [seg_pos={0 0}, upload=39871]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 10:50:57.554221035 (45h22m33.593794155s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 10:50:57.554225534 (45h22m33.593798654s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 10:50:57.879588342 (45h22m33.919161462s) [upload=39871]: Done uploading segments... Sep 8 10:50:57.879607679 (45h22m33.9191808s) [upload=39871]: Upload finished. err: <nil> Duration: 6.206394521s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 5.944816743s FAIL (2025-09-08 11:10:34 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 10:50:54.996737456 (45h22m31.036310576s) [upload=39871]: Starting upload Sep 8 10:50:54.996796369 (45h22m31.036369499s) [upload=39871]: Done starting upload Sep 8 10:50:54.996927921 (45h22m31.036501041s) [upload=39871]: Uploading segments... Sep 8 10:50:54.997046097 (45h22m31.036619217s) [upload=39871]: Got next segment. Inline: false Sep 8 10:50:54.997085543 (45h22m31.036658703s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 10:50:54.997093277 (45h22m31.036666427s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 10:50:55.262079152 (45h22m31.301652283s) [seg_pos={0 0}, upload=39871]: Begin upload segment... Sep 8 10:50:55.262128356 (45h22m31.301701476s) [seg_pos={0 0}, upload=39871]: Done begin upload segment. Sep 8 10:50:55.262146942 (45h22m31.301720062s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262156830 (45h22m31.30172995s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262502612 (45h22m31.302075732s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262872480 (45h22m31.302445601s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263230676 (45h22m31.302803796s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263492266 (45h22m31.303065386s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263718008 (45h22m31.303291129s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263781820 (45h22m31.30335494s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263953148 (45h22m31.303526268s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264180223 (45h22m31.303753343s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264391336 (45h22m31.303964456s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264787515 (45h22m31.304360655s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265102637 (45h22m31.304675757s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265414084 (45h22m31.304987204s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265622652 (45h22m31.305195772s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.266156605 (45h22m31.305729745s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:57.069064983 (45h22m33.108638103s) [upload=39871]: Next returned nil segment Sep 8 10:50:57.069083619 (45h22m33.108656729s) [upload=39871]: Waiting for error group managing segments... Sep 8 10:50:57.358709524 (45h22m33.398282644s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.418851458 (45h22m33.458424578s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.422887822 (45h22m33.462460942s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.426244124 (45h22m33.465817244s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.438594908 (45h22m33.478168028s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.477758539 (45h22m33.517331659s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.478283144 (45h22m33.517856264s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.494427878 (45h22m33.534000998s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.498758564 (45h22m33.538331684s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.519426042 (45h22m33.558999163s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.537375701 (45h22m33.576948811s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.544671341 (45h22m33.584244461s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553767086 (45h22m33.593340206s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553786884 (45h22m33.593360004s) [seg_pos={0 0}, upload=39871]: Segment reached optimal threshold of 13 pieces. Sep 8 10:50:57.553982909 (45h22m33.593556029s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554038305 (45h22m33.593611425s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554102648 (45h22m33.593675768s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE): protocol: write tcp 188.166.225.170:38400->104.36.82.2:4732: use of closed network connection; conn closed: op Sep 8 10:50:57.554156411 (45h22m33.593729531s) [seg_pos={0 0}, upload=39871]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 10:50:57.554221035 (45h22m33.593794155s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 10:50:57.554225534 (45h22m33.593798654s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 10:50:57.879588342 (45h22m33.919161462s) [upload=39871]: Done uploading segments... Sep 8 10:50:57.879607679 (45h22m33.9191808s) [upload=39871]: Upload finished. err: <nil> Duration: 5.944842301s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 6.655717572s FAIL (2025-09-08 11:09:56 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 10:50:54.996737456 (45h22m31.036310576s) [upload=39871]: Starting upload Sep 8 10:50:54.996796369 (45h22m31.036369499s) [upload=39871]: Done starting upload Sep 8 10:50:54.996927921 (45h22m31.036501041s) [upload=39871]: Uploading segments... Sep 8 10:50:54.997046097 (45h22m31.036619217s) [upload=39871]: Got next segment. Inline: false Sep 8 10:50:54.997085543 (45h22m31.036658703s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 10:50:54.997093277 (45h22m31.036666427s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 10:50:55.262079152 (45h22m31.301652283s) [seg_pos={0 0}, upload=39871]: Begin upload segment... Sep 8 10:50:55.262128356 (45h22m31.301701476s) [seg_pos={0 0}, upload=39871]: Done begin upload segment. Sep 8 10:50:55.262146942 (45h22m31.301720062s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262156830 (45h22m31.30172995s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262502612 (45h22m31.302075732s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262872480 (45h22m31.302445601s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263230676 (45h22m31.302803796s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263492266 (45h22m31.303065386s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263718008 (45h22m31.303291129s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263781820 (45h22m31.30335494s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263953148 (45h22m31.303526268s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264180223 (45h22m31.303753343s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264391336 (45h22m31.303964456s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264787515 (45h22m31.304360655s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265102637 (45h22m31.304675757s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265414084 (45h22m31.304987204s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265622652 (45h22m31.305195772s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.266156605 (45h22m31.305729745s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:57.069064983 (45h22m33.108638103s) [upload=39871]: Next returned nil segment Sep 8 10:50:57.069083619 (45h22m33.108656729s) [upload=39871]: Waiting for error group managing segments... Sep 8 10:50:57.358709524 (45h22m33.398282644s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.418851458 (45h22m33.458424578s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.422887822 (45h22m33.462460942s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.426244124 (45h22m33.465817244s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.438594908 (45h22m33.478168028s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.477758539 (45h22m33.517331659s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.478283144 (45h22m33.517856264s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.494427878 (45h22m33.534000998s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.498758564 (45h22m33.538331684s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.519426042 (45h22m33.558999163s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.537375701 (45h22m33.576948811s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.544671341 (45h22m33.584244461s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553767086 (45h22m33.593340206s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553786884 (45h22m33.593360004s) [seg_pos={0 0}, upload=39871]: Segment reached optimal threshold of 13 pieces. Sep 8 10:50:57.553982909 (45h22m33.593556029s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554038305 (45h22m33.593611425s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554102648 (45h22m33.593675768s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE): protocol: write tcp 188.166.225.170:38400->104.36.82.2:4732: use of closed network connection; conn closed: op Sep 8 10:50:57.554156411 (45h22m33.593729531s) [seg_pos={0 0}, upload=39871]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 10:50:57.554221035 (45h22m33.593794155s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 10:50:57.554225534 (45h22m33.593798654s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 10:50:57.879588342 (45h22m33.919161462s) [upload=39871]: Done uploading segments... Sep 8 10:50:57.879607679 (45h22m33.9191808s) [upload=39871]: Upload finished. err: <nil> Duration: 6.655748149s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 5.940133249s FAIL (2025-09-08 11:09:04 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 10:50:54.996737456 (45h22m31.036310576s) [upload=39871]: Starting upload Sep 8 10:50:54.996796369 (45h22m31.036369499s) [upload=39871]: Done starting upload Sep 8 10:50:54.996927921 (45h22m31.036501041s) [upload=39871]: Uploading segments... Sep 8 10:50:54.997046097 (45h22m31.036619217s) [upload=39871]: Got next segment. Inline: false Sep 8 10:50:54.997085543 (45h22m31.036658703s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 10:50:54.997093277 (45h22m31.036666427s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 10:50:55.262079152 (45h22m31.301652283s) [seg_pos={0 0}, upload=39871]: Begin upload segment... Sep 8 10:50:55.262128356 (45h22m31.301701476s) [seg_pos={0 0}, upload=39871]: Done begin upload segment. Sep 8 10:50:55.262146942 (45h22m31.301720062s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262156830 (45h22m31.30172995s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262502612 (45h22m31.302075732s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262872480 (45h22m31.302445601s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263230676 (45h22m31.302803796s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263492266 (45h22m31.303065386s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263718008 (45h22m31.303291129s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263781820 (45h22m31.30335494s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263953148 (45h22m31.303526268s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264180223 (45h22m31.303753343s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264391336 (45h22m31.303964456s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264787515 (45h22m31.304360655s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265102637 (45h22m31.304675757s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265414084 (45h22m31.304987204s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265622652 (45h22m31.305195772s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.266156605 (45h22m31.305729745s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:57.069064983 (45h22m33.108638103s) [upload=39871]: Next returned nil segment Sep 8 10:50:57.069083619 (45h22m33.108656729s) [upload=39871]: Waiting for error group managing segments... Sep 8 10:50:57.358709524 (45h22m33.398282644s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.418851458 (45h22m33.458424578s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.422887822 (45h22m33.462460942s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.426244124 (45h22m33.465817244s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.438594908 (45h22m33.478168028s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.477758539 (45h22m33.517331659s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.478283144 (45h22m33.517856264s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.494427878 (45h22m33.534000998s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.498758564 (45h22m33.538331684s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.519426042 (45h22m33.558999163s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.537375701 (45h22m33.576948811s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.544671341 (45h22m33.584244461s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553767086 (45h22m33.593340206s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553786884 (45h22m33.593360004s) [seg_pos={0 0}, upload=39871]: Segment reached optimal threshold of 13 pieces. Sep 8 10:50:57.553982909 (45h22m33.593556029s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554038305 (45h22m33.593611425s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554102648 (45h22m33.593675768s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE): protocol: write tcp 188.166.225.170:38400->104.36.82.2:4732: use of closed network connection; conn closed: op Sep 8 10:50:57.554156411 (45h22m33.593729531s) [seg_pos={0 0}, upload=39871]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 10:50:57.554221035 (45h22m33.593794155s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 10:50:57.554225534 (45h22m33.593798654s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 10:50:57.879588342 (45h22m33.919161462s) [upload=39871]: Done uploading segments... Sep 8 10:50:57.879607679 (45h22m33.9191808s) [upload=39871]: Upload finished. err: <nil> Duration: 5.940164007s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 6.326834548s FAIL (2025-09-08 11:07:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 10:50:54.996737456 (45h22m31.036310576s) [upload=39871]: Starting upload Sep 8 10:50:54.996796369 (45h22m31.036369499s) [upload=39871]: Done starting upload Sep 8 10:50:54.996927921 (45h22m31.036501041s) [upload=39871]: Uploading segments... Sep 8 10:50:54.997046097 (45h22m31.036619217s) [upload=39871]: Got next segment. Inline: false Sep 8 10:50:54.997085543 (45h22m31.036658703s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 10:50:54.997093277 (45h22m31.036666427s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 10:50:55.262079152 (45h22m31.301652283s) [seg_pos={0 0}, upload=39871]: Begin upload segment... Sep 8 10:50:55.262128356 (45h22m31.301701476s) [seg_pos={0 0}, upload=39871]: Done begin upload segment. Sep 8 10:50:55.262146942 (45h22m31.301720062s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262156830 (45h22m31.30172995s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262502612 (45h22m31.302075732s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262872480 (45h22m31.302445601s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263230676 (45h22m31.302803796s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263492266 (45h22m31.303065386s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263718008 (45h22m31.303291129s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263781820 (45h22m31.30335494s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263953148 (45h22m31.303526268s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264180223 (45h22m31.303753343s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264391336 (45h22m31.303964456s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264787515 (45h22m31.304360655s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265102637 (45h22m31.304675757s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265414084 (45h22m31.304987204s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265622652 (45h22m31.305195772s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.266156605 (45h22m31.305729745s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:57.069064983 (45h22m33.108638103s) [upload=39871]: Next returned nil segment Sep 8 10:50:57.069083619 (45h22m33.108656729s) [upload=39871]: Waiting for error group managing segments... Sep 8 10:50:57.358709524 (45h22m33.398282644s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.418851458 (45h22m33.458424578s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.422887822 (45h22m33.462460942s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.426244124 (45h22m33.465817244s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.438594908 (45h22m33.478168028s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.477758539 (45h22m33.517331659s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.478283144 (45h22m33.517856264s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.494427878 (45h22m33.534000998s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.498758564 (45h22m33.538331684s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.519426042 (45h22m33.558999163s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.537375701 (45h22m33.576948811s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.544671341 (45h22m33.584244461s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553767086 (45h22m33.593340206s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553786884 (45h22m33.593360004s) [seg_pos={0 0}, upload=39871]: Segment reached optimal threshold of 13 pieces. Sep 8 10:50:57.553982909 (45h22m33.593556029s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554038305 (45h22m33.593611425s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554102648 (45h22m33.593675768s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE): protocol: write tcp 188.166.225.170:38400->104.36.82.2:4732: use of closed network connection; conn closed: op Sep 8 10:50:57.554156411 (45h22m33.593729531s) [seg_pos={0 0}, upload=39871]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 10:50:57.554221035 (45h22m33.593794155s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 10:50:57.554225534 (45h22m33.593798654s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 10:50:57.879588342 (45h22m33.919161462s) [upload=39871]: Done uploading segments... Sep 8 10:50:57.879607679 (45h22m33.9191808s) [upload=39871]: Upload finished. err: <nil> Duration: 6.326862902s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 8.024753904s FAIL (2025-09-08 11:07:01 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 10:50:54.996737456 (45h22m31.036310576s) [upload=39871]: Starting upload Sep 8 10:50:54.996796369 (45h22m31.036369499s) [upload=39871]: Done starting upload Sep 8 10:50:54.996927921 (45h22m31.036501041s) [upload=39871]: Uploading segments... Sep 8 10:50:54.997046097 (45h22m31.036619217s) [upload=39871]: Got next segment. Inline: false Sep 8 10:50:54.997085543 (45h22m31.036658703s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 10:50:54.997093277 (45h22m31.036666427s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 10:50:55.262079152 (45h22m31.301652283s) [seg_pos={0 0}, upload=39871]: Begin upload segment... Sep 8 10:50:55.262128356 (45h22m31.301701476s) [seg_pos={0 0}, upload=39871]: Done begin upload segment. Sep 8 10:50:55.262146942 (45h22m31.301720062s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262156830 (45h22m31.30172995s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262502612 (45h22m31.302075732s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262872480 (45h22m31.302445601s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263230676 (45h22m31.302803796s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263492266 (45h22m31.303065386s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263718008 (45h22m31.303291129s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263781820 (45h22m31.30335494s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263953148 (45h22m31.303526268s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264180223 (45h22m31.303753343s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264391336 (45h22m31.303964456s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264787515 (45h22m31.304360655s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265102637 (45h22m31.304675757s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265414084 (45h22m31.304987204s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265622652 (45h22m31.305195772s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.266156605 (45h22m31.305729745s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:57.069064983 (45h22m33.108638103s) [upload=39871]: Next returned nil segment Sep 8 10:50:57.069083619 (45h22m33.108656729s) [upload=39871]: Waiting for error group managing segments... Sep 8 10:50:57.358709524 (45h22m33.398282644s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.418851458 (45h22m33.458424578s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.422887822 (45h22m33.462460942s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.426244124 (45h22m33.465817244s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.438594908 (45h22m33.478168028s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.477758539 (45h22m33.517331659s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.478283144 (45h22m33.517856264s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.494427878 (45h22m33.534000998s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.498758564 (45h22m33.538331684s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.519426042 (45h22m33.558999163s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.537375701 (45h22m33.576948811s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.544671341 (45h22m33.584244461s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553767086 (45h22m33.593340206s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553786884 (45h22m33.593360004s) [seg_pos={0 0}, upload=39871]: Segment reached optimal threshold of 13 pieces. Sep 8 10:50:57.553982909 (45h22m33.593556029s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554038305 (45h22m33.593611425s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554102648 (45h22m33.593675768s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE): protocol: write tcp 188.166.225.170:38400->104.36.82.2:4732: use of closed network connection; conn closed: op Sep 8 10:50:57.554156411 (45h22m33.593729531s) [seg_pos={0 0}, upload=39871]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 10:50:57.554221035 (45h22m33.593794155s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 10:50:57.554225534 (45h22m33.593798654s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 10:50:57.879588342 (45h22m33.919161462s) [upload=39871]: Done uploading segments... Sep 8 10:50:57.879607679 (45h22m33.9191808s) [upload=39871]: Upload finished. err: <nil> Duration: 8.024784162s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 8.789380019s FAIL (2025-09-08 11:06:42 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 10:50:54.996737456 (45h22m31.036310576s) [upload=39871]: Starting upload Sep 8 10:50:54.996796369 (45h22m31.036369499s) [upload=39871]: Done starting upload Sep 8 10:50:54.996927921 (45h22m31.036501041s) [upload=39871]: Uploading segments... Sep 8 10:50:54.997046097 (45h22m31.036619217s) [upload=39871]: Got next segment. Inline: false Sep 8 10:50:54.997085543 (45h22m31.036658703s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 10:50:54.997093277 (45h22m31.036666427s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 10:50:55.262079152 (45h22m31.301652283s) [seg_pos={0 0}, upload=39871]: Begin upload segment... Sep 8 10:50:55.262128356 (45h22m31.301701476s) [seg_pos={0 0}, upload=39871]: Done begin upload segment. Sep 8 10:50:55.262146942 (45h22m31.301720062s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262156830 (45h22m31.30172995s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262502612 (45h22m31.302075732s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262872480 (45h22m31.302445601s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263230676 (45h22m31.302803796s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263492266 (45h22m31.303065386s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263718008 (45h22m31.303291129s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263781820 (45h22m31.30335494s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263953148 (45h22m31.303526268s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264180223 (45h22m31.303753343s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264391336 (45h22m31.303964456s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264787515 (45h22m31.304360655s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265102637 (45h22m31.304675757s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265414084 (45h22m31.304987204s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265622652 (45h22m31.305195772s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.266156605 (45h22m31.305729745s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:57.069064983 (45h22m33.108638103s) [upload=39871]: Next returned nil segment Sep 8 10:50:57.069083619 (45h22m33.108656729s) [upload=39871]: Waiting for error group managing segments... Sep 8 10:50:57.358709524 (45h22m33.398282644s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.418851458 (45h22m33.458424578s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.422887822 (45h22m33.462460942s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.426244124 (45h22m33.465817244s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.438594908 (45h22m33.478168028s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.477758539 (45h22m33.517331659s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.478283144 (45h22m33.517856264s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.494427878 (45h22m33.534000998s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.498758564 (45h22m33.538331684s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.519426042 (45h22m33.558999163s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.537375701 (45h22m33.576948811s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.544671341 (45h22m33.584244461s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553767086 (45h22m33.593340206s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553786884 (45h22m33.593360004s) [seg_pos={0 0}, upload=39871]: Segment reached optimal threshold of 13 pieces. Sep 8 10:50:57.553982909 (45h22m33.593556029s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554038305 (45h22m33.593611425s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554102648 (45h22m33.593675768s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE): protocol: write tcp 188.166.225.170:38400->104.36.82.2:4732: use of closed network connection; conn closed: op Sep 8 10:50:57.554156411 (45h22m33.593729531s) [seg_pos={0 0}, upload=39871]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 10:50:57.554221035 (45h22m33.593794155s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 10:50:57.554225534 (45h22m33.593798654s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 10:50:57.879588342 (45h22m33.919161462s) [upload=39871]: Done uploading segments... Sep 8 10:50:57.879607679 (45h22m33.9191808s) [upload=39871]: Upload finished. err: <nil> Duration: 8.789405718s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 6.68114524s FAIL (2025-09-08 11:05:27 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 10:50:54.996737456 (45h22m31.036310576s) [upload=39871]: Starting upload Sep 8 10:50:54.996796369 (45h22m31.036369499s) [upload=39871]: Done starting upload Sep 8 10:50:54.996927921 (45h22m31.036501041s) [upload=39871]: Uploading segments... Sep 8 10:50:54.997046097 (45h22m31.036619217s) [upload=39871]: Got next segment. Inline: false Sep 8 10:50:54.997085543 (45h22m31.036658703s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 10:50:54.997093277 (45h22m31.036666427s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 10:50:55.262079152 (45h22m31.301652283s) [seg_pos={0 0}, upload=39871]: Begin upload segment... Sep 8 10:50:55.262128356 (45h22m31.301701476s) [seg_pos={0 0}, upload=39871]: Done begin upload segment. Sep 8 10:50:55.262146942 (45h22m31.301720062s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262156830 (45h22m31.30172995s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262502612 (45h22m31.302075732s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262872480 (45h22m31.302445601s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263230676 (45h22m31.302803796s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263492266 (45h22m31.303065386s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263718008 (45h22m31.303291129s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263781820 (45h22m31.30335494s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263953148 (45h22m31.303526268s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264180223 (45h22m31.303753343s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264391336 (45h22m31.303964456s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264787515 (45h22m31.304360655s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265102637 (45h22m31.304675757s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265414084 (45h22m31.304987204s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265622652 (45h22m31.305195772s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.266156605 (45h22m31.305729745s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:57.069064983 (45h22m33.108638103s) [upload=39871]: Next returned nil segment Sep 8 10:50:57.069083619 (45h22m33.108656729s) [upload=39871]: Waiting for error group managing segments... Sep 8 10:50:57.358709524 (45h22m33.398282644s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.418851458 (45h22m33.458424578s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.422887822 (45h22m33.462460942s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.426244124 (45h22m33.465817244s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.438594908 (45h22m33.478168028s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.477758539 (45h22m33.517331659s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.478283144 (45h22m33.517856264s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.494427878 (45h22m33.534000998s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.498758564 (45h22m33.538331684s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.519426042 (45h22m33.558999163s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.537375701 (45h22m33.576948811s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.544671341 (45h22m33.584244461s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553767086 (45h22m33.593340206s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553786884 (45h22m33.593360004s) [seg_pos={0 0}, upload=39871]: Segment reached optimal threshold of 13 pieces. Sep 8 10:50:57.553982909 (45h22m33.593556029s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554038305 (45h22m33.593611425s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554102648 (45h22m33.593675768s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE): protocol: write tcp 188.166.225.170:38400->104.36.82.2:4732: use of closed network connection; conn closed: op Sep 8 10:50:57.554156411 (45h22m33.593729531s) [seg_pos={0 0}, upload=39871]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 10:50:57.554221035 (45h22m33.593794155s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 10:50:57.554225534 (45h22m33.593798654s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 10:50:57.879588342 (45h22m33.919161462s) [upload=39871]: Done uploading segments... Sep 8 10:50:57.879607679 (45h22m33.9191808s) [upload=39871]: Upload finished. err: <nil> Duration: 6.681175709s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 6.117825815s FAIL (2025-09-08 11:04:17 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 10:50:54.996737456 (45h22m31.036310576s) [upload=39871]: Starting upload Sep 8 10:50:54.996796369 (45h22m31.036369499s) [upload=39871]: Done starting upload Sep 8 10:50:54.996927921 (45h22m31.036501041s) [upload=39871]: Uploading segments... Sep 8 10:50:54.997046097 (45h22m31.036619217s) [upload=39871]: Got next segment. Inline: false Sep 8 10:50:54.997085543 (45h22m31.036658703s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 10:50:54.997093277 (45h22m31.036666427s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 10:50:55.262079152 (45h22m31.301652283s) [seg_pos={0 0}, upload=39871]: Begin upload segment... Sep 8 10:50:55.262128356 (45h22m31.301701476s) [seg_pos={0 0}, upload=39871]: Done begin upload segment. Sep 8 10:50:55.262146942 (45h22m31.301720062s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262156830 (45h22m31.30172995s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262502612 (45h22m31.302075732s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262872480 (45h22m31.302445601s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263230676 (45h22m31.302803796s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263492266 (45h22m31.303065386s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263718008 (45h22m31.303291129s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263781820 (45h22m31.30335494s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263953148 (45h22m31.303526268s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264180223 (45h22m31.303753343s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264391336 (45h22m31.303964456s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264787515 (45h22m31.304360655s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265102637 (45h22m31.304675757s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265414084 (45h22m31.304987204s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265622652 (45h22m31.305195772s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.266156605 (45h22m31.305729745s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:57.069064983 (45h22m33.108638103s) [upload=39871]: Next returned nil segment Sep 8 10:50:57.069083619 (45h22m33.108656729s) [upload=39871]: Waiting for error group managing segments... Sep 8 10:50:57.358709524 (45h22m33.398282644s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.418851458 (45h22m33.458424578s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.422887822 (45h22m33.462460942s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.426244124 (45h22m33.465817244s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.438594908 (45h22m33.478168028s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.477758539 (45h22m33.517331659s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.478283144 (45h22m33.517856264s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.494427878 (45h22m33.534000998s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.498758564 (45h22m33.538331684s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.519426042 (45h22m33.558999163s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.537375701 (45h22m33.576948811s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.544671341 (45h22m33.584244461s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553767086 (45h22m33.593340206s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553786884 (45h22m33.593360004s) [seg_pos={0 0}, upload=39871]: Segment reached optimal threshold of 13 pieces. Sep 8 10:50:57.553982909 (45h22m33.593556029s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554038305 (45h22m33.593611425s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554102648 (45h22m33.593675768s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE): protocol: write tcp 188.166.225.170:38400->104.36.82.2:4732: use of closed network connection; conn closed: op Sep 8 10:50:57.554156411 (45h22m33.593729531s) [seg_pos={0 0}, upload=39871]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 10:50:57.554221035 (45h22m33.593794155s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 10:50:57.554225534 (45h22m33.593798654s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 10:50:57.879588342 (45h22m33.919161462s) [upload=39871]: Done uploading segments... Sep 8 10:50:57.879607679 (45h22m33.9191808s) [upload=39871]: Upload finished. err: <nil> Duration: 6.1178649s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 6.788777009s FAIL (2025-09-08 11:03:24 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 10:50:54.996737456 (45h22m31.036310576s) [upload=39871]: Starting upload Sep 8 10:50:54.996796369 (45h22m31.036369499s) [upload=39871]: Done starting upload Sep 8 10:50:54.996927921 (45h22m31.036501041s) [upload=39871]: Uploading segments... Sep 8 10:50:54.997046097 (45h22m31.036619217s) [upload=39871]: Got next segment. Inline: false Sep 8 10:50:54.997085543 (45h22m31.036658703s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 10:50:54.997093277 (45h22m31.036666427s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 10:50:55.262079152 (45h22m31.301652283s) [seg_pos={0 0}, upload=39871]: Begin upload segment... Sep 8 10:50:55.262128356 (45h22m31.301701476s) [seg_pos={0 0}, upload=39871]: Done begin upload segment. Sep 8 10:50:55.262146942 (45h22m31.301720062s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262156830 (45h22m31.30172995s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262502612 (45h22m31.302075732s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262872480 (45h22m31.302445601s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263230676 (45h22m31.302803796s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263492266 (45h22m31.303065386s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263718008 (45h22m31.303291129s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263781820 (45h22m31.30335494s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263953148 (45h22m31.303526268s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264180223 (45h22m31.303753343s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264391336 (45h22m31.303964456s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264787515 (45h22m31.304360655s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265102637 (45h22m31.304675757s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265414084 (45h22m31.304987204s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265622652 (45h22m31.305195772s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.266156605 (45h22m31.305729745s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:57.069064983 (45h22m33.108638103s) [upload=39871]: Next returned nil segment Sep 8 10:50:57.069083619 (45h22m33.108656729s) [upload=39871]: Waiting for error group managing segments... Sep 8 10:50:57.358709524 (45h22m33.398282644s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.418851458 (45h22m33.458424578s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.422887822 (45h22m33.462460942s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.426244124 (45h22m33.465817244s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.438594908 (45h22m33.478168028s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.477758539 (45h22m33.517331659s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.478283144 (45h22m33.517856264s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.494427878 (45h22m33.534000998s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.498758564 (45h22m33.538331684s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.519426042 (45h22m33.558999163s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.537375701 (45h22m33.576948811s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.544671341 (45h22m33.584244461s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553767086 (45h22m33.593340206s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553786884 (45h22m33.593360004s) [seg_pos={0 0}, upload=39871]: Segment reached optimal threshold of 13 pieces. Sep 8 10:50:57.553982909 (45h22m33.593556029s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554038305 (45h22m33.593611425s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554102648 (45h22m33.593675768s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE): protocol: write tcp 188.166.225.170:38400->104.36.82.2:4732: use of closed network connection; conn closed: op Sep 8 10:50:57.554156411 (45h22m33.593729531s) [seg_pos={0 0}, upload=39871]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 10:50:57.554221035 (45h22m33.593794155s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 10:50:57.554225534 (45h22m33.593798654s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 10:50:57.879588342 (45h22m33.919161462s) [upload=39871]: Done uploading segments... Sep 8 10:50:57.879607679 (45h22m33.9191808s) [upload=39871]: Upload finished. err: <nil> Duration: 6.788805793s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 6.103015426s FAIL (2025-09-08 11:02:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 10:50:54.996737456 (45h22m31.036310576s) [upload=39871]: Starting upload Sep 8 10:50:54.996796369 (45h22m31.036369499s) [upload=39871]: Done starting upload Sep 8 10:50:54.996927921 (45h22m31.036501041s) [upload=39871]: Uploading segments... Sep 8 10:50:54.997046097 (45h22m31.036619217s) [upload=39871]: Got next segment. Inline: false Sep 8 10:50:54.997085543 (45h22m31.036658703s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 10:50:54.997093277 (45h22m31.036666427s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 10:50:55.262079152 (45h22m31.301652283s) [seg_pos={0 0}, upload=39871]: Begin upload segment... Sep 8 10:50:55.262128356 (45h22m31.301701476s) [seg_pos={0 0}, upload=39871]: Done begin upload segment. Sep 8 10:50:55.262146942 (45h22m31.301720062s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262156830 (45h22m31.30172995s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262502612 (45h22m31.302075732s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262872480 (45h22m31.302445601s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263230676 (45h22m31.302803796s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263492266 (45h22m31.303065386s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263718008 (45h22m31.303291129s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263781820 (45h22m31.30335494s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263953148 (45h22m31.303526268s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264180223 (45h22m31.303753343s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264391336 (45h22m31.303964456s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264787515 (45h22m31.304360655s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265102637 (45h22m31.304675757s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265414084 (45h22m31.304987204s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265622652 (45h22m31.305195772s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.266156605 (45h22m31.305729745s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:57.069064983 (45h22m33.108638103s) [upload=39871]: Next returned nil segment Sep 8 10:50:57.069083619 (45h22m33.108656729s) [upload=39871]: Waiting for error group managing segments... Sep 8 10:50:57.358709524 (45h22m33.398282644s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.418851458 (45h22m33.458424578s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.422887822 (45h22m33.462460942s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.426244124 (45h22m33.465817244s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.438594908 (45h22m33.478168028s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.477758539 (45h22m33.517331659s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.478283144 (45h22m33.517856264s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.494427878 (45h22m33.534000998s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.498758564 (45h22m33.538331684s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.519426042 (45h22m33.558999163s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.537375701 (45h22m33.576948811s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.544671341 (45h22m33.584244461s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553767086 (45h22m33.593340206s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553786884 (45h22m33.593360004s) [seg_pos={0 0}, upload=39871]: Segment reached optimal threshold of 13 pieces. Sep 8 10:50:57.553982909 (45h22m33.593556029s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554038305 (45h22m33.593611425s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554102648 (45h22m33.593675768s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE): protocol: write tcp 188.166.225.170:38400->104.36.82.2:4732: use of closed network connection; conn closed: op Sep 8 10:50:57.554156411 (45h22m33.593729531s) [seg_pos={0 0}, upload=39871]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 10:50:57.554221035 (45h22m33.593794155s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 10:50:57.554225534 (45h22m33.593798654s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 10:50:57.879588342 (45h22m33.919161462s) [upload=39871]: Done uploading segments... Sep 8 10:50:57.879607679 (45h22m33.9191808s) [upload=39871]: Upload finished. err: <nil> Duration: 6.103036826s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 6.196494756s FAIL (2025-09-08 11:02:13 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 10:50:54.996737456 (45h22m31.036310576s) [upload=39871]: Starting upload Sep 8 10:50:54.996796369 (45h22m31.036369499s) [upload=39871]: Done starting upload Sep 8 10:50:54.996927921 (45h22m31.036501041s) [upload=39871]: Uploading segments... Sep 8 10:50:54.997046097 (45h22m31.036619217s) [upload=39871]: Got next segment. Inline: false Sep 8 10:50:54.997085543 (45h22m31.036658703s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 10:50:54.997093277 (45h22m31.036666427s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 10:50:55.262079152 (45h22m31.301652283s) [seg_pos={0 0}, upload=39871]: Begin upload segment... Sep 8 10:50:55.262128356 (45h22m31.301701476s) [seg_pos={0 0}, upload=39871]: Done begin upload segment. Sep 8 10:50:55.262146942 (45h22m31.301720062s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262156830 (45h22m31.30172995s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262502612 (45h22m31.302075732s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262872480 (45h22m31.302445601s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263230676 (45h22m31.302803796s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263492266 (45h22m31.303065386s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263718008 (45h22m31.303291129s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263781820 (45h22m31.30335494s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263953148 (45h22m31.303526268s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264180223 (45h22m31.303753343s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264391336 (45h22m31.303964456s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264787515 (45h22m31.304360655s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265102637 (45h22m31.304675757s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265414084 (45h22m31.304987204s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265622652 (45h22m31.305195772s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.266156605 (45h22m31.305729745s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:57.069064983 (45h22m33.108638103s) [upload=39871]: Next returned nil segment Sep 8 10:50:57.069083619 (45h22m33.108656729s) [upload=39871]: Waiting for error group managing segments... Sep 8 10:50:57.358709524 (45h22m33.398282644s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.418851458 (45h22m33.458424578s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.422887822 (45h22m33.462460942s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.426244124 (45h22m33.465817244s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.438594908 (45h22m33.478168028s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.477758539 (45h22m33.517331659s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.478283144 (45h22m33.517856264s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.494427878 (45h22m33.534000998s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.498758564 (45h22m33.538331684s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.519426042 (45h22m33.558999163s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.537375701 (45h22m33.576948811s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.544671341 (45h22m33.584244461s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553767086 (45h22m33.593340206s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553786884 (45h22m33.593360004s) [seg_pos={0 0}, upload=39871]: Segment reached optimal threshold of 13 pieces. Sep 8 10:50:57.553982909 (45h22m33.593556029s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554038305 (45h22m33.593611425s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554102648 (45h22m33.593675768s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE): protocol: write tcp 188.166.225.170:38400->104.36.82.2:4732: use of closed network connection; conn closed: op Sep 8 10:50:57.554156411 (45h22m33.593729531s) [seg_pos={0 0}, upload=39871]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 10:50:57.554221035 (45h22m33.593794155s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 10:50:57.554225534 (45h22m33.593798654s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 10:50:57.879588342 (45h22m33.919161462s) [upload=39871]: Done uploading segments... Sep 8 10:50:57.879607679 (45h22m33.9191808s) [upload=39871]: Upload finished. err: <nil> Duration: 6.196524674s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 6.278400405s FAIL (2025-09-08 11:01:07 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 10:50:54.996737456 (45h22m31.036310576s) [upload=39871]: Starting upload Sep 8 10:50:54.996796369 (45h22m31.036369499s) [upload=39871]: Done starting upload Sep 8 10:50:54.996927921 (45h22m31.036501041s) [upload=39871]: Uploading segments... Sep 8 10:50:54.997046097 (45h22m31.036619217s) [upload=39871]: Got next segment. Inline: false Sep 8 10:50:54.997085543 (45h22m31.036658703s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 10:50:54.997093277 (45h22m31.036666427s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 10:50:55.262079152 (45h22m31.301652283s) [seg_pos={0 0}, upload=39871]: Begin upload segment... Sep 8 10:50:55.262128356 (45h22m31.301701476s) [seg_pos={0 0}, upload=39871]: Done begin upload segment. Sep 8 10:50:55.262146942 (45h22m31.301720062s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262156830 (45h22m31.30172995s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262502612 (45h22m31.302075732s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262872480 (45h22m31.302445601s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263230676 (45h22m31.302803796s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263492266 (45h22m31.303065386s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263718008 (45h22m31.303291129s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263781820 (45h22m31.30335494s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263953148 (45h22m31.303526268s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264180223 (45h22m31.303753343s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264391336 (45h22m31.303964456s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264787515 (45h22m31.304360655s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265102637 (45h22m31.304675757s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265414084 (45h22m31.304987204s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265622652 (45h22m31.305195772s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.266156605 (45h22m31.305729745s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:57.069064983 (45h22m33.108638103s) [upload=39871]: Next returned nil segment Sep 8 10:50:57.069083619 (45h22m33.108656729s) [upload=39871]: Waiting for error group managing segments... Sep 8 10:50:57.358709524 (45h22m33.398282644s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.418851458 (45h22m33.458424578s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.422887822 (45h22m33.462460942s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.426244124 (45h22m33.465817244s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.438594908 (45h22m33.478168028s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.477758539 (45h22m33.517331659s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.478283144 (45h22m33.517856264s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.494427878 (45h22m33.534000998s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.498758564 (45h22m33.538331684s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.519426042 (45h22m33.558999163s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.537375701 (45h22m33.576948811s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.544671341 (45h22m33.584244461s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553767086 (45h22m33.593340206s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553786884 (45h22m33.593360004s) [seg_pos={0 0}, upload=39871]: Segment reached optimal threshold of 13 pieces. Sep 8 10:50:57.553982909 (45h22m33.593556029s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554038305 (45h22m33.593611425s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554102648 (45h22m33.593675768s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE): protocol: write tcp 188.166.225.170:38400->104.36.82.2:4732: use of closed network connection; conn closed: op Sep 8 10:50:57.554156411 (45h22m33.593729531s) [seg_pos={0 0}, upload=39871]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 10:50:57.554221035 (45h22m33.593794155s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 10:50:57.554225534 (45h22m33.593798654s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 10:50:57.879588342 (45h22m33.919161462s) [upload=39871]: Done uploading segments... Sep 8 10:50:57.879607679 (45h22m33.9191808s) [upload=39871]: Upload finished. err: <nil> Duration: 6.278429s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 6.152317397s FAIL (2025-09-08 11:00:09 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 10:50:54.996737456 (45h22m31.036310576s) [upload=39871]: Starting upload Sep 8 10:50:54.996796369 (45h22m31.036369499s) [upload=39871]: Done starting upload Sep 8 10:50:54.996927921 (45h22m31.036501041s) [upload=39871]: Uploading segments... Sep 8 10:50:54.997046097 (45h22m31.036619217s) [upload=39871]: Got next segment. Inline: false Sep 8 10:50:54.997085543 (45h22m31.036658703s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 10:50:54.997093277 (45h22m31.036666427s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 10:50:55.262079152 (45h22m31.301652283s) [seg_pos={0 0}, upload=39871]: Begin upload segment... Sep 8 10:50:55.262128356 (45h22m31.301701476s) [seg_pos={0 0}, upload=39871]: Done begin upload segment. Sep 8 10:50:55.262146942 (45h22m31.301720062s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262156830 (45h22m31.30172995s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262502612 (45h22m31.302075732s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262872480 (45h22m31.302445601s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263230676 (45h22m31.302803796s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263492266 (45h22m31.303065386s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263718008 (45h22m31.303291129s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263781820 (45h22m31.30335494s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263953148 (45h22m31.303526268s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264180223 (45h22m31.303753343s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264391336 (45h22m31.303964456s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264787515 (45h22m31.304360655s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265102637 (45h22m31.304675757s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265414084 (45h22m31.304987204s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265622652 (45h22m31.305195772s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.266156605 (45h22m31.305729745s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:57.069064983 (45h22m33.108638103s) [upload=39871]: Next returned nil segment Sep 8 10:50:57.069083619 (45h22m33.108656729s) [upload=39871]: Waiting for error group managing segments... Sep 8 10:50:57.358709524 (45h22m33.398282644s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.418851458 (45h22m33.458424578s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.422887822 (45h22m33.462460942s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.426244124 (45h22m33.465817244s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.438594908 (45h22m33.478168028s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.477758539 (45h22m33.517331659s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.478283144 (45h22m33.517856264s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.494427878 (45h22m33.534000998s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.498758564 (45h22m33.538331684s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.519426042 (45h22m33.558999163s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.537375701 (45h22m33.576948811s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.544671341 (45h22m33.584244461s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553767086 (45h22m33.593340206s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553786884 (45h22m33.593360004s) [seg_pos={0 0}, upload=39871]: Segment reached optimal threshold of 13 pieces. Sep 8 10:50:57.553982909 (45h22m33.593556029s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554038305 (45h22m33.593611425s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554102648 (45h22m33.593675768s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE): protocol: write tcp 188.166.225.170:38400->104.36.82.2:4732: use of closed network connection; conn closed: op Sep 8 10:50:57.554156411 (45h22m33.593729531s) [seg_pos={0 0}, upload=39871]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 10:50:57.554221035 (45h22m33.593794155s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 10:50:57.554225534 (45h22m33.593798654s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 10:50:57.879588342 (45h22m33.919161462s) [upload=39871]: Done uploading segments... Sep 8 10:50:57.879607679 (45h22m33.9191808s) [upload=39871]: Upload finished. err: <nil> Duration: 6.152368305s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 6.298376031s FAIL (2025-09-08 10:59:32 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 10:50:54.996737456 (45h22m31.036310576s) [upload=39871]: Starting upload Sep 8 10:50:54.996796369 (45h22m31.036369499s) [upload=39871]: Done starting upload Sep 8 10:50:54.996927921 (45h22m31.036501041s) [upload=39871]: Uploading segments... Sep 8 10:50:54.997046097 (45h22m31.036619217s) [upload=39871]: Got next segment. Inline: false Sep 8 10:50:54.997085543 (45h22m31.036658703s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 10:50:54.997093277 (45h22m31.036666427s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 10:50:55.262079152 (45h22m31.301652283s) [seg_pos={0 0}, upload=39871]: Begin upload segment... Sep 8 10:50:55.262128356 (45h22m31.301701476s) [seg_pos={0 0}, upload=39871]: Done begin upload segment. Sep 8 10:50:55.262146942 (45h22m31.301720062s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262156830 (45h22m31.30172995s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262502612 (45h22m31.302075732s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262872480 (45h22m31.302445601s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263230676 (45h22m31.302803796s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263492266 (45h22m31.303065386s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263718008 (45h22m31.303291129s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263781820 (45h22m31.30335494s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263953148 (45h22m31.303526268s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264180223 (45h22m31.303753343s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264391336 (45h22m31.303964456s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264787515 (45h22m31.304360655s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265102637 (45h22m31.304675757s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265414084 (45h22m31.304987204s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265622652 (45h22m31.305195772s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.266156605 (45h22m31.305729745s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:57.069064983 (45h22m33.108638103s) [upload=39871]: Next returned nil segment Sep 8 10:50:57.069083619 (45h22m33.108656729s) [upload=39871]: Waiting for error group managing segments... Sep 8 10:50:57.358709524 (45h22m33.398282644s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.418851458 (45h22m33.458424578s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.422887822 (45h22m33.462460942s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.426244124 (45h22m33.465817244s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.438594908 (45h22m33.478168028s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.477758539 (45h22m33.517331659s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.478283144 (45h22m33.517856264s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.494427878 (45h22m33.534000998s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.498758564 (45h22m33.538331684s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.519426042 (45h22m33.558999163s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.537375701 (45h22m33.576948811s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.544671341 (45h22m33.584244461s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553767086 (45h22m33.593340206s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553786884 (45h22m33.593360004s) [seg_pos={0 0}, upload=39871]: Segment reached optimal threshold of 13 pieces. Sep 8 10:50:57.553982909 (45h22m33.593556029s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554038305 (45h22m33.593611425s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554102648 (45h22m33.593675768s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE): protocol: write tcp 188.166.225.170:38400->104.36.82.2:4732: use of closed network connection; conn closed: op Sep 8 10:50:57.554156411 (45h22m33.593729531s) [seg_pos={0 0}, upload=39871]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 10:50:57.554221035 (45h22m33.593794155s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 10:50:57.554225534 (45h22m33.593798654s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 10:50:57.879588342 (45h22m33.919161462s) [upload=39871]: Done uploading segments... Sep 8 10:50:57.879607679 (45h22m33.9191808s) [upload=39871]: Upload finished. err: <nil> Duration: 6.298401721s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 6.362088376s FAIL (2025-09-08 10:58:49 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 10:50:54.996737456 (45h22m31.036310576s) [upload=39871]: Starting upload Sep 8 10:50:54.996796369 (45h22m31.036369499s) [upload=39871]: Done starting upload Sep 8 10:50:54.996927921 (45h22m31.036501041s) [upload=39871]: Uploading segments... Sep 8 10:50:54.997046097 (45h22m31.036619217s) [upload=39871]: Got next segment. Inline: false Sep 8 10:50:54.997085543 (45h22m31.036658703s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 10:50:54.997093277 (45h22m31.036666427s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 10:50:55.262079152 (45h22m31.301652283s) [seg_pos={0 0}, upload=39871]: Begin upload segment... Sep 8 10:50:55.262128356 (45h22m31.301701476s) [seg_pos={0 0}, upload=39871]: Done begin upload segment. Sep 8 10:50:55.262146942 (45h22m31.301720062s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262156830 (45h22m31.30172995s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262502612 (45h22m31.302075732s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.262872480 (45h22m31.302445601s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263230676 (45h22m31.302803796s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263492266 (45h22m31.303065386s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263718008 (45h22m31.303291129s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263781820 (45h22m31.30335494s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.263953148 (45h22m31.303526268s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264180223 (45h22m31.303753343s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264391336 (45h22m31.303964456s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.264787515 (45h22m31.304360655s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265102637 (45h22m31.304675757s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265414084 (45h22m31.304987204s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.265622652 (45h22m31.305195772s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:55.266156605 (45h22m31.305729745s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Uploading piece... Sep 8 10:50:57.069064983 (45h22m33.108638103s) [upload=39871]: Next returned nil segment Sep 8 10:50:57.069083619 (45h22m33.108656729s) [upload=39871]: Waiting for error group managing segments... Sep 8 10:50:57.358709524 (45h22m33.398282644s) [noise=true , address=77.90.31.18:4805 , piece_id=FHG32RXI5FF3EMNNWNWFYOU27J2GKT4EPR2IPMY7LA7PBCVSOQWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.418851458 (45h22m33.458424578s) [noise=true , address=45.91.116.10:4081 , piece_id=ETPGEQTTQNQIC5DXJFALBF7AAGBLOGOEFKLTK752MEDVWXE7PUVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.422887822 (45h22m33.462460942s) [noise=true , address=77.90.31.12:4592 , piece_id=JELUMQX5373KPVNWFMNPYVBL62O2WLVD5A3NN2RDVQZWB6A3F6NQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.426244124 (45h22m33.465817244s) [noise=true , address=145.79.227.17:4970 , piece_id=PYSN3HIGYW2CR4COPPANQBJ4NYMSL34FB4FDQZXLLS22TF53QTWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.438594908 (45h22m33.478168028s) [noise=true , address=45.91.116.4:4938 , piece_id=DDNCGSKRXDAN5LFMYETDL6I5AAEC2MZDNMEEQ4AP5YKHA3AKW4JA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.477758539 (45h22m33.517331659s) [noise=true , address=45.91.116.11:4119 , piece_id=LJIJZMI4YTPL3OSDGYRMMO7DU6YVHE6GN2JDLE4VQSTM6E2SETWA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.478283144 (45h22m33.517856264s) [noise=true , address=45.91.116.8:4045 , piece_id=CSHQND364QL47643T5I4ZQCITTWKWA3Q5LG7II4NJ45WUA7XUNJA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.494427878 (45h22m33.534000998s) [noise=true , address=77.90.31.16:4735 , piece_id=6GRAABEFUR7MVNGWRKQD5GUEBJCU3UHPCRXA7GFD47ZVWIDXXAZQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.498758564 (45h22m33.538331684s) [noise=true , address=45.91.116.12:4226 , piece_id=7CFLYTUBOTYVP3ENPXTVCZVCETSLCNU4ZX7YFEMABKTQIVI7AEMA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.519426042 (45h22m33.558999163s) [noise=true , address=45.91.116.14:4190 , piece_id=JWFFVRDXY4R6LU7CSMFOKMILQYVHEHDKXVDJGZMDTBHCZG2JCLVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.537375701 (45h22m33.576948811s) [noise=true , address=145.79.227.3:4151 , piece_id=A334P2TJOGVBDNJFLEWWNDLQSG7JNR5D6S3LSIU6E5FBF2LLWUFQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.544671341 (45h22m33.584244461s) [noise=true , address=145.79.227.6:4257 , piece_id=VRNR3WS57AVQTWVFYS2ASDWJHFLAN22BLIWQDBLEKHYDHEIY2W5Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553767086 (45h22m33.593340206s) [noise=true , address=77.90.31.19:4842 , piece_id=WNPW5MJSO62IMSDKNUR6KLH56LIUUGXEIF2GTYJMPUXTHHQW672Q, seg_pos={0 0}, upload=39871]: Done uploading piece. err: <nil> Sep 8 10:50:57.553786884 (45h22m33.593360004s) [seg_pos={0 0}, upload=39871]: Segment reached optimal threshold of 13 pieces. Sep 8 10:50:57.553982909 (45h22m33.593556029s) [noise=true , address=45.91.116.9:4261 , piece_id=HNMBIBIP4VJ2VAFWKSAYG5R2EMVWVP2XZDU2Q3IJUXZMYNCHH3KQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554038305 (45h22m33.593611425s) [noise=true , address=77.90.31.15:4699 , piece_id=QV355HCWKDWYZ5FZYY7HRXSUHMO6OWGEHJ62T72M5TWY37U3UXVA, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M): protocol: expected piece hash; context canceled; EOF Sep 8 10:50:57.554102648 (45h22m33.593675768s) [noise=true , address=104.36.82.2:4732 , piece_id=APPY3TNBPA6T3XCMOGVWKRD6KF2LIFZEAROBVU4N5BV227SERIGQ, seg_pos={0 0}, upload=39871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE): protocol: write tcp 188.166.225.170:38400->104.36.82.2:4732: use of closed network connection; conn closed: op Sep 8 10:50:57.554156411 (45h22m33.593729531s) [seg_pos={0 0}, upload=39871]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 10:50:57.554221035 (45h22m33.593794155s) [upload=39871]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 10:50:57.554225534 (45h22m33.593798654s) [upload=39871]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 10:50:57.879588342 (45h22m33.919161462s) [upload=39871]: Done uploading segments... Sep 8 10:50:57.879607679 (45h22m33.9191808s) [upload=39871]: Upload finished. err: <nil> Duration: 6.362118033s core uplink us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)