Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 16 out of 60 is failed (threshold=3) [......X................XXX........XXX.XX..XXXX...X....XX....] duration: 28.432192397s FAIL (2025-09-09 13:18:41 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 13:16:23.943018134 (71h47m59.982591255s) [upload=63193]: Starting upload Sep 9 13:16:23.943079762 (71h47m59.982652882s) [upload=63193]: Done starting upload Sep 9 13:16:23.943176287 (71h47m59.982749407s) [upload=63193]: Uploading segments... Sep 9 13:16:23.943263574 (71h47m59.982836694s) [upload=63193]: Got next segment. Inline: false Sep 9 13:16:23.943290756 (71h47m59.982863876s) [upload=63193]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 13:16:23.943295615 (71h47m59.982868735s) [upload=63193]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 13:16:24.225770642 (71h48m0.265343762s) [seg_pos={0 0}, upload=63193]: Begin upload segment... Sep 9 13:16:24.225844544 (71h48m0.265417674s) [seg_pos={0 0}, upload=63193]: Done begin upload segment. Sep 9 13:16:24.225868350 (71h48m0.26544147s) [noise=true , address=45.91.116.6:4973 , piece_id=IDISHV3MDRPNC5IV5KLJ3SQ67XTOHSJV35NBS5GX2XQMJOZ5KZYA, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.225906813 (71h48m0.265479933s) [noise=true , address=77.90.31.15:4697 , piece_id=WGAWM2RDO63BV4EAQN5W5O3LUHNVXMR7O4VNDTWRP7TYUVCPVVGA, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.226240451 (71h48m0.265813571s) [noise=true , address=145.79.227.2:4113 , piece_id=6GXPBZ6TJKPSBIQEEDH2GPPQZJZYB7ILPLGISNNDSQZRZAZ6UC4A, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.226386521 (71h48m0.265959641s) [noise=true , address=77.90.31.18:4807 , piece_id=MRZ22HZ56SAYYFVHL3DMHYIDXZKTBMJFR75J65RLL6YYDADDFSMQ, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.226595250 (71h48m0.26616837s) [noise=true , address=145.79.227.11:4731 , piece_id=7FAAXJ2EDT6NITKTLGSBJSNBHHOY7Z3LZTKGYFCQHLQD52KX6ZUQ, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.226670024 (71h48m0.266243144s) [noise=true , address=77.90.31.16:4733 , piece_id=FIZAL3WN77QFUCEEEUHZNLAQTCRAJSN4HDFV6W6A2EJXIK5UAZ6Q, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.226894793 (71h48m0.266467913s) [noise=true , address=45.91.116.11:4119 , piece_id=SGDUN7UO2XU2JRZYEUSQMB6M6YUDNRDHWUK2U67EAEJBOOOIAQNA, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.226989064 (71h48m0.266562184s) [noise=true , address=45.91.116.14:4190 , piece_id=TNEND6X3WIUEQM5FVIEMDOK5NHZL2VRPA7K7WUVLXYC4MPZDWRRA, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.227168517 (71h48m0.266741637s) [noise=true , address=45.91.116.4:4937 , piece_id=SK2TGJAOKIJOHOPF6MLYEOXQ7LQJF6HCWILLRDMP57IGZVWN6LOQ, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.227396865 (71h48m0.266969985s) [noise=true , address=77.90.31.19:4842 , piece_id=QPRL4AZ5YMAXQJ2IQOZ47RN6QDZ6MAGUSF3QMD4IJHA4UH4E6R7Q, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.227614812 (71h48m0.267187922s) [noise=true , address=45.91.116.11:4118 , piece_id=4NU3DT45HCEFESFPOGQ5DJE5WN3PWMGNJIQXXOUD7E62PVYXKSIA, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.227828560 (71h48m0.26740168s) [noise=true , address=77.90.31.21:4878 , piece_id=QXVY5XJXNFLKWTYIJOA3EFXNCOALIZZUOX2KXHOLZLAH3PLLMXLQ, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.228037530 (71h48m0.26761065s) [noise=true , address=145.79.227.17:4972 , piece_id=DJXTDERCD5TVK4WLFZRE55WSK5JERJ7VMSPO5GXMRDQ3IOPAXT3A, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.228247592 (71h48m0.267820713s) [noise=true , address=77.90.31.15:4699 , piece_id=6Q6BNEB3TL3YLJRIAQNAWPBOOSKSZUQ3LKV4ABLT7GSKYITCAJBQ, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.228461793 (71h48m0.268034913s) [noise=true , address=145.79.227.14:4837 , piece_id=VTB34SA3KGWKVWYZHIEYBGRIKUBNK2A3AXE4O2HQJA7QANYFY2OA, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.228674138 (71h48m0.268247258s) [noise=true , address=77.90.31.13:4628 , piece_id=OQJPOZMQOQ4TBNUWDKAYNUCM7MN56T5S2HSM2PBXAYGIVYJ67PAQ, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:26.029234678 (71h48m2.068807798s) [upload=63193]: Next returned nil segment Sep 9 13:16:26.029258935 (71h48m2.068832055s) [upload=63193]: Waiting for error group managing segments... Sep 9 13:16:26.339978495 (71h48m2.379551615s) [noise=true , address=145.79.227.14:4837 , piece_id=VTB34SA3KGWKVWYZHIEYBGRIKUBNK2A3AXE4O2HQJA7QANYFY2OA, seg_pos={0 0}, upload=63193]: Done uploading piece. err: <nil> Sep 9 13:16:26.410998868 (71h48m2.450571988s) [noise=true , address=145.79.227.11:4731 , piece_id=7FAAXJ2EDT6NITKTLGSBJSNBHHOY7Z3LZTKGYFCQHLQD52KX6ZUQ, seg_pos={0 0}, upload=63193]: Done uploading piece. err: <nil> Sep 9 13:16:26.457973460 (71h48m2.49754658s) [noise=true , address=45.91.116.11:4118 , piece_id=4NU3DT45HCEFESFPOGQ5DJE5WN3PWMGNJIQXXOUD7E62PVYXKSIA, seg_pos={0 0}, upload=63193]: Done uploading piece. err: <nil> Sep 9 13:16:26.468823492 (71h48m2.508396612s) [noise=true , address=145.79.227.17:4972 , piece_id=DJXTDERCD5TVK4WLFZRE55WSK5JERJ7VMSPO5GXMRDQ3IOPAXT3A, seg_pos={0 0}, upload=63193]: Done uploading piece. err: <nil> Sep 9 13:16:26.469760264 (71h48m2.509333384s) [noise=true , address=45.91.116.6:4973 , piece_id=IDISHV3MDRPNC5IV5KLJ3SQ67XTOHSJV35NBS5GX2XQMJOZ5KZYA, seg_pos={0 0}, upload=63193]: Done uploading piece. err: <nil> Sep 9 13:16:26.470091628 (71h48m2.509664748s) [noise=true , address=45.91.116.11:4119 , piece_id=SGDUN7UO2XU2JRZYEUSQMB6M6YUDNRDHWUK2U67EAEJBOOOIAQNA, seg_pos={0 0}, upload=63193]: Done uploading piece. err: <nil> Sep 9 13:16:26.476077742 (71h48m2.515650862s) [noise=true , address=45.91.116.14:4190 , piece_id=TNEND6X3WIUEQM5FVIEMDOK5NHZL2VRPA7K7WUVLXYC4MPZDWRRA, seg_pos={0 0}, upload=63193]: Done uploading piece. err: <nil> Sep 9 13:16:26.485692329 (71h48m2.525265449s) [noise=true , address=77.90.31.13:4628 , piece_id=OQJPOZMQOQ4TBNUWDKAYNUCM7MN56T5S2HSM2PBXAYGIVYJ67PAQ, seg_pos={0 0}, upload=63193]: Done uploading piece. err: <nil> Sep 9 13:16:26.517575155 (71h48m2.557148275s) [noise=true , address=77.90.31.16:4733 , piece_id=FIZAL3WN77QFUCEEEUHZNLAQTCRAJSN4HDFV6W6A2EJXIK5UAZ6Q, seg_pos={0 0}, upload=63193]: Done uploading piece. err: <nil> Sep 9 13:16:26.610967685 (71h48m2.650540805s) [noise=true , address=45.91.116.4:4937 , piece_id=SK2TGJAOKIJOHOPF6MLYEOXQ7LQJF6HCWILLRDMP57IGZVWN6LOQ, seg_pos={0 0}, upload=63193]: Done uploading piece. err: <nil> Sep 9 13:16:26.620501818 (71h48m2.660074948s) [noise=true , address=77.90.31.15:4699 , piece_id=6Q6BNEB3TL3YLJRIAQNAWPBOOSKSZUQ3LKV4ABLT7GSKYITCAJBQ, seg_pos={0 0}, upload=63193]: Done uploading piece. err: <nil> Sep 9 13:16:26.673682425 (71h48m2.713255545s) [noise=true , address=77.90.31.15:4697 , piece_id=WGAWM2RDO63BV4EAQN5W5O3LUHNVXMR7O4VNDTWRP7TYUVCPVVGA, seg_pos={0 0}, upload=63193]: Done uploading piece. err: <nil> Sep 9 13:16:26.727566619 (71h48m2.767139759s) [noise=true , address=145.79.227.2:4113 , piece_id=6GXPBZ6TJKPSBIQEEDH2GPPQZJZYB7ILPLGISNNDSQZRZAZ6UC4A, seg_pos={0 0}, upload=63193]: Done uploading piece. err: <nil> Sep 9 13:16:26.727616905 (71h48m2.767190035s) [seg_pos={0 0}, upload=63193]: Segment reached optimal threshold of 13 pieces. Sep 9 13:16:26.727940765 (71h48m2.767513895s) [noise=true , address=77.90.31.21:4878 , piece_id=QXVY5XJXNFLKWTYIJOA3EFXNCOALIZZUOX2KXHOLZLAH3PLLMXLQ, seg_pos={0 0}, upload=63193]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK): protocol: expected piece hash; context canceled; EOF Sep 9 13:16:26.728155216 (71h48m2.767728346s) [noise=true , address=77.90.31.18:4807 , piece_id=MRZ22HZ56SAYYFVHL3DMHYIDXZKTBMJFR75J65RLL6YYDADDFSMQ, seg_pos={0 0}, upload=63193]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS): protocol: write tcp 188.166.225.170:43444->77.90.31.18:4807: use of closed network connection; write tcp 188.166.225.170:43444->77.90.31.18:4807: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43444->77.90.31.18:4807: use of closed network connection Sep 9 13:16:26.728247522 (71h48m2.767820662s) [noise=true , address=77.90.31.19:4842 , piece_id=QPRL4AZ5YMAXQJ2IQOZ47RN6QDZ6MAGUSF3QMD4IJHA4UH4E6R7Q, seg_pos={0 0}, upload=63193]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: write tcp 188.166.225.170:54154->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:54154->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54154->77.90.31.19:4842: use of closed network connection Sep 9 13:16:26.728265457 (71h48m2.767838597s) [seg_pos={0 0}, upload=63193]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 13:16:26.728356090 (71h48m2.76792923s) [upload=63193]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 13:16:26.728363324 (71h48m2.767936454s) [upload=63193]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 13:16:27.188310692 (71h48m3.227883852s) [upload=63193]: Done uploading segments... Sep 9 13:16:27.188332644 (71h48m3.227905764s) [upload=63193]: Upload finished. err: <nil> Duration: 28.432232223s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 16 out of 60 is failed (threshold=3) [.......X................XXX........XXX.XX..XXXX...X....XX...] duration: 17.212798128s FAIL (2025-09-09 13:17:53 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 13:16:23.943018134 (71h47m59.982591255s) [upload=63193]: Starting upload Sep 9 13:16:23.943079762 (71h47m59.982652882s) [upload=63193]: Done starting upload Sep 9 13:16:23.943176287 (71h47m59.982749407s) [upload=63193]: Uploading segments... Sep 9 13:16:23.943263574 (71h47m59.982836694s) [upload=63193]: Got next segment. Inline: false Sep 9 13:16:23.943290756 (71h47m59.982863876s) [upload=63193]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 13:16:23.943295615 (71h47m59.982868735s) [upload=63193]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 13:16:24.225770642 (71h48m0.265343762s) [seg_pos={0 0}, upload=63193]: Begin upload segment... Sep 9 13:16:24.225844544 (71h48m0.265417674s) [seg_pos={0 0}, upload=63193]: Done begin upload segment. Sep 9 13:16:24.225868350 (71h48m0.26544147s) [noise=true , address=45.91.116.6:4973 , piece_id=IDISHV3MDRPNC5IV5KLJ3SQ67XTOHSJV35NBS5GX2XQMJOZ5KZYA, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.225906813 (71h48m0.265479933s) [noise=true , address=77.90.31.15:4697 , piece_id=WGAWM2RDO63BV4EAQN5W5O3LUHNVXMR7O4VNDTWRP7TYUVCPVVGA, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.226240451 (71h48m0.265813571s) [noise=true , address=145.79.227.2:4113 , piece_id=6GXPBZ6TJKPSBIQEEDH2GPPQZJZYB7ILPLGISNNDSQZRZAZ6UC4A, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.226386521 (71h48m0.265959641s) [noise=true , address=77.90.31.18:4807 , piece_id=MRZ22HZ56SAYYFVHL3DMHYIDXZKTBMJFR75J65RLL6YYDADDFSMQ, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.226595250 (71h48m0.26616837s) [noise=true , address=145.79.227.11:4731 , piece_id=7FAAXJ2EDT6NITKTLGSBJSNBHHOY7Z3LZTKGYFCQHLQD52KX6ZUQ, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.226670024 (71h48m0.266243144s) [noise=true , address=77.90.31.16:4733 , piece_id=FIZAL3WN77QFUCEEEUHZNLAQTCRAJSN4HDFV6W6A2EJXIK5UAZ6Q, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.226894793 (71h48m0.266467913s) [noise=true , address=45.91.116.11:4119 , piece_id=SGDUN7UO2XU2JRZYEUSQMB6M6YUDNRDHWUK2U67EAEJBOOOIAQNA, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.226989064 (71h48m0.266562184s) [noise=true , address=45.91.116.14:4190 , piece_id=TNEND6X3WIUEQM5FVIEMDOK5NHZL2VRPA7K7WUVLXYC4MPZDWRRA, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.227168517 (71h48m0.266741637s) [noise=true , address=45.91.116.4:4937 , piece_id=SK2TGJAOKIJOHOPF6MLYEOXQ7LQJF6HCWILLRDMP57IGZVWN6LOQ, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.227396865 (71h48m0.266969985s) [noise=true , address=77.90.31.19:4842 , piece_id=QPRL4AZ5YMAXQJ2IQOZ47RN6QDZ6MAGUSF3QMD4IJHA4UH4E6R7Q, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.227614812 (71h48m0.267187922s) [noise=true , address=45.91.116.11:4118 , piece_id=4NU3DT45HCEFESFPOGQ5DJE5WN3PWMGNJIQXXOUD7E62PVYXKSIA, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.227828560 (71h48m0.26740168s) [noise=true , address=77.90.31.21:4878 , piece_id=QXVY5XJXNFLKWTYIJOA3EFXNCOALIZZUOX2KXHOLZLAH3PLLMXLQ, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.228037530 (71h48m0.26761065s) [noise=true , address=145.79.227.17:4972 , piece_id=DJXTDERCD5TVK4WLFZRE55WSK5JERJ7VMSPO5GXMRDQ3IOPAXT3A, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.228247592 (71h48m0.267820713s) [noise=true , address=77.90.31.15:4699 , piece_id=6Q6BNEB3TL3YLJRIAQNAWPBOOSKSZUQ3LKV4ABLT7GSKYITCAJBQ, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.228461793 (71h48m0.268034913s) [noise=true , address=145.79.227.14:4837 , piece_id=VTB34SA3KGWKVWYZHIEYBGRIKUBNK2A3AXE4O2HQJA7QANYFY2OA, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.228674138 (71h48m0.268247258s) [noise=true , address=77.90.31.13:4628 , piece_id=OQJPOZMQOQ4TBNUWDKAYNUCM7MN56T5S2HSM2PBXAYGIVYJ67PAQ, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:26.029234678 (71h48m2.068807798s) [upload=63193]: Next returned nil segment Sep 9 13:16:26.029258935 (71h48m2.068832055s) [upload=63193]: Waiting for error group managing segments... Sep 9 13:16:26.339978495 (71h48m2.379551615s) [noise=true , address=145.79.227.14:4837 , piece_id=VTB34SA3KGWKVWYZHIEYBGRIKUBNK2A3AXE4O2HQJA7QANYFY2OA, seg_pos={0 0}, upload=63193]: Done uploading piece. err: <nil> Sep 9 13:16:26.410998868 (71h48m2.450571988s) [noise=true , address=145.79.227.11:4731 , piece_id=7FAAXJ2EDT6NITKTLGSBJSNBHHOY7Z3LZTKGYFCQHLQD52KX6ZUQ, seg_pos={0 0}, upload=63193]: Done uploading piece. err: <nil> Sep 9 13:16:26.457973460 (71h48m2.49754658s) [noise=true , address=45.91.116.11:4118 , piece_id=4NU3DT45HCEFESFPOGQ5DJE5WN3PWMGNJIQXXOUD7E62PVYXKSIA, seg_pos={0 0}, upload=63193]: Done uploading piece. err: <nil> Sep 9 13:16:26.468823492 (71h48m2.508396612s) [noise=true , address=145.79.227.17:4972 , piece_id=DJXTDERCD5TVK4WLFZRE55WSK5JERJ7VMSPO5GXMRDQ3IOPAXT3A, seg_pos={0 0}, upload=63193]: Done uploading piece. err: <nil> Sep 9 13:16:26.469760264 (71h48m2.509333384s) [noise=true , address=45.91.116.6:4973 , piece_id=IDISHV3MDRPNC5IV5KLJ3SQ67XTOHSJV35NBS5GX2XQMJOZ5KZYA, seg_pos={0 0}, upload=63193]: Done uploading piece. err: <nil> Sep 9 13:16:26.470091628 (71h48m2.509664748s) [noise=true , address=45.91.116.11:4119 , piece_id=SGDUN7UO2XU2JRZYEUSQMB6M6YUDNRDHWUK2U67EAEJBOOOIAQNA, seg_pos={0 0}, upload=63193]: Done uploading piece. err: <nil> Sep 9 13:16:26.476077742 (71h48m2.515650862s) [noise=true , address=45.91.116.14:4190 , piece_id=TNEND6X3WIUEQM5FVIEMDOK5NHZL2VRPA7K7WUVLXYC4MPZDWRRA, seg_pos={0 0}, upload=63193]: Done uploading piece. err: <nil> Sep 9 13:16:26.485692329 (71h48m2.525265449s) [noise=true , address=77.90.31.13:4628 , piece_id=OQJPOZMQOQ4TBNUWDKAYNUCM7MN56T5S2HSM2PBXAYGIVYJ67PAQ, seg_pos={0 0}, upload=63193]: Done uploading piece. err: <nil> Sep 9 13:16:26.517575155 (71h48m2.557148275s) [noise=true , address=77.90.31.16:4733 , piece_id=FIZAL3WN77QFUCEEEUHZNLAQTCRAJSN4HDFV6W6A2EJXIK5UAZ6Q, seg_pos={0 0}, upload=63193]: Done uploading piece. err: <nil> Sep 9 13:16:26.610967685 (71h48m2.650540805s) [noise=true , address=45.91.116.4:4937 , piece_id=SK2TGJAOKIJOHOPF6MLYEOXQ7LQJF6HCWILLRDMP57IGZVWN6LOQ, seg_pos={0 0}, upload=63193]: Done uploading piece. err: <nil> Sep 9 13:16:26.620501818 (71h48m2.660074948s) [noise=true , address=77.90.31.15:4699 , piece_id=6Q6BNEB3TL3YLJRIAQNAWPBOOSKSZUQ3LKV4ABLT7GSKYITCAJBQ, seg_pos={0 0}, upload=63193]: Done uploading piece. err: <nil> Sep 9 13:16:26.673682425 (71h48m2.713255545s) [noise=true , address=77.90.31.15:4697 , piece_id=WGAWM2RDO63BV4EAQN5W5O3LUHNVXMR7O4VNDTWRP7TYUVCPVVGA, seg_pos={0 0}, upload=63193]: Done uploading piece. err: <nil> Sep 9 13:16:26.727566619 (71h48m2.767139759s) [noise=true , address=145.79.227.2:4113 , piece_id=6GXPBZ6TJKPSBIQEEDH2GPPQZJZYB7ILPLGISNNDSQZRZAZ6UC4A, seg_pos={0 0}, upload=63193]: Done uploading piece. err: <nil> Sep 9 13:16:26.727616905 (71h48m2.767190035s) [seg_pos={0 0}, upload=63193]: Segment reached optimal threshold of 13 pieces. Sep 9 13:16:26.727940765 (71h48m2.767513895s) [noise=true , address=77.90.31.21:4878 , piece_id=QXVY5XJXNFLKWTYIJOA3EFXNCOALIZZUOX2KXHOLZLAH3PLLMXLQ, seg_pos={0 0}, upload=63193]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK): protocol: expected piece hash; context canceled; EOF Sep 9 13:16:26.728155216 (71h48m2.767728346s) [noise=true , address=77.90.31.18:4807 , piece_id=MRZ22HZ56SAYYFVHL3DMHYIDXZKTBMJFR75J65RLL6YYDADDFSMQ, seg_pos={0 0}, upload=63193]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS): protocol: write tcp 188.166.225.170:43444->77.90.31.18:4807: use of closed network connection; write tcp 188.166.225.170:43444->77.90.31.18:4807: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43444->77.90.31.18:4807: use of closed network connection Sep 9 13:16:26.728247522 (71h48m2.767820662s) [noise=true , address=77.90.31.19:4842 , piece_id=QPRL4AZ5YMAXQJ2IQOZ47RN6QDZ6MAGUSF3QMD4IJHA4UH4E6R7Q, seg_pos={0 0}, upload=63193]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: write tcp 188.166.225.170:54154->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:54154->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54154->77.90.31.19:4842: use of closed network connection Sep 9 13:16:26.728265457 (71h48m2.767838597s) [seg_pos={0 0}, upload=63193]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 13:16:26.728356090 (71h48m2.76792923s) [upload=63193]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 13:16:26.728363324 (71h48m2.767936454s) [upload=63193]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 13:16:27.188310692 (71h48m3.227883852s) [upload=63193]: Done uploading segments... Sep 9 13:16:27.188332644 (71h48m3.227905764s) [upload=63193]: Upload finished. err: <nil> Duration: 17.212859976s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 16 out of 60 is failed (threshold=3) [........X................XXX........XXX.XX..XXXX...X....XX..] duration: 20.832701022s FAIL (2025-09-09 13:17:35 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 13:16:23.943018134 (71h47m59.982591255s) [upload=63193]: Starting upload Sep 9 13:16:23.943079762 (71h47m59.982652882s) [upload=63193]: Done starting upload Sep 9 13:16:23.943176287 (71h47m59.982749407s) [upload=63193]: Uploading segments... Sep 9 13:16:23.943263574 (71h47m59.982836694s) [upload=63193]: Got next segment. Inline: false Sep 9 13:16:23.943290756 (71h47m59.982863876s) [upload=63193]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 13:16:23.943295615 (71h47m59.982868735s) [upload=63193]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 13:16:24.225770642 (71h48m0.265343762s) [seg_pos={0 0}, upload=63193]: Begin upload segment... Sep 9 13:16:24.225844544 (71h48m0.265417674s) [seg_pos={0 0}, upload=63193]: Done begin upload segment. Sep 9 13:16:24.225868350 (71h48m0.26544147s) [noise=true , address=45.91.116.6:4973 , piece_id=IDISHV3MDRPNC5IV5KLJ3SQ67XTOHSJV35NBS5GX2XQMJOZ5KZYA, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.225906813 (71h48m0.265479933s) [noise=true , address=77.90.31.15:4697 , piece_id=WGAWM2RDO63BV4EAQN5W5O3LUHNVXMR7O4VNDTWRP7TYUVCPVVGA, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.226240451 (71h48m0.265813571s) [noise=true , address=145.79.227.2:4113 , piece_id=6GXPBZ6TJKPSBIQEEDH2GPPQZJZYB7ILPLGISNNDSQZRZAZ6UC4A, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.226386521 (71h48m0.265959641s) [noise=true , address=77.90.31.18:4807 , piece_id=MRZ22HZ56SAYYFVHL3DMHYIDXZKTBMJFR75J65RLL6YYDADDFSMQ, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.226595250 (71h48m0.26616837s) [noise=true , address=145.79.227.11:4731 , piece_id=7FAAXJ2EDT6NITKTLGSBJSNBHHOY7Z3LZTKGYFCQHLQD52KX6ZUQ, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.226670024 (71h48m0.266243144s) [noise=true , address=77.90.31.16:4733 , piece_id=FIZAL3WN77QFUCEEEUHZNLAQTCRAJSN4HDFV6W6A2EJXIK5UAZ6Q, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.226894793 (71h48m0.266467913s) [noise=true , address=45.91.116.11:4119 , piece_id=SGDUN7UO2XU2JRZYEUSQMB6M6YUDNRDHWUK2U67EAEJBOOOIAQNA, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.226989064 (71h48m0.266562184s) [noise=true , address=45.91.116.14:4190 , piece_id=TNEND6X3WIUEQM5FVIEMDOK5NHZL2VRPA7K7WUVLXYC4MPZDWRRA, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.227168517 (71h48m0.266741637s) [noise=true , address=45.91.116.4:4937 , piece_id=SK2TGJAOKIJOHOPF6MLYEOXQ7LQJF6HCWILLRDMP57IGZVWN6LOQ, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.227396865 (71h48m0.266969985s) [noise=true , address=77.90.31.19:4842 , piece_id=QPRL4AZ5YMAXQJ2IQOZ47RN6QDZ6MAGUSF3QMD4IJHA4UH4E6R7Q, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.227614812 (71h48m0.267187922s) [noise=true , address=45.91.116.11:4118 , piece_id=4NU3DT45HCEFESFPOGQ5DJE5WN3PWMGNJIQXXOUD7E62PVYXKSIA, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.227828560 (71h48m0.26740168s) [noise=true , address=77.90.31.21:4878 , piece_id=QXVY5XJXNFLKWTYIJOA3EFXNCOALIZZUOX2KXHOLZLAH3PLLMXLQ, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.228037530 (71h48m0.26761065s) [noise=true , address=145.79.227.17:4972 , piece_id=DJXTDERCD5TVK4WLFZRE55WSK5JERJ7VMSPO5GXMRDQ3IOPAXT3A, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.228247592 (71h48m0.267820713s) [noise=true , address=77.90.31.15:4699 , piece_id=6Q6BNEB3TL3YLJRIAQNAWPBOOSKSZUQ3LKV4ABLT7GSKYITCAJBQ, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.228461793 (71h48m0.268034913s) [noise=true , address=145.79.227.14:4837 , piece_id=VTB34SA3KGWKVWYZHIEYBGRIKUBNK2A3AXE4O2HQJA7QANYFY2OA, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.228674138 (71h48m0.268247258s) [noise=true , address=77.90.31.13:4628 , piece_id=OQJPOZMQOQ4TBNUWDKAYNUCM7MN56T5S2HSM2PBXAYGIVYJ67PAQ, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:26.029234678 (71h48m2.068807798s) [upload=63193]: Next returned nil segment Sep 9 13:16:26.029258935 (71h48m2.068832055s) [upload=63193]: Waiting for error group managing segments... Sep 9 13:16:26.339978495 (71h48m2.379551615s) [noise=true , address=145.79.227.14:4837 , piece_id=VTB34SA3KGWKVWYZHIEYBGRIKUBNK2A3AXE4O2HQJA7QANYFY2OA, seg_pos={0 0}, upload=63193]: Done uploading piece. err: <nil> Sep 9 13:16:26.410998868 (71h48m2.450571988s) [noise=true , address=145.79.227.11:4731 , piece_id=7FAAXJ2EDT6NITKTLGSBJSNBHHOY7Z3LZTKGYFCQHLQD52KX6ZUQ, seg_pos={0 0}, upload=63193]: Done uploading piece. err: <nil> Sep 9 13:16:26.457973460 (71h48m2.49754658s) [noise=true , address=45.91.116.11:4118 , piece_id=4NU3DT45HCEFESFPOGQ5DJE5WN3PWMGNJIQXXOUD7E62PVYXKSIA, seg_pos={0 0}, upload=63193]: Done uploading piece. err: <nil> Sep 9 13:16:26.468823492 (71h48m2.508396612s) [noise=true , address=145.79.227.17:4972 , piece_id=DJXTDERCD5TVK4WLFZRE55WSK5JERJ7VMSPO5GXMRDQ3IOPAXT3A, seg_pos={0 0}, upload=63193]: Done uploading piece. err: <nil> Sep 9 13:16:26.469760264 (71h48m2.509333384s) [noise=true , address=45.91.116.6:4973 , piece_id=IDISHV3MDRPNC5IV5KLJ3SQ67XTOHSJV35NBS5GX2XQMJOZ5KZYA, seg_pos={0 0}, upload=63193]: Done uploading piece. err: <nil> Sep 9 13:16:26.470091628 (71h48m2.509664748s) [noise=true , address=45.91.116.11:4119 , piece_id=SGDUN7UO2XU2JRZYEUSQMB6M6YUDNRDHWUK2U67EAEJBOOOIAQNA, seg_pos={0 0}, upload=63193]: Done uploading piece. err: <nil> Sep 9 13:16:26.476077742 (71h48m2.515650862s) [noise=true , address=45.91.116.14:4190 , piece_id=TNEND6X3WIUEQM5FVIEMDOK5NHZL2VRPA7K7WUVLXYC4MPZDWRRA, seg_pos={0 0}, upload=63193]: Done uploading piece. err: <nil> Sep 9 13:16:26.485692329 (71h48m2.525265449s) [noise=true , address=77.90.31.13:4628 , piece_id=OQJPOZMQOQ4TBNUWDKAYNUCM7MN56T5S2HSM2PBXAYGIVYJ67PAQ, seg_pos={0 0}, upload=63193]: Done uploading piece. err: <nil> Sep 9 13:16:26.517575155 (71h48m2.557148275s) [noise=true , address=77.90.31.16:4733 , piece_id=FIZAL3WN77QFUCEEEUHZNLAQTCRAJSN4HDFV6W6A2EJXIK5UAZ6Q, seg_pos={0 0}, upload=63193]: Done uploading piece. err: <nil> Sep 9 13:16:26.610967685 (71h48m2.650540805s) [noise=true , address=45.91.116.4:4937 , piece_id=SK2TGJAOKIJOHOPF6MLYEOXQ7LQJF6HCWILLRDMP57IGZVWN6LOQ, seg_pos={0 0}, upload=63193]: Done uploading piece. err: <nil> Sep 9 13:16:26.620501818 (71h48m2.660074948s) [noise=true , address=77.90.31.15:4699 , piece_id=6Q6BNEB3TL3YLJRIAQNAWPBOOSKSZUQ3LKV4ABLT7GSKYITCAJBQ, seg_pos={0 0}, upload=63193]: Done uploading piece. err: <nil> Sep 9 13:16:26.673682425 (71h48m2.713255545s) [noise=true , address=77.90.31.15:4697 , piece_id=WGAWM2RDO63BV4EAQN5W5O3LUHNVXMR7O4VNDTWRP7TYUVCPVVGA, seg_pos={0 0}, upload=63193]: Done uploading piece. err: <nil> Sep 9 13:16:26.727566619 (71h48m2.767139759s) [noise=true , address=145.79.227.2:4113 , piece_id=6GXPBZ6TJKPSBIQEEDH2GPPQZJZYB7ILPLGISNNDSQZRZAZ6UC4A, seg_pos={0 0}, upload=63193]: Done uploading piece. err: <nil> Sep 9 13:16:26.727616905 (71h48m2.767190035s) [seg_pos={0 0}, upload=63193]: Segment reached optimal threshold of 13 pieces. Sep 9 13:16:26.727940765 (71h48m2.767513895s) [noise=true , address=77.90.31.21:4878 , piece_id=QXVY5XJXNFLKWTYIJOA3EFXNCOALIZZUOX2KXHOLZLAH3PLLMXLQ, seg_pos={0 0}, upload=63193]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK): protocol: expected piece hash; context canceled; EOF Sep 9 13:16:26.728155216 (71h48m2.767728346s) [noise=true , address=77.90.31.18:4807 , piece_id=MRZ22HZ56SAYYFVHL3DMHYIDXZKTBMJFR75J65RLL6YYDADDFSMQ, seg_pos={0 0}, upload=63193]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS): protocol: write tcp 188.166.225.170:43444->77.90.31.18:4807: use of closed network connection; write tcp 188.166.225.170:43444->77.90.31.18:4807: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43444->77.90.31.18:4807: use of closed network connection Sep 9 13:16:26.728247522 (71h48m2.767820662s) [noise=true , address=77.90.31.19:4842 , piece_id=QPRL4AZ5YMAXQJ2IQOZ47RN6QDZ6MAGUSF3QMD4IJHA4UH4E6R7Q, seg_pos={0 0}, upload=63193]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: write tcp 188.166.225.170:54154->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:54154->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54154->77.90.31.19:4842: use of closed network connection Sep 9 13:16:26.728265457 (71h48m2.767838597s) [seg_pos={0 0}, upload=63193]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 13:16:26.728356090 (71h48m2.76792923s) [upload=63193]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 13:16:26.728363324 (71h48m2.767936454s) [upload=63193]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 13:16:27.188310692 (71h48m3.227883852s) [upload=63193]: Done uploading segments... Sep 9 13:16:27.188332644 (71h48m3.227905764s) [upload=63193]: Upload finished. err: <nil> Duration: 20.832721161s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 16 out of 60 is failed (threshold=3) [.........X................XXX........XXX.XX..XXXX...X....XX.] duration: 10.754523759s FAIL (2025-09-09 13:17:07 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 13:16:23.943018134 (71h47m59.982591255s) [upload=63193]: Starting upload Sep 9 13:16:23.943079762 (71h47m59.982652882s) [upload=63193]: Done starting upload Sep 9 13:16:23.943176287 (71h47m59.982749407s) [upload=63193]: Uploading segments... Sep 9 13:16:23.943263574 (71h47m59.982836694s) [upload=63193]: Got next segment. Inline: false Sep 9 13:16:23.943290756 (71h47m59.982863876s) [upload=63193]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 13:16:23.943295615 (71h47m59.982868735s) [upload=63193]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 13:16:24.225770642 (71h48m0.265343762s) [seg_pos={0 0}, upload=63193]: Begin upload segment... Sep 9 13:16:24.225844544 (71h48m0.265417674s) [seg_pos={0 0}, upload=63193]: Done begin upload segment. Sep 9 13:16:24.225868350 (71h48m0.26544147s) [noise=true , address=45.91.116.6:4973 , piece_id=IDISHV3MDRPNC5IV5KLJ3SQ67XTOHSJV35NBS5GX2XQMJOZ5KZYA, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.225906813 (71h48m0.265479933s) [noise=true , address=77.90.31.15:4697 , piece_id=WGAWM2RDO63BV4EAQN5W5O3LUHNVXMR7O4VNDTWRP7TYUVCPVVGA, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.226240451 (71h48m0.265813571s) [noise=true , address=145.79.227.2:4113 , piece_id=6GXPBZ6TJKPSBIQEEDH2GPPQZJZYB7ILPLGISNNDSQZRZAZ6UC4A, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.226386521 (71h48m0.265959641s) [noise=true , address=77.90.31.18:4807 , piece_id=MRZ22HZ56SAYYFVHL3DMHYIDXZKTBMJFR75J65RLL6YYDADDFSMQ, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.226595250 (71h48m0.26616837s) [noise=true , address=145.79.227.11:4731 , piece_id=7FAAXJ2EDT6NITKTLGSBJSNBHHOY7Z3LZTKGYFCQHLQD52KX6ZUQ, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.226670024 (71h48m0.266243144s) [noise=true , address=77.90.31.16:4733 , piece_id=FIZAL3WN77QFUCEEEUHZNLAQTCRAJSN4HDFV6W6A2EJXIK5UAZ6Q, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.226894793 (71h48m0.266467913s) [noise=true , address=45.91.116.11:4119 , piece_id=SGDUN7UO2XU2JRZYEUSQMB6M6YUDNRDHWUK2U67EAEJBOOOIAQNA, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.226989064 (71h48m0.266562184s) [noise=true , address=45.91.116.14:4190 , piece_id=TNEND6X3WIUEQM5FVIEMDOK5NHZL2VRPA7K7WUVLXYC4MPZDWRRA, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.227168517 (71h48m0.266741637s) [noise=true , address=45.91.116.4:4937 , piece_id=SK2TGJAOKIJOHOPF6MLYEOXQ7LQJF6HCWILLRDMP57IGZVWN6LOQ, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.227396865 (71h48m0.266969985s) [noise=true , address=77.90.31.19:4842 , piece_id=QPRL4AZ5YMAXQJ2IQOZ47RN6QDZ6MAGUSF3QMD4IJHA4UH4E6R7Q, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.227614812 (71h48m0.267187922s) [noise=true , address=45.91.116.11:4118 , piece_id=4NU3DT45HCEFESFPOGQ5DJE5WN3PWMGNJIQXXOUD7E62PVYXKSIA, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.227828560 (71h48m0.26740168s) [noise=true , address=77.90.31.21:4878 , piece_id=QXVY5XJXNFLKWTYIJOA3EFXNCOALIZZUOX2KXHOLZLAH3PLLMXLQ, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.228037530 (71h48m0.26761065s) [noise=true , address=145.79.227.17:4972 , piece_id=DJXTDERCD5TVK4WLFZRE55WSK5JERJ7VMSPO5GXMRDQ3IOPAXT3A, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.228247592 (71h48m0.267820713s) [noise=true , address=77.90.31.15:4699 , piece_id=6Q6BNEB3TL3YLJRIAQNAWPBOOSKSZUQ3LKV4ABLT7GSKYITCAJBQ, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.228461793 (71h48m0.268034913s) [noise=true , address=145.79.227.14:4837 , piece_id=VTB34SA3KGWKVWYZHIEYBGRIKUBNK2A3AXE4O2HQJA7QANYFY2OA, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.228674138 (71h48m0.268247258s) [noise=true , address=77.90.31.13:4628 , piece_id=OQJPOZMQOQ4TBNUWDKAYNUCM7MN56T5S2HSM2PBXAYGIVYJ67PAQ, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:26.029234678 (71h48m2.068807798s) [upload=63193]: Next returned nil segment Sep 9 13:16:26.029258935 (71h48m2.068832055s) [upload=63193]: Waiting for error group managing segments... Sep 9 13:16:26.339978495 (71h48m2.379551615s) [noise=true , address=145.79.227.14:4837 , piece_id=VTB34SA3KGWKVWYZHIEYBGRIKUBNK2A3AXE4O2HQJA7QANYFY2OA, seg_pos={0 0}, upload=63193]: Done uploading piece. err: <nil> Sep 9 13:16:26.410998868 (71h48m2.450571988s) [noise=true , address=145.79.227.11:4731 , piece_id=7FAAXJ2EDT6NITKTLGSBJSNBHHOY7Z3LZTKGYFCQHLQD52KX6ZUQ, seg_pos={0 0}, upload=63193]: Done uploading piece. err: <nil> Sep 9 13:16:26.457973460 (71h48m2.49754658s) [noise=true , address=45.91.116.11:4118 , piece_id=4NU3DT45HCEFESFPOGQ5DJE5WN3PWMGNJIQXXOUD7E62PVYXKSIA, seg_pos={0 0}, upload=63193]: Done uploading piece. err: <nil> Sep 9 13:16:26.468823492 (71h48m2.508396612s) [noise=true , address=145.79.227.17:4972 , piece_id=DJXTDERCD5TVK4WLFZRE55WSK5JERJ7VMSPO5GXMRDQ3IOPAXT3A, seg_pos={0 0}, upload=63193]: Done uploading piece. err: <nil> Sep 9 13:16:26.469760264 (71h48m2.509333384s) [noise=true , address=45.91.116.6:4973 , piece_id=IDISHV3MDRPNC5IV5KLJ3SQ67XTOHSJV35NBS5GX2XQMJOZ5KZYA, seg_pos={0 0}, upload=63193]: Done uploading piece. err: <nil> Sep 9 13:16:26.470091628 (71h48m2.509664748s) [noise=true , address=45.91.116.11:4119 , piece_id=SGDUN7UO2XU2JRZYEUSQMB6M6YUDNRDHWUK2U67EAEJBOOOIAQNA, seg_pos={0 0}, upload=63193]: Done uploading piece. err: <nil> Sep 9 13:16:26.476077742 (71h48m2.515650862s) [noise=true , address=45.91.116.14:4190 , piece_id=TNEND6X3WIUEQM5FVIEMDOK5NHZL2VRPA7K7WUVLXYC4MPZDWRRA, seg_pos={0 0}, upload=63193]: Done uploading piece. err: <nil> Sep 9 13:16:26.485692329 (71h48m2.525265449s) [noise=true , address=77.90.31.13:4628 , piece_id=OQJPOZMQOQ4TBNUWDKAYNUCM7MN56T5S2HSM2PBXAYGIVYJ67PAQ, seg_pos={0 0}, upload=63193]: Done uploading piece. err: <nil> Sep 9 13:16:26.517575155 (71h48m2.557148275s) [noise=true , address=77.90.31.16:4733 , piece_id=FIZAL3WN77QFUCEEEUHZNLAQTCRAJSN4HDFV6W6A2EJXIK5UAZ6Q, seg_pos={0 0}, upload=63193]: Done uploading piece. err: <nil> Sep 9 13:16:26.610967685 (71h48m2.650540805s) [noise=true , address=45.91.116.4:4937 , piece_id=SK2TGJAOKIJOHOPF6MLYEOXQ7LQJF6HCWILLRDMP57IGZVWN6LOQ, seg_pos={0 0}, upload=63193]: Done uploading piece. err: <nil> Sep 9 13:16:26.620501818 (71h48m2.660074948s) [noise=true , address=77.90.31.15:4699 , piece_id=6Q6BNEB3TL3YLJRIAQNAWPBOOSKSZUQ3LKV4ABLT7GSKYITCAJBQ, seg_pos={0 0}, upload=63193]: Done uploading piece. err: <nil> Sep 9 13:16:26.673682425 (71h48m2.713255545s) [noise=true , address=77.90.31.15:4697 , piece_id=WGAWM2RDO63BV4EAQN5W5O3LUHNVXMR7O4VNDTWRP7TYUVCPVVGA, seg_pos={0 0}, upload=63193]: Done uploading piece. err: <nil> Sep 9 13:16:26.727566619 (71h48m2.767139759s) [noise=true , address=145.79.227.2:4113 , piece_id=6GXPBZ6TJKPSBIQEEDH2GPPQZJZYB7ILPLGISNNDSQZRZAZ6UC4A, seg_pos={0 0}, upload=63193]: Done uploading piece. err: <nil> Sep 9 13:16:26.727616905 (71h48m2.767190035s) [seg_pos={0 0}, upload=63193]: Segment reached optimal threshold of 13 pieces. Sep 9 13:16:26.727940765 (71h48m2.767513895s) [noise=true , address=77.90.31.21:4878 , piece_id=QXVY5XJXNFLKWTYIJOA3EFXNCOALIZZUOX2KXHOLZLAH3PLLMXLQ, seg_pos={0 0}, upload=63193]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK): protocol: expected piece hash; context canceled; EOF Sep 9 13:16:26.728155216 (71h48m2.767728346s) [noise=true , address=77.90.31.18:4807 , piece_id=MRZ22HZ56SAYYFVHL3DMHYIDXZKTBMJFR75J65RLL6YYDADDFSMQ, seg_pos={0 0}, upload=63193]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS): protocol: write tcp 188.166.225.170:43444->77.90.31.18:4807: use of closed network connection; write tcp 188.166.225.170:43444->77.90.31.18:4807: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43444->77.90.31.18:4807: use of closed network connection Sep 9 13:16:26.728247522 (71h48m2.767820662s) [noise=true , address=77.90.31.19:4842 , piece_id=QPRL4AZ5YMAXQJ2IQOZ47RN6QDZ6MAGUSF3QMD4IJHA4UH4E6R7Q, seg_pos={0 0}, upload=63193]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: write tcp 188.166.225.170:54154->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:54154->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54154->77.90.31.19:4842: use of closed network connection Sep 9 13:16:26.728265457 (71h48m2.767838597s) [seg_pos={0 0}, upload=63193]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 13:16:26.728356090 (71h48m2.76792923s) [upload=63193]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 13:16:26.728363324 (71h48m2.767936454s) [upload=63193]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 13:16:27.188310692 (71h48m3.227883852s) [upload=63193]: Done uploading segments... Sep 9 13:16:27.188332644 (71h48m3.227905764s) [upload=63193]: Upload finished. err: <nil> Duration: 10.754566111s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 16 out of 60 is failed (threshold=3) [..........X................XXX........XXX.XX..XXXX...X....XX] duration: 30.002460368s FAIL (2025-09-09 13:16:53 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 13:16:23.943018134 (71h47m59.982591255s) [upload=63193]: Starting upload Sep 9 13:16:23.943079762 (71h47m59.982652882s) [upload=63193]: Done starting upload Sep 9 13:16:23.943176287 (71h47m59.982749407s) [upload=63193]: Uploading segments... Sep 9 13:16:23.943263574 (71h47m59.982836694s) [upload=63193]: Got next segment. Inline: false Sep 9 13:16:23.943290756 (71h47m59.982863876s) [upload=63193]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 13:16:23.943295615 (71h47m59.982868735s) [upload=63193]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 13:16:24.225770642 (71h48m0.265343762s) [seg_pos={0 0}, upload=63193]: Begin upload segment... Sep 9 13:16:24.225844544 (71h48m0.265417674s) [seg_pos={0 0}, upload=63193]: Done begin upload segment. Sep 9 13:16:24.225868350 (71h48m0.26544147s) [noise=true , address=45.91.116.6:4973 , piece_id=IDISHV3MDRPNC5IV5KLJ3SQ67XTOHSJV35NBS5GX2XQMJOZ5KZYA, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.225906813 (71h48m0.265479933s) [noise=true , address=77.90.31.15:4697 , piece_id=WGAWM2RDO63BV4EAQN5W5O3LUHNVXMR7O4VNDTWRP7TYUVCPVVGA, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.226240451 (71h48m0.265813571s) [noise=true , address=145.79.227.2:4113 , piece_id=6GXPBZ6TJKPSBIQEEDH2GPPQZJZYB7ILPLGISNNDSQZRZAZ6UC4A, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.226386521 (71h48m0.265959641s) [noise=true , address=77.90.31.18:4807 , piece_id=MRZ22HZ56SAYYFVHL3DMHYIDXZKTBMJFR75J65RLL6YYDADDFSMQ, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.226595250 (71h48m0.26616837s) [noise=true , address=145.79.227.11:4731 , piece_id=7FAAXJ2EDT6NITKTLGSBJSNBHHOY7Z3LZTKGYFCQHLQD52KX6ZUQ, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.226670024 (71h48m0.266243144s) [noise=true , address=77.90.31.16:4733 , piece_id=FIZAL3WN77QFUCEEEUHZNLAQTCRAJSN4HDFV6W6A2EJXIK5UAZ6Q, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.226894793 (71h48m0.266467913s) [noise=true , address=45.91.116.11:4119 , piece_id=SGDUN7UO2XU2JRZYEUSQMB6M6YUDNRDHWUK2U67EAEJBOOOIAQNA, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.226989064 (71h48m0.266562184s) [noise=true , address=45.91.116.14:4190 , piece_id=TNEND6X3WIUEQM5FVIEMDOK5NHZL2VRPA7K7WUVLXYC4MPZDWRRA, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.227168517 (71h48m0.266741637s) [noise=true , address=45.91.116.4:4937 , piece_id=SK2TGJAOKIJOHOPF6MLYEOXQ7LQJF6HCWILLRDMP57IGZVWN6LOQ, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.227396865 (71h48m0.266969985s) [noise=true , address=77.90.31.19:4842 , piece_id=QPRL4AZ5YMAXQJ2IQOZ47RN6QDZ6MAGUSF3QMD4IJHA4UH4E6R7Q, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.227614812 (71h48m0.267187922s) [noise=true , address=45.91.116.11:4118 , piece_id=4NU3DT45HCEFESFPOGQ5DJE5WN3PWMGNJIQXXOUD7E62PVYXKSIA, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.227828560 (71h48m0.26740168s) [noise=true , address=77.90.31.21:4878 , piece_id=QXVY5XJXNFLKWTYIJOA3EFXNCOALIZZUOX2KXHOLZLAH3PLLMXLQ, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.228037530 (71h48m0.26761065s) [noise=true , address=145.79.227.17:4972 , piece_id=DJXTDERCD5TVK4WLFZRE55WSK5JERJ7VMSPO5GXMRDQ3IOPAXT3A, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.228247592 (71h48m0.267820713s) [noise=true , address=77.90.31.15:4699 , piece_id=6Q6BNEB3TL3YLJRIAQNAWPBOOSKSZUQ3LKV4ABLT7GSKYITCAJBQ, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.228461793 (71h48m0.268034913s) [noise=true , address=145.79.227.14:4837 , piece_id=VTB34SA3KGWKVWYZHIEYBGRIKUBNK2A3AXE4O2HQJA7QANYFY2OA, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:24.228674138 (71h48m0.268247258s) [noise=true , address=77.90.31.13:4628 , piece_id=OQJPOZMQOQ4TBNUWDKAYNUCM7MN56T5S2HSM2PBXAYGIVYJ67PAQ, seg_pos={0 0}, upload=63193]: Uploading piece... Sep 9 13:16:26.029234678 (71h48m2.068807798s) [upload=63193]: Next returned nil segment Sep 9 13:16:26.029258935 (71h48m2.068832055s) [upload=63193]: Waiting for error group managing segments... Sep 9 13:16:26.339978495 (71h48m2.379551615s) [noise=true , address=145.79.227.14:4837 , piece_id=VTB34SA3KGWKVWYZHIEYBGRIKUBNK2A3AXE4O2HQJA7QANYFY2OA, seg_pos={0 0}, upload=63193]: Done uploading piece. err: <nil> Sep 9 13:16:26.410998868 (71h48m2.450571988s) [noise=true , address=145.79.227.11:4731 , piece_id=7FAAXJ2EDT6NITKTLGSBJSNBHHOY7Z3LZTKGYFCQHLQD52KX6ZUQ, seg_pos={0 0}, upload=63193]: Done uploading piece. err: <nil> Sep 9 13:16:26.457973460 (71h48m2.49754658s) [noise=true , address=45.91.116.11:4118 , piece_id=4NU3DT45HCEFESFPOGQ5DJE5WN3PWMGNJIQXXOUD7E62PVYXKSIA, seg_pos={0 0}, upload=63193]: Done uploading piece. err: <nil> Sep 9 13:16:26.468823492 (71h48m2.508396612s) [noise=true , address=145.79.227.17:4972 , piece_id=DJXTDERCD5TVK4WLFZRE55WSK5JERJ7VMSPO5GXMRDQ3IOPAXT3A, seg_pos={0 0}, upload=63193]: Done uploading piece. err: <nil> Sep 9 13:16:26.469760264 (71h48m2.509333384s) [noise=true , address=45.91.116.6:4973 , piece_id=IDISHV3MDRPNC5IV5KLJ3SQ67XTOHSJV35NBS5GX2XQMJOZ5KZYA, seg_pos={0 0}, upload=63193]: Done uploading piece. err: <nil> Sep 9 13:16:26.470091628 (71h48m2.509664748s) [noise=true , address=45.91.116.11:4119 , piece_id=SGDUN7UO2XU2JRZYEUSQMB6M6YUDNRDHWUK2U67EAEJBOOOIAQNA, seg_pos={0 0}, upload=63193]: Done uploading piece. err: <nil> Sep 9 13:16:26.476077742 (71h48m2.515650862s) [noise=true , address=45.91.116.14:4190 , piece_id=TNEND6X3WIUEQM5FVIEMDOK5NHZL2VRPA7K7WUVLXYC4MPZDWRRA, seg_pos={0 0}, upload=63193]: Done uploading piece. err: <nil> Sep 9 13:16:26.485692329 (71h48m2.525265449s) [noise=true , address=77.90.31.13:4628 , piece_id=OQJPOZMQOQ4TBNUWDKAYNUCM7MN56T5S2HSM2PBXAYGIVYJ67PAQ, seg_pos={0 0}, upload=63193]: Done uploading piece. err: <nil> Sep 9 13:16:26.517575155 (71h48m2.557148275s) [noise=true , address=77.90.31.16:4733 , piece_id=FIZAL3WN77QFUCEEEUHZNLAQTCRAJSN4HDFV6W6A2EJXIK5UAZ6Q, seg_pos={0 0}, upload=63193]: Done uploading piece. err: <nil> Sep 9 13:16:26.610967685 (71h48m2.650540805s) [noise=true , address=45.91.116.4:4937 , piece_id=SK2TGJAOKIJOHOPF6MLYEOXQ7LQJF6HCWILLRDMP57IGZVWN6LOQ, seg_pos={0 0}, upload=63193]: Done uploading piece. err: <nil> Sep 9 13:16:26.620501818 (71h48m2.660074948s) [noise=true , address=77.90.31.15:4699 , piece_id=6Q6BNEB3TL3YLJRIAQNAWPBOOSKSZUQ3LKV4ABLT7GSKYITCAJBQ, seg_pos={0 0}, upload=63193]: Done uploading piece. err: <nil> Sep 9 13:16:26.673682425 (71h48m2.713255545s) [noise=true , address=77.90.31.15:4697 , piece_id=WGAWM2RDO63BV4EAQN5W5O3LUHNVXMR7O4VNDTWRP7TYUVCPVVGA, seg_pos={0 0}, upload=63193]: Done uploading piece. err: <nil> Sep 9 13:16:26.727566619 (71h48m2.767139759s) [noise=true , address=145.79.227.2:4113 , piece_id=6GXPBZ6TJKPSBIQEEDH2GPPQZJZYB7ILPLGISNNDSQZRZAZ6UC4A, seg_pos={0 0}, upload=63193]: Done uploading piece. err: <nil> Sep 9 13:16:26.727616905 (71h48m2.767190035s) [seg_pos={0 0}, upload=63193]: Segment reached optimal threshold of 13 pieces. Sep 9 13:16:26.727940765 (71h48m2.767513895s) [noise=true , address=77.90.31.21:4878 , piece_id=QXVY5XJXNFLKWTYIJOA3EFXNCOALIZZUOX2KXHOLZLAH3PLLMXLQ, seg_pos={0 0}, upload=63193]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK): protocol: expected piece hash; context canceled; EOF Sep 9 13:16:26.728155216 (71h48m2.767728346s) [noise=true , address=77.90.31.18:4807 , piece_id=MRZ22HZ56SAYYFVHL3DMHYIDXZKTBMJFR75J65RLL6YYDADDFSMQ, seg_pos={0 0}, upload=63193]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS): protocol: write tcp 188.166.225.170:43444->77.90.31.18:4807: use of closed network connection; write tcp 188.166.225.170:43444->77.90.31.18:4807: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43444->77.90.31.18:4807: use of closed network connection Sep 9 13:16:26.728247522 (71h48m2.767820662s) [noise=true , address=77.90.31.19:4842 , piece_id=QPRL4AZ5YMAXQJ2IQOZ47RN6QDZ6MAGUSF3QMD4IJHA4UH4E6R7Q, seg_pos={0 0}, upload=63193]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: write tcp 188.166.225.170:54154->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:54154->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54154->77.90.31.19:4842: use of closed network connection Sep 9 13:16:26.728265457 (71h48m2.767838597s) [seg_pos={0 0}, upload=63193]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 13:16:26.728356090 (71h48m2.76792923s) [upload=63193]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 13:16:26.728363324 (71h48m2.767936454s) [upload=63193]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 13:16:27.188310692 (71h48m3.227883852s) [upload=63193]: Done uploading segments... Sep 9 13:16:27.188332644 (71h48m3.227905764s) [upload=63193]: Upload finished. err: <nil> Duration: 30.002490456s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 15 out of 60 is failed (threshold=3) [...........X................XXX........XXX.XX..XXXX...X....X] duration: 30.001827s FAIL (2025-09-09 13:15:42 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 13:15:13.429733361 (71h46m49.469306511s) [upload=63178]: Starting upload Sep 9 13:15:13.429874792 (71h46m49.469447922s) [upload=63178]: Done starting upload Sep 9 13:15:13.429949014 (71h46m49.469522134s) [upload=63178]: Uploading segments... Sep 9 13:15:13.430106364 (71h46m49.469679484s) [upload=63178]: Got next segment. Inline: false Sep 9 13:15:13.430142514 (71h46m49.469715634s) [upload=63178]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 13:15:13.430147874 (71h46m49.469720994s) [upload=63178]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 13:15:13.937117900 (71h46m49.97669102s) [seg_pos={0 0}, upload=63178]: Begin upload segment... Sep 9 13:15:13.937177654 (71h46m49.976750814s) [seg_pos={0 0}, upload=63178]: Done begin upload segment. Sep 9 13:15:13.937216178 (71h46m49.976789328s) [noise=true , address=45.91.116.6:4973 , piece_id=D24P7CDU2UUFKMQXFX7VC3HMGM4P6X5GSNQBUIZKTDAM2KUMWHBA, seg_pos={0 0}, upload=63178]: Uploading piece... Sep 9 13:15:13.937228041 (71h46m49.976801171s) [noise=true , address=145.79.227.11:4731 , piece_id=SZGM6ZXMLQMDMONHUZN3ZZX5S5B22CZ63PSIQ3F3EAUB7XNZC45A, seg_pos={0 0}, upload=63178]: Uploading piece... Sep 9 13:15:13.937618779 (71h46m49.977191899s) [noise=true , address=145.79.227.17:4971 , piece_id=HD6KFRYXMOD72LHKII6TGZ4MK4OQ2BRJDUXMB6QJP4CSHSFKCDEA, seg_pos={0 0}, upload=63178]: Uploading piece... Sep 9 13:15:13.937641582 (71h46m49.977214702s) [noise=true , address=77.90.31.18:4807 , piece_id=XWEVSNSJ6FNLYT2DOUWJL5RAMEMEUWHCBAEYVYCFCSXMOXE2U5XA, seg_pos={0 0}, upload=63178]: Uploading piece... Sep 9 13:15:13.937880429 (71h46m49.977453549s) [noise=true , address=45.91.116.4:4940 , piece_id=HATZ5MDFPWVMSJAJM3STVWCMJXQQSE4LBHFVVMNBS3G77NUVJOLQ, seg_pos={0 0}, upload=63178]: Uploading piece... Sep 9 13:15:13.937914424 (71h46m49.977487544s) [noise=true , address=45.91.116.8:4048 , piece_id=MVLFAH2ORU3LPSU24BU4DRYQ6ZZPKOHSSCXCAPUPLVE6PTSA6CPA, seg_pos={0 0}, upload=63178]: Uploading piece... Sep 9 13:15:13.938221202 (71h46m49.977794322s) [noise=true , address=77.90.31.21:4879 , piece_id=XZSOWQDQT6KPUZU5FZUSQFWBY5WUB3LJW5NUV2DMFJ2DWDS5SSAA, seg_pos={0 0}, upload=63178]: Uploading piece... Sep 9 13:15:13.938576491 (71h46m49.978149612s) [noise=true , address=45.91.116.8:4047 , piece_id=CHJZOPRHZFEFB6ZTVWPLVMETXPV7QDDJ6PCZXO7CIBMOE7MGREBQ, seg_pos={0 0}, upload=63178]: Uploading piece... Sep 9 13:15:13.938845556 (71h46m49.978418677s) [noise=true , address=45.91.116.7:4010 , piece_id=YYVCIO4GAHARBXB46BY6VMN5D7YFCEMAKLMOZC7SQYQ7PULMJOXA, seg_pos={0 0}, upload=63178]: Uploading piece... Sep 9 13:15:13.939066008 (71h46m49.978639128s) [noise=true , address=77.90.31.14:4661 , piece_id=I5LW5G7XJP3LAAOV3EJY2PQBBVE7NBATDNGS4RVMUN26GNUUOWNA, seg_pos={0 0}, upload=63178]: Uploading piece... Sep 9 13:15:13.939307991 (71h46m49.978881112s) [noise=true , address=45.91.116.11:4118 , piece_id=MLC2V5ZOC6YJNUHWWLIIA6UX6GPGDVAHISDCGA33FZ22PGD5ODHA, seg_pos={0 0}, upload=63178]: Uploading piece... Sep 9 13:15:13.939515538 (71h46m49.979088658s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQ3RFMOI6TIB2M7H35VML77NWSQ4YZKGVCO2CCQNURUFWV3FOZA, seg_pos={0 0}, upload=63178]: Uploading piece... Sep 9 13:15:13.939721773 (71h46m49.979294903s) [noise=true , address=77.90.31.21:4877 , piece_id=T55TXKX6QUZ55JN4VWDBEQIEGJ5XY2GKST22KFGH4TUBB2GGH3KA, seg_pos={0 0}, upload=63178]: Uploading piece... Sep 9 13:15:13.939918349 (71h46m49.979491469s) [noise=true , address=77.90.31.16:4733 , piece_id=A6DPBUKWHGBIFQBKTGQTOJ5USMTB5WUBSMOF2YXDWDYCCTX5WBDA, seg_pos={0 0}, upload=63178]: Uploading piece... Sep 9 13:15:13.940656632 (71h46m49.980229752s) [noise=true , address=45.91.116.10:4082 , piece_id=WAZKBJ4W7VQTIYE52KDGSUSQZISQVQHM6OFI7RYXJTKPAG2PYYTA, seg_pos={0 0}, upload=63178]: Uploading piece... Sep 9 13:15:13.941578827 (71h46m49.981151947s) [noise=true , address=145.79.227.13:4801 , piece_id=NS6NFNFWN4HMK7VB3BZWXYEK4RM7NBMSOUUH7NZSWITOIPEERGRA, seg_pos={0 0}, upload=63178]: Uploading piece... Sep 9 13:15:15.743237352 (71h46m51.782810472s) [upload=63178]: Next returned nil segment Sep 9 13:15:15.743256368 (71h46m51.782829488s) [upload=63178]: Waiting for error group managing segments... Sep 9 13:15:16.041837488 (71h46m52.081410608s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQ3RFMOI6TIB2M7H35VML77NWSQ4YZKGVCO2CCQNURUFWV3FOZA, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil> Sep 9 13:15:16.113681189 (71h46m52.153254309s) [noise=true , address=45.91.116.7:4010 , piece_id=YYVCIO4GAHARBXB46BY6VMN5D7YFCEMAKLMOZC7SQYQ7PULMJOXA, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil> Sep 9 13:15:16.162721659 (71h46m52.202294779s) [noise=true , address=77.90.31.14:4661 , piece_id=I5LW5G7XJP3LAAOV3EJY2PQBBVE7NBATDNGS4RVMUN26GNUUOWNA, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil> Sep 9 13:15:16.177502771 (71h46m52.217075891s) [noise=true , address=45.91.116.10:4082 , piece_id=WAZKBJ4W7VQTIYE52KDGSUSQZISQVQHM6OFI7RYXJTKPAG2PYYTA, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil> Sep 9 13:15:16.178090877 (71h46m52.217663997s) [noise=true , address=45.91.116.11:4118 , piece_id=MLC2V5ZOC6YJNUHWWLIIA6UX6GPGDVAHISDCGA33FZ22PGD5ODHA, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil> Sep 9 13:15:16.186927174 (71h46m52.226500294s) [noise=true , address=45.91.116.4:4940 , piece_id=HATZ5MDFPWVMSJAJM3STVWCMJXQQSE4LBHFVVMNBS3G77NUVJOLQ, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil> Sep 9 13:15:16.195070425 (71h46m52.234643545s) [noise=true , address=77.90.31.21:4877 , piece_id=T55TXKX6QUZ55JN4VWDBEQIEGJ5XY2GKST22KFGH4TUBB2GGH3KA, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil> Sep 9 13:15:16.225674093 (71h46m52.265247213s) [noise=true , address=145.79.227.13:4801 , piece_id=NS6NFNFWN4HMK7VB3BZWXYEK4RM7NBMSOUUH7NZSWITOIPEERGRA, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil> Sep 9 13:15:16.239264879 (71h46m52.278837999s) [noise=true , address=77.90.31.16:4733 , piece_id=A6DPBUKWHGBIFQBKTGQTOJ5USMTB5WUBSMOF2YXDWDYCCTX5WBDA, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil> Sep 9 13:15:16.239357576 (71h46m52.278930706s) [noise=true , address=45.91.116.8:4048 , piece_id=MVLFAH2ORU3LPSU24BU4DRYQ6ZZPKOHSSCXCAPUPLVE6PTSA6CPA, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil> Sep 9 13:15:16.255489744 (71h46m52.295062874s) [noise=true , address=77.90.31.18:4807 , piece_id=XWEVSNSJ6FNLYT2DOUWJL5RAMEMEUWHCBAEYVYCFCSXMOXE2U5XA, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil> Sep 9 13:15:16.260058186 (71h46m52.299631306s) [noise=true , address=45.91.116.6:4973 , piece_id=D24P7CDU2UUFKMQXFX7VC3HMGM4P6X5GSNQBUIZKTDAM2KUMWHBA, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil> Sep 9 13:15:16.262701533 (71h46m52.302274653s) [noise=true , address=45.91.116.8:4047 , piece_id=CHJZOPRHZFEFB6ZTVWPLVMETXPV7QDDJ6PCZXO7CIBMOE7MGREBQ, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil> Sep 9 13:15:16.262716562 (71h46m52.302289682s) [seg_pos={0 0}, upload=63178]: Segment reached optimal threshold of 13 pieces. Sep 9 13:15:16.262826984 (71h46m52.302400114s) [noise=true , address=77.90.31.21:4879 , piece_id=XZSOWQDQT6KPUZU5FZUSQFWBY5WUB3LJW5NUV2DMFJ2DWDS5SSAA, seg_pos={0 0}, upload=63178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ): protocol: expected piece hash; context canceled; EOF Sep 9 13:15:16.262941312 (71h46m52.302514442s) [noise=true , address=145.79.227.17:4971 , piece_id=HD6KFRYXMOD72LHKII6TGZ4MK4OQ2BRJDUXMB6QJP4CSHSFKCDEA, seg_pos={0 0}, upload=63178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: write tcp 188.166.225.170:59124->145.79.227.17:4971: use of closed network connection; write tcp 188.166.225.170:59124->145.79.227.17:4971: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59124->145.79.227.17:4971: use of closed network connection Sep 9 13:15:16.262960669 (71h46m52.302533789s) [noise=true , address=145.79.227.11:4731 , piece_id=SZGM6ZXMLQMDMONHUZN3ZZX5S5B22CZ63PSIQ3F3EAUB7XNZC45A, seg_pos={0 0}, upload=63178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9): protocol: write tcp 188.166.225.170:52710->145.79.227.11:4731: use of closed network connection; write tcp 188.166.225.170:52710->145.79.227.11:4731: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52710->145.79.227.11:4731: use of closed network connection Sep 9 13:15:16.262982781 (71h46m52.302555901s) [seg_pos={0 0}, upload=63178]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 13:15:16.263058847 (71h46m52.302631977s) [upload=63178]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 13:15:16.263063075 (71h46m52.302636205s) [upload=63178]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 13:15:16.599612268 (71h46m52.639185389s) [upload=63178]: Done uploading segments... Sep 9 13:15:16.599631896 (71h46m52.639205016s) [upload=63178]: Upload finished. err: <nil> Duration: 30.001846618s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 14 out of 60 is failed (threshold=3) [............X................XXX........XXX.XX..XXXX...X....] duration: 16.986892772s FAIL (2025-09-09 13:14:54 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 13:11:16.892706312 (71h42m52.932279442s) [upload=63120]: Starting upload Sep 9 13:11:16.892779381 (71h42m52.932352511s) [upload=63120]: Done starting upload Sep 9 13:11:16.892818256 (71h42m52.932391376s) [upload=63120]: Uploading segments... Sep 9 13:11:16.892992469 (71h42m52.932565599s) [upload=63120]: Got next segment. Inline: false Sep 9 13:11:16.893022386 (71h42m52.932595516s) [upload=63120]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 13:11:16.893027145 (71h42m52.932600265s) [upload=63120]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 13:11:17.384487503 (71h42m53.424060623s) [seg_pos={0 0}, upload=63120]: Begin upload segment... Sep 9 13:11:17.384526297 (71h42m53.424099407s) [seg_pos={0 0}, upload=63120]: Done begin upload segment. Sep 9 13:11:17.384545955 (71h42m53.424119075s) [noise=true , address=145.79.227.11:4732 , piece_id=EAEB3QCHV27ZOM5GCEWOTDFZTIZPPZI75J2HRZWH27RTQYIQWRZQ, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.384930500 (71h42m53.42450362s) [noise=true , address=45.91.116.7:4011 , piece_id=CRCOGI3FUA3IGBNRW7D23SIAMSDKAXWS6SCR43YHLG7RDTVX6VYQ, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.385422842 (71h42m53.424995953s) [noise=true , address=45.91.116.5:4299 , piece_id=Y7ZS3ILZLJ22MSJJNIYYSWVY7D43SHPMU2TD5YNDY7ONJHOS744A, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.385886780 (71h42m53.4254599s) [noise=true , address=45.91.116.9:4261 , piece_id=EOCRU5FDXNMRCUJJ46PYVBHIALRZXWJQVRFUU3MDMRZBLZ4BOOLA, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.385977363 (71h42m53.425550483s) [noise=true , address=77.90.31.15:4698 , piece_id=YKF2KR7I2VSFPGXHCVDADHOTXZFWNO2DW6WI27WOWEYWMZGASASA, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.386291285 (71h42m53.425864425s) [noise=true , address=45.91.116.6:4973 , piece_id=WAIWDFXWGRPTZ2GY3OK5VISLKSIPSOCWH47GAYJ3LXYIMVGBIBWQ, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.386615826 (71h42m53.426188946s) [noise=true , address=45.91.116.4:4938 , piece_id=URBRBCB6DIOHHL7LPYAXLCMKVXU5RVNQASM6OZVNSQUATEPAFIXQ, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.386982146 (71h42m53.426555266s) [noise=true , address=45.91.116.12:4225 , piece_id=XLV2JLL5JR6L3BK3Z3G4JGNU25QPG2LC2G6WXV3HWEXNV5UQKYFA, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.387253355 (71h42m53.426826475s) [noise=true , address=77.90.31.21:4878 , piece_id=N24KLQFZCACGCW2NWZ2JM5IK7B5NE6PRHV4V7EM36GUWH4YGGWAQ, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.387516690 (71h42m53.42708981s) [noise=true , address=45.91.116.12:4226 , piece_id=4YX4BYD6ERKSFKBKL6ZOY7DTTVGBGHVESXCIBQYKJ5PX2TQZ2KDQ, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.387797787 (71h42m53.427370907s) [noise=true , address=145.79.227.14:4837 , piece_id=5YPJH66EDGU3KBKZU6NV3VIUEUNCXWUXEG2ISAEUO5ASV42UAA7A, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.388012298 (71h42m53.427585418s) [noise=true , address=145.79.227.7:4295 , piece_id=S4IPMU26CTZ665HEZDGGP3WSYLEENIYEPTQNZPRAO7GCVVMJWK3Q, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.388217199 (71h42m53.427790319s) [noise=true , address=45.91.116.8:4045 , piece_id=HRS3KHIKWNH2A7Z25MV4W67RGCPM4AW3FG4DNZ2DLB3UY54QRVTQ, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.388444033 (71h42m53.428017153s) [noise=true , address=77.90.31.13:4627 , piece_id=XBEJ7GSODUHKNH37IFUYFNQUCWKJEUBYACVZWCSARY72BRPSF3EA, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.388645740 (71h42m53.42821885s) [noise=true , address=45.91.116.10:4083 , piece_id=M2ULLE6RSKTLRHY25CO4YCN2754WLBZHVEUNRKRHPWVPJY62LZCQ, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.388846513 (71h42m53.428419634s) [noise=true , address=45.91.116.13:4155 , piece_id=26QIRWAP5M7YRY5PKM4F6EOO3TAZM26NVWAPZNNPTOJQ7OQNXIHQ, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:19.234358286 (71h42m55.273931406s) [upload=63120]: Next returned nil segment Sep 9 13:11:19.234374428 (71h42m55.273947548s) [upload=63120]: Waiting for error group managing segments... Sep 9 13:11:19.560332396 (71h42m55.599905516s) [noise=true , address=45.91.116.9:4261 , piece_id=EOCRU5FDXNMRCUJJ46PYVBHIALRZXWJQVRFUU3MDMRZBLZ4BOOLA, seg_pos={0 0}, upload=63120]: Done uploading piece. err: <nil> Sep 9 13:11:19.569448160 (71h42m55.60902128s) [noise=true , address=45.91.116.10:4083 , piece_id=M2ULLE6RSKTLRHY25CO4YCN2754WLBZHVEUNRKRHPWVPJY62LZCQ, seg_pos={0 0}, upload=63120]: Done uploading piece. err: <nil> Sep 9 13:11:19.598130487 (71h42m55.637703608s) [noise=true , address=45.91.116.13:4155 , piece_id=26QIRWAP5M7YRY5PKM4F6EOO3TAZM26NVWAPZNNPTOJQ7OQNXIHQ, seg_pos={0 0}, upload=63120]: Done uploading piece. err: <nil> Sep 9 13:11:19.621531127 (71h42m55.661104247s) [noise=true , address=145.79.227.11:4732 , piece_id=EAEB3QCHV27ZOM5GCEWOTDFZTIZPPZI75J2HRZWH27RTQYIQWRZQ, seg_pos={0 0}, upload=63120]: Done uploading piece. err: <nil> Sep 9 13:11:19.636102371 (71h42m55.675675491s) [noise=true , address=45.91.116.5:4299 , piece_id=Y7ZS3ILZLJ22MSJJNIYYSWVY7D43SHPMU2TD5YNDY7ONJHOS744A, seg_pos={0 0}, upload=63120]: Done uploading piece. err: <nil> Sep 9 13:11:19.647424878 (71h42m55.686997998s) [noise=true , address=45.91.116.6:4973 , piece_id=WAIWDFXWGRPTZ2GY3OK5VISLKSIPSOCWH47GAYJ3LXYIMVGBIBWQ, seg_pos={0 0}, upload=63120]: Done uploading piece. err: <nil> Sep 9 13:11:19.647582880 (71h42m55.687156s) [noise=true , address=145.79.227.7:4295 , piece_id=S4IPMU26CTZ665HEZDGGP3WSYLEENIYEPTQNZPRAO7GCVVMJWK3Q, seg_pos={0 0}, upload=63120]: Done uploading piece. err: <nil> Sep 9 13:11:19.660247606 (71h42m55.699820726s) [noise=true , address=45.91.116.4:4938 , piece_id=URBRBCB6DIOHHL7LPYAXLCMKVXU5RVNQASM6OZVNSQUATEPAFIXQ, seg_pos={0 0}, upload=63120]: Done uploading piece. err: <nil> Sep 9 13:11:19.680374150 (71h42m55.71994728s) [noise=true , address=45.91.116.12:4226 , piece_id=4YX4BYD6ERKSFKBKL6ZOY7DTTVGBGHVESXCIBQYKJ5PX2TQZ2KDQ, seg_pos={0 0}, upload=63120]: Done uploading piece. err: <nil> Sep 9 13:11:19.689181835 (71h42m55.728754955s) [noise=true , address=77.90.31.15:4698 , piece_id=YKF2KR7I2VSFPGXHCVDADHOTXZFWNO2DW6WI27WOWEYWMZGASASA, seg_pos={0 0}, upload=63120]: Done uploading piece. err: <nil> Sep 9 13:11:19.697091591 (71h42m55.736664711s) [noise=true , address=45.91.116.12:4225 , piece_id=XLV2JLL5JR6L3BK3Z3G4JGNU25QPG2LC2G6WXV3HWEXNV5UQKYFA, seg_pos={0 0}, upload=63120]: Done uploading piece. err: <nil> Sep 9 13:11:19.710728267 (71h42m55.750301377s) [noise=true , address=77.90.31.13:4627 , piece_id=XBEJ7GSODUHKNH37IFUYFNQUCWKJEUBYACVZWCSARY72BRPSF3EA, seg_pos={0 0}, upload=63120]: Done uploading piece. err: <nil> Sep 9 13:11:19.913514622 (71h42m55.953087742s) [noise=true , address=45.91.116.7:4011 , piece_id=CRCOGI3FUA3IGBNRW7D23SIAMSDKAXWS6SCR43YHLG7RDTVX6VYQ, seg_pos={0 0}, upload=63120]: Done uploading piece. err: <nil> Sep 9 13:11:19.913531544 (71h42m55.953104664s) [seg_pos={0 0}, upload=63120]: Segment reached optimal threshold of 13 pieces. Sep 9 13:11:19.913623199 (71h42m55.953196319s) [noise=true , address=45.91.116.8:4045 , piece_id=HRS3KHIKWNH2A7Z25MV4W67RGCPM4AW3FG4DNZ2DLB3UY54QRVTQ, seg_pos={0 0}, upload=63120]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: expected piece hash; context canceled; EOF Sep 9 13:11:19.913767064 (71h42m55.953340174s) [noise=true , address=145.79.227.14:4837 , piece_id=5YPJH66EDGU3KBKZU6NV3VIUEUNCXWUXEG2ISAEUO5ASV42UAA7A, seg_pos={0 0}, upload=63120]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV): protocol: write tcp 188.166.225.170:50516->145.79.227.14:4837: use of closed network connection; write tcp 188.166.225.170:50516->145.79.227.14:4837: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50516->145.79.227.14:4837: use of closed network connection Sep 9 13:11:19.913784268 (71h42m55.953357388s) [noise=true , address=77.90.31.21:4878 , piece_id=N24KLQFZCACGCW2NWZ2JM5IK7B5NE6PRHV4V7EM36GUWH4YGGWAQ, seg_pos={0 0}, upload=63120]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK): protocol: write tcp 188.166.225.170:51458->77.90.31.21:4878: use of closed network connection; write tcp 188.166.225.170:51458->77.90.31.21:4878: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51458->77.90.31.21:4878: use of closed network connection Sep 9 13:11:19.913827711 (71h42m55.953400831s) [seg_pos={0 0}, upload=63120]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 13:11:19.913892425 (71h42m55.953465545s) [upload=63120]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 13:11:19.913896603 (71h42m55.953469723s) [upload=63120]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 13:11:20.370855167 (71h42m56.410428287s) [upload=63120]: Done uploading segments... Sep 9 13:11:20.370878120 (71h42m56.41045124s) [upload=63120]: Upload finished. err: <nil> Duration: 16.986924794s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 14 out of 60 is failed (threshold=3) [.............X................XXX........XXX.XX..XXXX...X...] duration: 9.82929987s FAIL (2025-09-09 13:14:04 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 13:11:16.892706312 (71h42m52.932279442s) [upload=63120]: Starting upload Sep 9 13:11:16.892779381 (71h42m52.932352511s) [upload=63120]: Done starting upload Sep 9 13:11:16.892818256 (71h42m52.932391376s) [upload=63120]: Uploading segments... Sep 9 13:11:16.892992469 (71h42m52.932565599s) [upload=63120]: Got next segment. Inline: false Sep 9 13:11:16.893022386 (71h42m52.932595516s) [upload=63120]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 13:11:16.893027145 (71h42m52.932600265s) [upload=63120]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 13:11:17.384487503 (71h42m53.424060623s) [seg_pos={0 0}, upload=63120]: Begin upload segment... Sep 9 13:11:17.384526297 (71h42m53.424099407s) [seg_pos={0 0}, upload=63120]: Done begin upload segment. Sep 9 13:11:17.384545955 (71h42m53.424119075s) [noise=true , address=145.79.227.11:4732 , piece_id=EAEB3QCHV27ZOM5GCEWOTDFZTIZPPZI75J2HRZWH27RTQYIQWRZQ, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.384930500 (71h42m53.42450362s) [noise=true , address=45.91.116.7:4011 , piece_id=CRCOGI3FUA3IGBNRW7D23SIAMSDKAXWS6SCR43YHLG7RDTVX6VYQ, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.385422842 (71h42m53.424995953s) [noise=true , address=45.91.116.5:4299 , piece_id=Y7ZS3ILZLJ22MSJJNIYYSWVY7D43SHPMU2TD5YNDY7ONJHOS744A, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.385886780 (71h42m53.4254599s) [noise=true , address=45.91.116.9:4261 , piece_id=EOCRU5FDXNMRCUJJ46PYVBHIALRZXWJQVRFUU3MDMRZBLZ4BOOLA, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.385977363 (71h42m53.425550483s) [noise=true , address=77.90.31.15:4698 , piece_id=YKF2KR7I2VSFPGXHCVDADHOTXZFWNO2DW6WI27WOWEYWMZGASASA, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.386291285 (71h42m53.425864425s) [noise=true , address=45.91.116.6:4973 , piece_id=WAIWDFXWGRPTZ2GY3OK5VISLKSIPSOCWH47GAYJ3LXYIMVGBIBWQ, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.386615826 (71h42m53.426188946s) [noise=true , address=45.91.116.4:4938 , piece_id=URBRBCB6DIOHHL7LPYAXLCMKVXU5RVNQASM6OZVNSQUATEPAFIXQ, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.386982146 (71h42m53.426555266s) [noise=true , address=45.91.116.12:4225 , piece_id=XLV2JLL5JR6L3BK3Z3G4JGNU25QPG2LC2G6WXV3HWEXNV5UQKYFA, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.387253355 (71h42m53.426826475s) [noise=true , address=77.90.31.21:4878 , piece_id=N24KLQFZCACGCW2NWZ2JM5IK7B5NE6PRHV4V7EM36GUWH4YGGWAQ, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.387516690 (71h42m53.42708981s) [noise=true , address=45.91.116.12:4226 , piece_id=4YX4BYD6ERKSFKBKL6ZOY7DTTVGBGHVESXCIBQYKJ5PX2TQZ2KDQ, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.387797787 (71h42m53.427370907s) [noise=true , address=145.79.227.14:4837 , piece_id=5YPJH66EDGU3KBKZU6NV3VIUEUNCXWUXEG2ISAEUO5ASV42UAA7A, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.388012298 (71h42m53.427585418s) [noise=true , address=145.79.227.7:4295 , piece_id=S4IPMU26CTZ665HEZDGGP3WSYLEENIYEPTQNZPRAO7GCVVMJWK3Q, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.388217199 (71h42m53.427790319s) [noise=true , address=45.91.116.8:4045 , piece_id=HRS3KHIKWNH2A7Z25MV4W67RGCPM4AW3FG4DNZ2DLB3UY54QRVTQ, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.388444033 (71h42m53.428017153s) [noise=true , address=77.90.31.13:4627 , piece_id=XBEJ7GSODUHKNH37IFUYFNQUCWKJEUBYACVZWCSARY72BRPSF3EA, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.388645740 (71h42m53.42821885s) [noise=true , address=45.91.116.10:4083 , piece_id=M2ULLE6RSKTLRHY25CO4YCN2754WLBZHVEUNRKRHPWVPJY62LZCQ, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.388846513 (71h42m53.428419634s) [noise=true , address=45.91.116.13:4155 , piece_id=26QIRWAP5M7YRY5PKM4F6EOO3TAZM26NVWAPZNNPTOJQ7OQNXIHQ, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:19.234358286 (71h42m55.273931406s) [upload=63120]: Next returned nil segment Sep 9 13:11:19.234374428 (71h42m55.273947548s) [upload=63120]: Waiting for error group managing segments... Sep 9 13:11:19.560332396 (71h42m55.599905516s) [noise=true , address=45.91.116.9:4261 , piece_id=EOCRU5FDXNMRCUJJ46PYVBHIALRZXWJQVRFUU3MDMRZBLZ4BOOLA, seg_pos={0 0}, upload=63120]: Done uploading piece. err: <nil> Sep 9 13:11:19.569448160 (71h42m55.60902128s) [noise=true , address=45.91.116.10:4083 , piece_id=M2ULLE6RSKTLRHY25CO4YCN2754WLBZHVEUNRKRHPWVPJY62LZCQ, seg_pos={0 0}, upload=63120]: Done uploading piece. err: <nil> Sep 9 13:11:19.598130487 (71h42m55.637703608s) [noise=true , address=45.91.116.13:4155 , piece_id=26QIRWAP5M7YRY5PKM4F6EOO3TAZM26NVWAPZNNPTOJQ7OQNXIHQ, seg_pos={0 0}, upload=63120]: Done uploading piece. err: <nil> Sep 9 13:11:19.621531127 (71h42m55.661104247s) [noise=true , address=145.79.227.11:4732 , piece_id=EAEB3QCHV27ZOM5GCEWOTDFZTIZPPZI75J2HRZWH27RTQYIQWRZQ, seg_pos={0 0}, upload=63120]: Done uploading piece. err: <nil> Sep 9 13:11:19.636102371 (71h42m55.675675491s) [noise=true , address=45.91.116.5:4299 , piece_id=Y7ZS3ILZLJ22MSJJNIYYSWVY7D43SHPMU2TD5YNDY7ONJHOS744A, seg_pos={0 0}, upload=63120]: Done uploading piece. err: <nil> Sep 9 13:11:19.647424878 (71h42m55.686997998s) [noise=true , address=45.91.116.6:4973 , piece_id=WAIWDFXWGRPTZ2GY3OK5VISLKSIPSOCWH47GAYJ3LXYIMVGBIBWQ, seg_pos={0 0}, upload=63120]: Done uploading piece. err: <nil> Sep 9 13:11:19.647582880 (71h42m55.687156s) [noise=true , address=145.79.227.7:4295 , piece_id=S4IPMU26CTZ665HEZDGGP3WSYLEENIYEPTQNZPRAO7GCVVMJWK3Q, seg_pos={0 0}, upload=63120]: Done uploading piece. err: <nil> Sep 9 13:11:19.660247606 (71h42m55.699820726s) [noise=true , address=45.91.116.4:4938 , piece_id=URBRBCB6DIOHHL7LPYAXLCMKVXU5RVNQASM6OZVNSQUATEPAFIXQ, seg_pos={0 0}, upload=63120]: Done uploading piece. err: <nil> Sep 9 13:11:19.680374150 (71h42m55.71994728s) [noise=true , address=45.91.116.12:4226 , piece_id=4YX4BYD6ERKSFKBKL6ZOY7DTTVGBGHVESXCIBQYKJ5PX2TQZ2KDQ, seg_pos={0 0}, upload=63120]: Done uploading piece. err: <nil> Sep 9 13:11:19.689181835 (71h42m55.728754955s) [noise=true , address=77.90.31.15:4698 , piece_id=YKF2KR7I2VSFPGXHCVDADHOTXZFWNO2DW6WI27WOWEYWMZGASASA, seg_pos={0 0}, upload=63120]: Done uploading piece. err: <nil> Sep 9 13:11:19.697091591 (71h42m55.736664711s) [noise=true , address=45.91.116.12:4225 , piece_id=XLV2JLL5JR6L3BK3Z3G4JGNU25QPG2LC2G6WXV3HWEXNV5UQKYFA, seg_pos={0 0}, upload=63120]: Done uploading piece. err: <nil> Sep 9 13:11:19.710728267 (71h42m55.750301377s) [noise=true , address=77.90.31.13:4627 , piece_id=XBEJ7GSODUHKNH37IFUYFNQUCWKJEUBYACVZWCSARY72BRPSF3EA, seg_pos={0 0}, upload=63120]: Done uploading piece. err: <nil> Sep 9 13:11:19.913514622 (71h42m55.953087742s) [noise=true , address=45.91.116.7:4011 , piece_id=CRCOGI3FUA3IGBNRW7D23SIAMSDKAXWS6SCR43YHLG7RDTVX6VYQ, seg_pos={0 0}, upload=63120]: Done uploading piece. err: <nil> Sep 9 13:11:19.913531544 (71h42m55.953104664s) [seg_pos={0 0}, upload=63120]: Segment reached optimal threshold of 13 pieces. Sep 9 13:11:19.913623199 (71h42m55.953196319s) [noise=true , address=45.91.116.8:4045 , piece_id=HRS3KHIKWNH2A7Z25MV4W67RGCPM4AW3FG4DNZ2DLB3UY54QRVTQ, seg_pos={0 0}, upload=63120]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: expected piece hash; context canceled; EOF Sep 9 13:11:19.913767064 (71h42m55.953340174s) [noise=true , address=145.79.227.14:4837 , piece_id=5YPJH66EDGU3KBKZU6NV3VIUEUNCXWUXEG2ISAEUO5ASV42UAA7A, seg_pos={0 0}, upload=63120]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV): protocol: write tcp 188.166.225.170:50516->145.79.227.14:4837: use of closed network connection; write tcp 188.166.225.170:50516->145.79.227.14:4837: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50516->145.79.227.14:4837: use of closed network connection Sep 9 13:11:19.913784268 (71h42m55.953357388s) [noise=true , address=77.90.31.21:4878 , piece_id=N24KLQFZCACGCW2NWZ2JM5IK7B5NE6PRHV4V7EM36GUWH4YGGWAQ, seg_pos={0 0}, upload=63120]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK): protocol: write tcp 188.166.225.170:51458->77.90.31.21:4878: use of closed network connection; write tcp 188.166.225.170:51458->77.90.31.21:4878: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51458->77.90.31.21:4878: use of closed network connection Sep 9 13:11:19.913827711 (71h42m55.953400831s) [seg_pos={0 0}, upload=63120]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 13:11:19.913892425 (71h42m55.953465545s) [upload=63120]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 13:11:19.913896603 (71h42m55.953469723s) [upload=63120]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 13:11:20.370855167 (71h42m56.410428287s) [upload=63120]: Done uploading segments... Sep 9 13:11:20.370878120 (71h42m56.41045124s) [upload=63120]: Upload finished. err: <nil> Duration: 9.829325107s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 14 out of 60 is failed (threshold=3) [..............X................XXX........XXX.XX..XXXX...X..] duration: 22.64025716s FAIL (2025-09-09 13:13:47 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 13:11:16.892706312 (71h42m52.932279442s) [upload=63120]: Starting upload Sep 9 13:11:16.892779381 (71h42m52.932352511s) [upload=63120]: Done starting upload Sep 9 13:11:16.892818256 (71h42m52.932391376s) [upload=63120]: Uploading segments... Sep 9 13:11:16.892992469 (71h42m52.932565599s) [upload=63120]: Got next segment. Inline: false Sep 9 13:11:16.893022386 (71h42m52.932595516s) [upload=63120]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 13:11:16.893027145 (71h42m52.932600265s) [upload=63120]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 13:11:17.384487503 (71h42m53.424060623s) [seg_pos={0 0}, upload=63120]: Begin upload segment... Sep 9 13:11:17.384526297 (71h42m53.424099407s) [seg_pos={0 0}, upload=63120]: Done begin upload segment. Sep 9 13:11:17.384545955 (71h42m53.424119075s) [noise=true , address=145.79.227.11:4732 , piece_id=EAEB3QCHV27ZOM5GCEWOTDFZTIZPPZI75J2HRZWH27RTQYIQWRZQ, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.384930500 (71h42m53.42450362s) [noise=true , address=45.91.116.7:4011 , piece_id=CRCOGI3FUA3IGBNRW7D23SIAMSDKAXWS6SCR43YHLG7RDTVX6VYQ, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.385422842 (71h42m53.424995953s) [noise=true , address=45.91.116.5:4299 , piece_id=Y7ZS3ILZLJ22MSJJNIYYSWVY7D43SHPMU2TD5YNDY7ONJHOS744A, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.385886780 (71h42m53.4254599s) [noise=true , address=45.91.116.9:4261 , piece_id=EOCRU5FDXNMRCUJJ46PYVBHIALRZXWJQVRFUU3MDMRZBLZ4BOOLA, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.385977363 (71h42m53.425550483s) [noise=true , address=77.90.31.15:4698 , piece_id=YKF2KR7I2VSFPGXHCVDADHOTXZFWNO2DW6WI27WOWEYWMZGASASA, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.386291285 (71h42m53.425864425s) [noise=true , address=45.91.116.6:4973 , piece_id=WAIWDFXWGRPTZ2GY3OK5VISLKSIPSOCWH47GAYJ3LXYIMVGBIBWQ, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.386615826 (71h42m53.426188946s) [noise=true , address=45.91.116.4:4938 , piece_id=URBRBCB6DIOHHL7LPYAXLCMKVXU5RVNQASM6OZVNSQUATEPAFIXQ, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.386982146 (71h42m53.426555266s) [noise=true , address=45.91.116.12:4225 , piece_id=XLV2JLL5JR6L3BK3Z3G4JGNU25QPG2LC2G6WXV3HWEXNV5UQKYFA, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.387253355 (71h42m53.426826475s) [noise=true , address=77.90.31.21:4878 , piece_id=N24KLQFZCACGCW2NWZ2JM5IK7B5NE6PRHV4V7EM36GUWH4YGGWAQ, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.387516690 (71h42m53.42708981s) [noise=true , address=45.91.116.12:4226 , piece_id=4YX4BYD6ERKSFKBKL6ZOY7DTTVGBGHVESXCIBQYKJ5PX2TQZ2KDQ, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.387797787 (71h42m53.427370907s) [noise=true , address=145.79.227.14:4837 , piece_id=5YPJH66EDGU3KBKZU6NV3VIUEUNCXWUXEG2ISAEUO5ASV42UAA7A, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.388012298 (71h42m53.427585418s) [noise=true , address=145.79.227.7:4295 , piece_id=S4IPMU26CTZ665HEZDGGP3WSYLEENIYEPTQNZPRAO7GCVVMJWK3Q, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.388217199 (71h42m53.427790319s) [noise=true , address=45.91.116.8:4045 , piece_id=HRS3KHIKWNH2A7Z25MV4W67RGCPM4AW3FG4DNZ2DLB3UY54QRVTQ, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.388444033 (71h42m53.428017153s) [noise=true , address=77.90.31.13:4627 , piece_id=XBEJ7GSODUHKNH37IFUYFNQUCWKJEUBYACVZWCSARY72BRPSF3EA, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.388645740 (71h42m53.42821885s) [noise=true , address=45.91.116.10:4083 , piece_id=M2ULLE6RSKTLRHY25CO4YCN2754WLBZHVEUNRKRHPWVPJY62LZCQ, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.388846513 (71h42m53.428419634s) [noise=true , address=45.91.116.13:4155 , piece_id=26QIRWAP5M7YRY5PKM4F6EOO3TAZM26NVWAPZNNPTOJQ7OQNXIHQ, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:19.234358286 (71h42m55.273931406s) [upload=63120]: Next returned nil segment Sep 9 13:11:19.234374428 (71h42m55.273947548s) [upload=63120]: Waiting for error group managing segments... Sep 9 13:11:19.560332396 (71h42m55.599905516s) [noise=true , address=45.91.116.9:4261 , piece_id=EOCRU5FDXNMRCUJJ46PYVBHIALRZXWJQVRFUU3MDMRZBLZ4BOOLA, seg_pos={0 0}, upload=63120]: Done uploading piece. err: <nil> Sep 9 13:11:19.569448160 (71h42m55.60902128s) [noise=true , address=45.91.116.10:4083 , piece_id=M2ULLE6RSKTLRHY25CO4YCN2754WLBZHVEUNRKRHPWVPJY62LZCQ, seg_pos={0 0}, upload=63120]: Done uploading piece. err: <nil> Sep 9 13:11:19.598130487 (71h42m55.637703608s) [noise=true , address=45.91.116.13:4155 , piece_id=26QIRWAP5M7YRY5PKM4F6EOO3TAZM26NVWAPZNNPTOJQ7OQNXIHQ, seg_pos={0 0}, upload=63120]: Done uploading piece. err: <nil> Sep 9 13:11:19.621531127 (71h42m55.661104247s) [noise=true , address=145.79.227.11:4732 , piece_id=EAEB3QCHV27ZOM5GCEWOTDFZTIZPPZI75J2HRZWH27RTQYIQWRZQ, seg_pos={0 0}, upload=63120]: Done uploading piece. err: <nil> Sep 9 13:11:19.636102371 (71h42m55.675675491s) [noise=true , address=45.91.116.5:4299 , piece_id=Y7ZS3ILZLJ22MSJJNIYYSWVY7D43SHPMU2TD5YNDY7ONJHOS744A, seg_pos={0 0}, upload=63120]: Done uploading piece. err: <nil> Sep 9 13:11:19.647424878 (71h42m55.686997998s) [noise=true , address=45.91.116.6:4973 , piece_id=WAIWDFXWGRPTZ2GY3OK5VISLKSIPSOCWH47GAYJ3LXYIMVGBIBWQ, seg_pos={0 0}, upload=63120]: Done uploading piece. err: <nil> Sep 9 13:11:19.647582880 (71h42m55.687156s) [noise=true , address=145.79.227.7:4295 , piece_id=S4IPMU26CTZ665HEZDGGP3WSYLEENIYEPTQNZPRAO7GCVVMJWK3Q, seg_pos={0 0}, upload=63120]: Done uploading piece. err: <nil> Sep 9 13:11:19.660247606 (71h42m55.699820726s) [noise=true , address=45.91.116.4:4938 , piece_id=URBRBCB6DIOHHL7LPYAXLCMKVXU5RVNQASM6OZVNSQUATEPAFIXQ, seg_pos={0 0}, upload=63120]: Done uploading piece. err: <nil> Sep 9 13:11:19.680374150 (71h42m55.71994728s) [noise=true , address=45.91.116.12:4226 , piece_id=4YX4BYD6ERKSFKBKL6ZOY7DTTVGBGHVESXCIBQYKJ5PX2TQZ2KDQ, seg_pos={0 0}, upload=63120]: Done uploading piece. err: <nil> Sep 9 13:11:19.689181835 (71h42m55.728754955s) [noise=true , address=77.90.31.15:4698 , piece_id=YKF2KR7I2VSFPGXHCVDADHOTXZFWNO2DW6WI27WOWEYWMZGASASA, seg_pos={0 0}, upload=63120]: Done uploading piece. err: <nil> Sep 9 13:11:19.697091591 (71h42m55.736664711s) [noise=true , address=45.91.116.12:4225 , piece_id=XLV2JLL5JR6L3BK3Z3G4JGNU25QPG2LC2G6WXV3HWEXNV5UQKYFA, seg_pos={0 0}, upload=63120]: Done uploading piece. err: <nil> Sep 9 13:11:19.710728267 (71h42m55.750301377s) [noise=true , address=77.90.31.13:4627 , piece_id=XBEJ7GSODUHKNH37IFUYFNQUCWKJEUBYACVZWCSARY72BRPSF3EA, seg_pos={0 0}, upload=63120]: Done uploading piece. err: <nil> Sep 9 13:11:19.913514622 (71h42m55.953087742s) [noise=true , address=45.91.116.7:4011 , piece_id=CRCOGI3FUA3IGBNRW7D23SIAMSDKAXWS6SCR43YHLG7RDTVX6VYQ, seg_pos={0 0}, upload=63120]: Done uploading piece. err: <nil> Sep 9 13:11:19.913531544 (71h42m55.953104664s) [seg_pos={0 0}, upload=63120]: Segment reached optimal threshold of 13 pieces. Sep 9 13:11:19.913623199 (71h42m55.953196319s) [noise=true , address=45.91.116.8:4045 , piece_id=HRS3KHIKWNH2A7Z25MV4W67RGCPM4AW3FG4DNZ2DLB3UY54QRVTQ, seg_pos={0 0}, upload=63120]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: expected piece hash; context canceled; EOF Sep 9 13:11:19.913767064 (71h42m55.953340174s) [noise=true , address=145.79.227.14:4837 , piece_id=5YPJH66EDGU3KBKZU6NV3VIUEUNCXWUXEG2ISAEUO5ASV42UAA7A, seg_pos={0 0}, upload=63120]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV): protocol: write tcp 188.166.225.170:50516->145.79.227.14:4837: use of closed network connection; write tcp 188.166.225.170:50516->145.79.227.14:4837: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50516->145.79.227.14:4837: use of closed network connection Sep 9 13:11:19.913784268 (71h42m55.953357388s) [noise=true , address=77.90.31.21:4878 , piece_id=N24KLQFZCACGCW2NWZ2JM5IK7B5NE6PRHV4V7EM36GUWH4YGGWAQ, seg_pos={0 0}, upload=63120]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK): protocol: write tcp 188.166.225.170:51458->77.90.31.21:4878: use of closed network connection; write tcp 188.166.225.170:51458->77.90.31.21:4878: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51458->77.90.31.21:4878: use of closed network connection Sep 9 13:11:19.913827711 (71h42m55.953400831s) [seg_pos={0 0}, upload=63120]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 13:11:19.913892425 (71h42m55.953465545s) [upload=63120]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 13:11:19.913896603 (71h42m55.953469723s) [upload=63120]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 13:11:20.370855167 (71h42m56.410428287s) [upload=63120]: Done uploading segments... Sep 9 13:11:20.370878120 (71h42m56.41045124s) [upload=63120]: Upload finished. err: <nil> Duration: 22.640285834s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 14 out of 60 is failed (threshold=3) [...............X................XXX........XXX.XX..XXXX...X.] duration: 16.395238766s FAIL (2025-09-09 13:12:38 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 13:11:16.892706312 (71h42m52.932279442s) [upload=63120]: Starting upload Sep 9 13:11:16.892779381 (71h42m52.932352511s) [upload=63120]: Done starting upload Sep 9 13:11:16.892818256 (71h42m52.932391376s) [upload=63120]: Uploading segments... Sep 9 13:11:16.892992469 (71h42m52.932565599s) [upload=63120]: Got next segment. Inline: false Sep 9 13:11:16.893022386 (71h42m52.932595516s) [upload=63120]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 13:11:16.893027145 (71h42m52.932600265s) [upload=63120]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 13:11:17.384487503 (71h42m53.424060623s) [seg_pos={0 0}, upload=63120]: Begin upload segment... Sep 9 13:11:17.384526297 (71h42m53.424099407s) [seg_pos={0 0}, upload=63120]: Done begin upload segment. Sep 9 13:11:17.384545955 (71h42m53.424119075s) [noise=true , address=145.79.227.11:4732 , piece_id=EAEB3QCHV27ZOM5GCEWOTDFZTIZPPZI75J2HRZWH27RTQYIQWRZQ, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.384930500 (71h42m53.42450362s) [noise=true , address=45.91.116.7:4011 , piece_id=CRCOGI3FUA3IGBNRW7D23SIAMSDKAXWS6SCR43YHLG7RDTVX6VYQ, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.385422842 (71h42m53.424995953s) [noise=true , address=45.91.116.5:4299 , piece_id=Y7ZS3ILZLJ22MSJJNIYYSWVY7D43SHPMU2TD5YNDY7ONJHOS744A, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.385886780 (71h42m53.4254599s) [noise=true , address=45.91.116.9:4261 , piece_id=EOCRU5FDXNMRCUJJ46PYVBHIALRZXWJQVRFUU3MDMRZBLZ4BOOLA, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.385977363 (71h42m53.425550483s) [noise=true , address=77.90.31.15:4698 , piece_id=YKF2KR7I2VSFPGXHCVDADHOTXZFWNO2DW6WI27WOWEYWMZGASASA, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.386291285 (71h42m53.425864425s) [noise=true , address=45.91.116.6:4973 , piece_id=WAIWDFXWGRPTZ2GY3OK5VISLKSIPSOCWH47GAYJ3LXYIMVGBIBWQ, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.386615826 (71h42m53.426188946s) [noise=true , address=45.91.116.4:4938 , piece_id=URBRBCB6DIOHHL7LPYAXLCMKVXU5RVNQASM6OZVNSQUATEPAFIXQ, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.386982146 (71h42m53.426555266s) [noise=true , address=45.91.116.12:4225 , piece_id=XLV2JLL5JR6L3BK3Z3G4JGNU25QPG2LC2G6WXV3HWEXNV5UQKYFA, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.387253355 (71h42m53.426826475s) [noise=true , address=77.90.31.21:4878 , piece_id=N24KLQFZCACGCW2NWZ2JM5IK7B5NE6PRHV4V7EM36GUWH4YGGWAQ, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.387516690 (71h42m53.42708981s) [noise=true , address=45.91.116.12:4226 , piece_id=4YX4BYD6ERKSFKBKL6ZOY7DTTVGBGHVESXCIBQYKJ5PX2TQZ2KDQ, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.387797787 (71h42m53.427370907s) [noise=true , address=145.79.227.14:4837 , piece_id=5YPJH66EDGU3KBKZU6NV3VIUEUNCXWUXEG2ISAEUO5ASV42UAA7A, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.388012298 (71h42m53.427585418s) [noise=true , address=145.79.227.7:4295 , piece_id=S4IPMU26CTZ665HEZDGGP3WSYLEENIYEPTQNZPRAO7GCVVMJWK3Q, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.388217199 (71h42m53.427790319s) [noise=true , address=45.91.116.8:4045 , piece_id=HRS3KHIKWNH2A7Z25MV4W67RGCPM4AW3FG4DNZ2DLB3UY54QRVTQ, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.388444033 (71h42m53.428017153s) [noise=true , address=77.90.31.13:4627 , piece_id=XBEJ7GSODUHKNH37IFUYFNQUCWKJEUBYACVZWCSARY72BRPSF3EA, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.388645740 (71h42m53.42821885s) [noise=true , address=45.91.116.10:4083 , piece_id=M2ULLE6RSKTLRHY25CO4YCN2754WLBZHVEUNRKRHPWVPJY62LZCQ, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.388846513 (71h42m53.428419634s) [noise=true , address=45.91.116.13:4155 , piece_id=26QIRWAP5M7YRY5PKM4F6EOO3TAZM26NVWAPZNNPTOJQ7OQNXIHQ, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:19.234358286 (71h42m55.273931406s) [upload=63120]: Next returned nil segment Sep 9 13:11:19.234374428 (71h42m55.273947548s) [upload=63120]: Waiting for error group managing segments... Sep 9 13:11:19.560332396 (71h42m55.599905516s) [noise=true , address=45.91.116.9:4261 , piece_id=EOCRU5FDXNMRCUJJ46PYVBHIALRZXWJQVRFUU3MDMRZBLZ4BOOLA, seg_pos={0 0}, upload=63120]: Done uploading piece. err: <nil> Sep 9 13:11:19.569448160 (71h42m55.60902128s) [noise=true , address=45.91.116.10:4083 , piece_id=M2ULLE6RSKTLRHY25CO4YCN2754WLBZHVEUNRKRHPWVPJY62LZCQ, seg_pos={0 0}, upload=63120]: Done uploading piece. err: <nil> Sep 9 13:11:19.598130487 (71h42m55.637703608s) [noise=true , address=45.91.116.13:4155 , piece_id=26QIRWAP5M7YRY5PKM4F6EOO3TAZM26NVWAPZNNPTOJQ7OQNXIHQ, seg_pos={0 0}, upload=63120]: Done uploading piece. err: <nil> Sep 9 13:11:19.621531127 (71h42m55.661104247s) [noise=true , address=145.79.227.11:4732 , piece_id=EAEB3QCHV27ZOM5GCEWOTDFZTIZPPZI75J2HRZWH27RTQYIQWRZQ, seg_pos={0 0}, upload=63120]: Done uploading piece. err: <nil> Sep 9 13:11:19.636102371 (71h42m55.675675491s) [noise=true , address=45.91.116.5:4299 , piece_id=Y7ZS3ILZLJ22MSJJNIYYSWVY7D43SHPMU2TD5YNDY7ONJHOS744A, seg_pos={0 0}, upload=63120]: Done uploading piece. err: <nil> Sep 9 13:11:19.647424878 (71h42m55.686997998s) [noise=true , address=45.91.116.6:4973 , piece_id=WAIWDFXWGRPTZ2GY3OK5VISLKSIPSOCWH47GAYJ3LXYIMVGBIBWQ, seg_pos={0 0}, upload=63120]: Done uploading piece. err: <nil> Sep 9 13:11:19.647582880 (71h42m55.687156s) [noise=true , address=145.79.227.7:4295 , piece_id=S4IPMU26CTZ665HEZDGGP3WSYLEENIYEPTQNZPRAO7GCVVMJWK3Q, seg_pos={0 0}, upload=63120]: Done uploading piece. err: <nil> Sep 9 13:11:19.660247606 (71h42m55.699820726s) [noise=true , address=45.91.116.4:4938 , piece_id=URBRBCB6DIOHHL7LPYAXLCMKVXU5RVNQASM6OZVNSQUATEPAFIXQ, seg_pos={0 0}, upload=63120]: Done uploading piece. err: <nil> Sep 9 13:11:19.680374150 (71h42m55.71994728s) [noise=true , address=45.91.116.12:4226 , piece_id=4YX4BYD6ERKSFKBKL6ZOY7DTTVGBGHVESXCIBQYKJ5PX2TQZ2KDQ, seg_pos={0 0}, upload=63120]: Done uploading piece. err: <nil> Sep 9 13:11:19.689181835 (71h42m55.728754955s) [noise=true , address=77.90.31.15:4698 , piece_id=YKF2KR7I2VSFPGXHCVDADHOTXZFWNO2DW6WI27WOWEYWMZGASASA, seg_pos={0 0}, upload=63120]: Done uploading piece. err: <nil> Sep 9 13:11:19.697091591 (71h42m55.736664711s) [noise=true , address=45.91.116.12:4225 , piece_id=XLV2JLL5JR6L3BK3Z3G4JGNU25QPG2LC2G6WXV3HWEXNV5UQKYFA, seg_pos={0 0}, upload=63120]: Done uploading piece. err: <nil> Sep 9 13:11:19.710728267 (71h42m55.750301377s) [noise=true , address=77.90.31.13:4627 , piece_id=XBEJ7GSODUHKNH37IFUYFNQUCWKJEUBYACVZWCSARY72BRPSF3EA, seg_pos={0 0}, upload=63120]: Done uploading piece. err: <nil> Sep 9 13:11:19.913514622 (71h42m55.953087742s) [noise=true , address=45.91.116.7:4011 , piece_id=CRCOGI3FUA3IGBNRW7D23SIAMSDKAXWS6SCR43YHLG7RDTVX6VYQ, seg_pos={0 0}, upload=63120]: Done uploading piece. err: <nil> Sep 9 13:11:19.913531544 (71h42m55.953104664s) [seg_pos={0 0}, upload=63120]: Segment reached optimal threshold of 13 pieces. Sep 9 13:11:19.913623199 (71h42m55.953196319s) [noise=true , address=45.91.116.8:4045 , piece_id=HRS3KHIKWNH2A7Z25MV4W67RGCPM4AW3FG4DNZ2DLB3UY54QRVTQ, seg_pos={0 0}, upload=63120]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: expected piece hash; context canceled; EOF Sep 9 13:11:19.913767064 (71h42m55.953340174s) [noise=true , address=145.79.227.14:4837 , piece_id=5YPJH66EDGU3KBKZU6NV3VIUEUNCXWUXEG2ISAEUO5ASV42UAA7A, seg_pos={0 0}, upload=63120]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV): protocol: write tcp 188.166.225.170:50516->145.79.227.14:4837: use of closed network connection; write tcp 188.166.225.170:50516->145.79.227.14:4837: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50516->145.79.227.14:4837: use of closed network connection Sep 9 13:11:19.913784268 (71h42m55.953357388s) [noise=true , address=77.90.31.21:4878 , piece_id=N24KLQFZCACGCW2NWZ2JM5IK7B5NE6PRHV4V7EM36GUWH4YGGWAQ, seg_pos={0 0}, upload=63120]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK): protocol: write tcp 188.166.225.170:51458->77.90.31.21:4878: use of closed network connection; write tcp 188.166.225.170:51458->77.90.31.21:4878: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51458->77.90.31.21:4878: use of closed network connection Sep 9 13:11:19.913827711 (71h42m55.953400831s) [seg_pos={0 0}, upload=63120]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 13:11:19.913892425 (71h42m55.953465545s) [upload=63120]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 13:11:19.913896603 (71h42m55.953469723s) [upload=63120]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 13:11:20.370855167 (71h42m56.410428287s) [upload=63120]: Done uploading segments... Sep 9 13:11:20.370878120 (71h42m56.41045124s) [upload=63120]: Upload finished. err: <nil> Duration: 16.395275558s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 14 out of 60 is failed (threshold=3) [................X................XXX........XXX.XX..XXXX...X] duration: 30.001827222s FAIL (2025-09-09 13:11:46 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 13:11:16.892706312 (71h42m52.932279442s) [upload=63120]: Starting upload Sep 9 13:11:16.892779381 (71h42m52.932352511s) [upload=63120]: Done starting upload Sep 9 13:11:16.892818256 (71h42m52.932391376s) [upload=63120]: Uploading segments... Sep 9 13:11:16.892992469 (71h42m52.932565599s) [upload=63120]: Got next segment. Inline: false Sep 9 13:11:16.893022386 (71h42m52.932595516s) [upload=63120]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 13:11:16.893027145 (71h42m52.932600265s) [upload=63120]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 13:11:17.384487503 (71h42m53.424060623s) [seg_pos={0 0}, upload=63120]: Begin upload segment... Sep 9 13:11:17.384526297 (71h42m53.424099407s) [seg_pos={0 0}, upload=63120]: Done begin upload segment. Sep 9 13:11:17.384545955 (71h42m53.424119075s) [noise=true , address=145.79.227.11:4732 , piece_id=EAEB3QCHV27ZOM5GCEWOTDFZTIZPPZI75J2HRZWH27RTQYIQWRZQ, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.384930500 (71h42m53.42450362s) [noise=true , address=45.91.116.7:4011 , piece_id=CRCOGI3FUA3IGBNRW7D23SIAMSDKAXWS6SCR43YHLG7RDTVX6VYQ, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.385422842 (71h42m53.424995953s) [noise=true , address=45.91.116.5:4299 , piece_id=Y7ZS3ILZLJ22MSJJNIYYSWVY7D43SHPMU2TD5YNDY7ONJHOS744A, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.385886780 (71h42m53.4254599s) [noise=true , address=45.91.116.9:4261 , piece_id=EOCRU5FDXNMRCUJJ46PYVBHIALRZXWJQVRFUU3MDMRZBLZ4BOOLA, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.385977363 (71h42m53.425550483s) [noise=true , address=77.90.31.15:4698 , piece_id=YKF2KR7I2VSFPGXHCVDADHOTXZFWNO2DW6WI27WOWEYWMZGASASA, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.386291285 (71h42m53.425864425s) [noise=true , address=45.91.116.6:4973 , piece_id=WAIWDFXWGRPTZ2GY3OK5VISLKSIPSOCWH47GAYJ3LXYIMVGBIBWQ, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.386615826 (71h42m53.426188946s) [noise=true , address=45.91.116.4:4938 , piece_id=URBRBCB6DIOHHL7LPYAXLCMKVXU5RVNQASM6OZVNSQUATEPAFIXQ, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.386982146 (71h42m53.426555266s) [noise=true , address=45.91.116.12:4225 , piece_id=XLV2JLL5JR6L3BK3Z3G4JGNU25QPG2LC2G6WXV3HWEXNV5UQKYFA, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.387253355 (71h42m53.426826475s) [noise=true , address=77.90.31.21:4878 , piece_id=N24KLQFZCACGCW2NWZ2JM5IK7B5NE6PRHV4V7EM36GUWH4YGGWAQ, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.387516690 (71h42m53.42708981s) [noise=true , address=45.91.116.12:4226 , piece_id=4YX4BYD6ERKSFKBKL6ZOY7DTTVGBGHVESXCIBQYKJ5PX2TQZ2KDQ, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.387797787 (71h42m53.427370907s) [noise=true , address=145.79.227.14:4837 , piece_id=5YPJH66EDGU3KBKZU6NV3VIUEUNCXWUXEG2ISAEUO5ASV42UAA7A, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.388012298 (71h42m53.427585418s) [noise=true , address=145.79.227.7:4295 , piece_id=S4IPMU26CTZ665HEZDGGP3WSYLEENIYEPTQNZPRAO7GCVVMJWK3Q, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.388217199 (71h42m53.427790319s) [noise=true , address=45.91.116.8:4045 , piece_id=HRS3KHIKWNH2A7Z25MV4W67RGCPM4AW3FG4DNZ2DLB3UY54QRVTQ, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.388444033 (71h42m53.428017153s) [noise=true , address=77.90.31.13:4627 , piece_id=XBEJ7GSODUHKNH37IFUYFNQUCWKJEUBYACVZWCSARY72BRPSF3EA, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.388645740 (71h42m53.42821885s) [noise=true , address=45.91.116.10:4083 , piece_id=M2ULLE6RSKTLRHY25CO4YCN2754WLBZHVEUNRKRHPWVPJY62LZCQ, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:17.388846513 (71h42m53.428419634s) [noise=true , address=45.91.116.13:4155 , piece_id=26QIRWAP5M7YRY5PKM4F6EOO3TAZM26NVWAPZNNPTOJQ7OQNXIHQ, seg_pos={0 0}, upload=63120]: Uploading piece... Sep 9 13:11:19.234358286 (71h42m55.273931406s) [upload=63120]: Next returned nil segment Sep 9 13:11:19.234374428 (71h42m55.273947548s) [upload=63120]: Waiting for error group managing segments... Sep 9 13:11:19.560332396 (71h42m55.599905516s) [noise=true , address=45.91.116.9:4261 , piece_id=EOCRU5FDXNMRCUJJ46PYVBHIALRZXWJQVRFUU3MDMRZBLZ4BOOLA, seg_pos={0 0}, upload=63120]: Done uploading piece. err: <nil> Sep 9 13:11:19.569448160 (71h42m55.60902128s) [noise=true , address=45.91.116.10:4083 , piece_id=M2ULLE6RSKTLRHY25CO4YCN2754WLBZHVEUNRKRHPWVPJY62LZCQ, seg_pos={0 0}, upload=63120]: Done uploading piece. err: <nil> Sep 9 13:11:19.598130487 (71h42m55.637703608s) [noise=true , address=45.91.116.13:4155 , piece_id=26QIRWAP5M7YRY5PKM4F6EOO3TAZM26NVWAPZNNPTOJQ7OQNXIHQ, seg_pos={0 0}, upload=63120]: Done uploading piece. err: <nil> Sep 9 13:11:19.621531127 (71h42m55.661104247s) [noise=true , address=145.79.227.11:4732 , piece_id=EAEB3QCHV27ZOM5GCEWOTDFZTIZPPZI75J2HRZWH27RTQYIQWRZQ, seg_pos={0 0}, upload=63120]: Done uploading piece. err: <nil> Sep 9 13:11:19.636102371 (71h42m55.675675491s) [noise=true , address=45.91.116.5:4299 , piece_id=Y7ZS3ILZLJ22MSJJNIYYSWVY7D43SHPMU2TD5YNDY7ONJHOS744A, seg_pos={0 0}, upload=63120]: Done uploading piece. err: <nil> Sep 9 13:11:19.647424878 (71h42m55.686997998s) [noise=true , address=45.91.116.6:4973 , piece_id=WAIWDFXWGRPTZ2GY3OK5VISLKSIPSOCWH47GAYJ3LXYIMVGBIBWQ, seg_pos={0 0}, upload=63120]: Done uploading piece. err: <nil> Sep 9 13:11:19.647582880 (71h42m55.687156s) [noise=true , address=145.79.227.7:4295 , piece_id=S4IPMU26CTZ665HEZDGGP3WSYLEENIYEPTQNZPRAO7GCVVMJWK3Q, seg_pos={0 0}, upload=63120]: Done uploading piece. err: <nil> Sep 9 13:11:19.660247606 (71h42m55.699820726s) [noise=true , address=45.91.116.4:4938 , piece_id=URBRBCB6DIOHHL7LPYAXLCMKVXU5RVNQASM6OZVNSQUATEPAFIXQ, seg_pos={0 0}, upload=63120]: Done uploading piece. err: <nil> Sep 9 13:11:19.680374150 (71h42m55.71994728s) [noise=true , address=45.91.116.12:4226 , piece_id=4YX4BYD6ERKSFKBKL6ZOY7DTTVGBGHVESXCIBQYKJ5PX2TQZ2KDQ, seg_pos={0 0}, upload=63120]: Done uploading piece. err: <nil> Sep 9 13:11:19.689181835 (71h42m55.728754955s) [noise=true , address=77.90.31.15:4698 , piece_id=YKF2KR7I2VSFPGXHCVDADHOTXZFWNO2DW6WI27WOWEYWMZGASASA, seg_pos={0 0}, upload=63120]: Done uploading piece. err: <nil> Sep 9 13:11:19.697091591 (71h42m55.736664711s) [noise=true , address=45.91.116.12:4225 , piece_id=XLV2JLL5JR6L3BK3Z3G4JGNU25QPG2LC2G6WXV3HWEXNV5UQKYFA, seg_pos={0 0}, upload=63120]: Done uploading piece. err: <nil> Sep 9 13:11:19.710728267 (71h42m55.750301377s) [noise=true , address=77.90.31.13:4627 , piece_id=XBEJ7GSODUHKNH37IFUYFNQUCWKJEUBYACVZWCSARY72BRPSF3EA, seg_pos={0 0}, upload=63120]: Done uploading piece. err: <nil> Sep 9 13:11:19.913514622 (71h42m55.953087742s) [noise=true , address=45.91.116.7:4011 , piece_id=CRCOGI3FUA3IGBNRW7D23SIAMSDKAXWS6SCR43YHLG7RDTVX6VYQ, seg_pos={0 0}, upload=63120]: Done uploading piece. err: <nil> Sep 9 13:11:19.913531544 (71h42m55.953104664s) [seg_pos={0 0}, upload=63120]: Segment reached optimal threshold of 13 pieces. Sep 9 13:11:19.913623199 (71h42m55.953196319s) [noise=true , address=45.91.116.8:4045 , piece_id=HRS3KHIKWNH2A7Z25MV4W67RGCPM4AW3FG4DNZ2DLB3UY54QRVTQ, seg_pos={0 0}, upload=63120]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: expected piece hash; context canceled; EOF Sep 9 13:11:19.913767064 (71h42m55.953340174s) [noise=true , address=145.79.227.14:4837 , piece_id=5YPJH66EDGU3KBKZU6NV3VIUEUNCXWUXEG2ISAEUO5ASV42UAA7A, seg_pos={0 0}, upload=63120]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV): protocol: write tcp 188.166.225.170:50516->145.79.227.14:4837: use of closed network connection; write tcp 188.166.225.170:50516->145.79.227.14:4837: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50516->145.79.227.14:4837: use of closed network connection Sep 9 13:11:19.913784268 (71h42m55.953357388s) [noise=true , address=77.90.31.21:4878 , piece_id=N24KLQFZCACGCW2NWZ2JM5IK7B5NE6PRHV4V7EM36GUWH4YGGWAQ, seg_pos={0 0}, upload=63120]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK): protocol: write tcp 188.166.225.170:51458->77.90.31.21:4878: use of closed network connection; write tcp 188.166.225.170:51458->77.90.31.21:4878: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51458->77.90.31.21:4878: use of closed network connection Sep 9 13:11:19.913827711 (71h42m55.953400831s) [seg_pos={0 0}, upload=63120]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 13:11:19.913892425 (71h42m55.953465545s) [upload=63120]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 13:11:19.913896603 (71h42m55.953469723s) [upload=63120]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 13:11:20.370855167 (71h42m56.410428287s) [upload=63120]: Done uploading segments... Sep 9 13:11:20.370878120 (71h42m56.41045124s) [upload=63120]: Upload finished. err: <nil> Duration: 30.001861818s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 13 out of 60 is failed (threshold=3) [.................X................XXX........XXX.XX..XXXX...] duration: 21.877692s FAIL (2025-09-09 13:11:13 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 13:08:19.171263072 (71h39m55.210836193s) [upload=63076]: Starting upload Sep 9 13:08:19.171327656 (71h39m55.210900766s) [upload=63076]: Done starting upload Sep 9 13:08:19.171404884 (71h39m55.210978014s) [upload=63076]: Uploading segments... Sep 9 13:08:19.171510306 (71h39m55.211083426s) [upload=63076]: Got next segment. Inline: false Sep 9 13:08:19.171566513 (71h39m55.211139643s) [upload=63076]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 13:08:19.171572625 (71h39m55.211145755s) [upload=63076]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 13:08:19.418622323 (71h39m55.458195443s) [seg_pos={0 0}, upload=63076]: Begin upload segment... Sep 9 13:08:19.418668421 (71h39m55.458241541s) [seg_pos={0 0}, upload=63076]: Done begin upload segment. Sep 9 13:08:19.418690584 (71h39m55.458263694s) [noise=true , address=77.90.31.18:4807 , piece_id=QQ4NVMHF3SNCSNEYLESPU7MMYO7KWB7PY536ORNXFSRW4ZEVVVZA, seg_pos={0 0}, upload=63076]: Uploading piece... Sep 9 13:08:19.418738887 (71h39m55.458312007s) [noise=true , address=45.91.116.11:4119 , piece_id=R7CKYUSMTZ4JITTITVQPA4G6PTKJM3K22K64ZNTJ6Y57775SIQSQ, seg_pos={0 0}, upload=63076]: Uploading piece... Sep 9 13:08:19.419057135 (71h39m55.458630255s) [noise=true , address=77.90.31.15:4697 , piece_id=KIKJSUEXEMMKARB52UEH6H2AFCZJLODFGFQQVBQRO5RXE3A4UR5A, seg_pos={0 0}, upload=63076]: Uploading piece... Sep 9 13:08:19.419323515 (71h39m55.458896635s) [noise=true , address=45.91.116.10:4082 , piece_id=SCISKOTOIYPS3PUOT33OQ55KTEDCPYF24MXRWBHPCZOY6FVG32LQ, seg_pos={0 0}, upload=63076]: Uploading piece... Sep 9 13:08:19.419599483 (71h39m55.459172603s) [noise=true , address=45.91.116.14:4190 , piece_id=LZNFPDZLNN6ZKEJZBGRR2FOJEGQYPRN2PSQF6ZGGCS4HJ5LINRXQ, seg_pos={0 0}, upload=63076]: Uploading piece... Sep 9 13:08:19.420033724 (71h39m55.459606844s) [noise=true , address=45.91.116.13:4155 , piece_id=PH7BJLAQZEO2345DC5NM66LYFGE2B3OICWKD57RCWLBFW6UXFW4A, seg_pos={0 0}, upload=63076]: Uploading piece... Sep 9 13:08:19.420318018 (71h39m55.459891138s) [noise=true , address=145.79.227.5:4223 , piece_id=54DZLGEA5TZT7J3E5Y6WKFQTB7TBFP36KTALNB3XHZI5NFR5RFSQ, seg_pos={0 0}, upload=63076]: Uploading piece... Sep 9 13:08:19.420594517 (71h39m55.460167627s) [noise=true , address=145.79.227.13:4804 , piece_id=GINNZNOBMZVPI73EK34UGKYZGV556TEREZLUTBR2NGG43XUH3QJA, seg_pos={0 0}, upload=63076]: Uploading piece... Sep 9 13:08:19.420821191 (71h39m55.460394311s) [noise=true , address=145.79.227.14:4837 , piece_id=2DYLX4EMTHECDUPPYR5Z3RO53OCGU5VUQZ5MWBGCYLYW56RC7IXA, seg_pos={0 0}, upload=63076]: Uploading piece... Sep 9 13:08:19.421035180 (71h39m55.460608291s) [noise=true , address=45.91.116.4:4937 , piece_id=JGZFSQ7BQ3R7RW2LIGVAOEXAVXJM37QKYNB5F4YMDPLZBQACKX5A, seg_pos={0 0}, upload=63076]: Uploading piece... Sep 9 13:08:19.421247116 (71h39m55.460820236s) [noise=true , address=45.91.116.7:4010 , piece_id=D6OHZIXDXMEMK2HYWDKMP725L6IE2QRRSJHJBZJPQ6EOM4S4572A, seg_pos={0 0}, upload=63076]: Uploading piece... Sep 9 13:08:19.421453671 (71h39m55.461026801s) [noise=true , address=45.91.116.9:4263 , piece_id=GG2E4TZWV6TNDOERCPHDZDLKJ7RWPET6JRJU2KAWBJFYP3SE5JYQ, seg_pos={0 0}, upload=63076]: Uploading piece... Sep 9 13:08:19.421646420 (71h39m55.46121954s) [noise=true , address=45.91.116.6:4974 , piece_id=2XKXJYWO4NCHZQMRA3TMNLSTZQQAZA3AJU53DW3SHL3ZXWXKWQCA, seg_pos={0 0}, upload=63076]: Uploading piece... Sep 9 13:08:19.421912038 (71h39m55.461485158s) [noise=true , address=45.91.116.12:4227 , piece_id=YFCWEHVDRYQPOXXY4VIFSV7RDJ2WBALW6Z5MQHPUJXWMQMVKOAHQ, seg_pos={0 0}, upload=63076]: Uploading piece... Sep 9 13:08:19.422114396 (71h39m55.461687516s) [noise=true , address=145.79.227.17:4972 , piece_id=6C4PKYKKJO5XPM7YVBSLHQCJO6SMANGWU3ATELAAY7ZTVPB22RDQ, seg_pos={0 0}, upload=63076]: Uploading piece... Sep 9 13:08:19.422354555 (71h39m55.461927675s) [noise=true , address=45.91.116.4:4938 , piece_id=FYLI6KNYLDYWJQV7ZBDQMIJAZGRSVTKZ4K7ITV37JF2SKIJOJO6A, seg_pos={0 0}, upload=63076]: Uploading piece... Sep 9 13:08:21.181050946 (71h39m57.220624066s) [upload=63076]: Next returned nil segment Sep 9 13:08:21.181069211 (71h39m57.220642332s) [upload=63076]: Waiting for error group managing segments... Sep 9 13:08:21.474490236 (71h39m57.514063356s) [noise=true , address=145.79.227.5:4223 , piece_id=54DZLGEA5TZT7J3E5Y6WKFQTB7TBFP36KTALNB3XHZI5NFR5RFSQ, seg_pos={0 0}, upload=63076]: Done uploading piece. err: <nil> Sep 9 13:08:21.557939596 (71h39m57.597512716s) [noise=true , address=145.79.227.17:4972 , piece_id=6C4PKYKKJO5XPM7YVBSLHQCJO6SMANGWU3ATELAAY7ZTVPB22RDQ, seg_pos={0 0}, upload=63076]: Done uploading piece. err: <nil> Sep 9 13:08:21.589287253 (71h39m57.628860373s) [noise=true , address=45.91.116.7:4010 , piece_id=D6OHZIXDXMEMK2HYWDKMP725L6IE2QRRSJHJBZJPQ6EOM4S4572A, seg_pos={0 0}, upload=63076]: Done uploading piece. err: <nil> Sep 9 13:08:21.623563235 (71h39m57.663136355s) [noise=true , address=45.91.116.14:4190 , piece_id=LZNFPDZLNN6ZKEJZBGRR2FOJEGQYPRN2PSQF6ZGGCS4HJ5LINRXQ, seg_pos={0 0}, upload=63076]: Done uploading piece. err: <nil> Sep 9 13:08:21.633603378 (71h39m57.673176498s) [noise=true , address=45.91.116.11:4119 , piece_id=R7CKYUSMTZ4JITTITVQPA4G6PTKJM3K22K64ZNTJ6Y57775SIQSQ, seg_pos={0 0}, upload=63076]: Done uploading piece. err: <nil> Sep 9 13:08:21.650727637 (71h39m57.690300757s) [noise=true , address=45.91.116.6:4974 , piece_id=2XKXJYWO4NCHZQMRA3TMNLSTZQQAZA3AJU53DW3SHL3ZXWXKWQCA, seg_pos={0 0}, upload=63076]: Done uploading piece. err: <nil> Sep 9 13:08:21.651977960 (71h39m57.69155108s) [noise=true , address=45.91.116.12:4227 , piece_id=YFCWEHVDRYQPOXXY4VIFSV7RDJ2WBALW6Z5MQHPUJXWMQMVKOAHQ, seg_pos={0 0}, upload=63076]: Done uploading piece. err: <nil> Sep 9 13:08:21.662125519 (71h39m57.701698639s) [noise=true , address=145.79.227.13:4804 , piece_id=GINNZNOBMZVPI73EK34UGKYZGV556TEREZLUTBR2NGG43XUH3QJA, seg_pos={0 0}, upload=63076]: Done uploading piece. err: <nil> Sep 9 13:08:21.667562312 (71h39m57.707135432s) [noise=true , address=77.90.31.15:4697 , piece_id=KIKJSUEXEMMKARB52UEH6H2AFCZJLODFGFQQVBQRO5RXE3A4UR5A, seg_pos={0 0}, upload=63076]: Done uploading piece. err: <nil> Sep 9 13:08:21.674854848 (71h39m57.714427968s) [noise=true , address=45.91.116.9:4263 , piece_id=GG2E4TZWV6TNDOERCPHDZDLKJ7RWPET6JRJU2KAWBJFYP3SE5JYQ, seg_pos={0 0}, upload=63076]: Done uploading piece. err: <nil> Sep 9 13:08:21.774400841 (71h39m57.813973961s) [noise=true , address=45.91.116.4:4938 , piece_id=FYLI6KNYLDYWJQV7ZBDQMIJAZGRSVTKZ4K7ITV37JF2SKIJOJO6A, seg_pos={0 0}, upload=63076]: Done uploading piece. err: <nil> Sep 9 13:08:21.806671495 (71h39m57.846244635s) [noise=true , address=77.90.31.18:4807 , piece_id=QQ4NVMHF3SNCSNEYLESPU7MMYO7KWB7PY536ORNXFSRW4ZEVVVZA, seg_pos={0 0}, upload=63076]: Done uploading piece. err: <nil> Sep 9 13:08:21.826454731 (71h39m57.866027851s) [noise=true , address=45.91.116.10:4082 , piece_id=SCISKOTOIYPS3PUOT33OQ55KTEDCPYF24MXRWBHPCZOY6FVG32LQ, seg_pos={0 0}, upload=63076]: Done uploading piece. err: <nil> Sep 9 13:08:21.826495009 (71h39m57.866068129s) [seg_pos={0 0}, upload=63076]: Segment reached optimal threshold of 13 pieces. Sep 9 13:08:21.826714008 (71h39m57.866287128s) [noise=true , address=45.91.116.4:4937 , piece_id=JGZFSQ7BQ3R7RW2LIGVAOEXAVXJM37QKYNB5F4YMDPLZBQACKX5A, seg_pos={0 0}, upload=63076]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq): protocol: expected piece hash; context canceled; EOF Sep 9 13:08:21.826795464 (71h39m57.866368584s) [noise=true , address=145.79.227.14:4837 , piece_id=2DYLX4EMTHECDUPPYR5Z3RO53OCGU5VUQZ5MWBGCYLYW56RC7IXA, seg_pos={0 0}, upload=63076]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV): protocol: write tcp 188.166.225.170:38058->145.79.227.14:4837: use of closed network connection; write tcp 188.166.225.170:38058->145.79.227.14:4837: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38058->145.79.227.14:4837: use of closed network connection Sep 9 13:08:21.826858544 (71h39m57.866431664s) [noise=true , address=45.91.116.13:4155 , piece_id=PH7BJLAQZEO2345DC5NM66LYFGE2B3OICWKD57RCWLBFW6UXFW4A, seg_pos={0 0}, upload=63076]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf): protocol: write tcp 188.166.225.170:56292->45.91.116.13:4155: use of closed network connection; write tcp 188.166.225.170:56292->45.91.116.13:4155: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56292->45.91.116.13:4155: use of closed network connection Sep 9 13:08:21.826910604 (71h39m57.866483724s) [seg_pos={0 0}, upload=63076]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 13:08:21.827000786 (71h39m57.866573896s) [upload=63076]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 13:08:21.827005405 (71h39m57.866578525s) [upload=63076]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 13:08:22.150505110 (71h39m58.190078231s) [upload=63076]: Done uploading segments... Sep 9 13:08:22.150526051 (71h39m58.190099171s) [upload=63076]: Upload finished. err: <nil> Duration: 21.877720445s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 13 out of 60 is failed (threshold=3) [..................X................XXX........XXX.XX..XXXX..] duration: 20.754646004s FAIL (2025-09-09 13:10:01 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 13:08:19.171263072 (71h39m55.210836193s) [upload=63076]: Starting upload Sep 9 13:08:19.171327656 (71h39m55.210900766s) [upload=63076]: Done starting upload Sep 9 13:08:19.171404884 (71h39m55.210978014s) [upload=63076]: Uploading segments... Sep 9 13:08:19.171510306 (71h39m55.211083426s) [upload=63076]: Got next segment. Inline: false Sep 9 13:08:19.171566513 (71h39m55.211139643s) [upload=63076]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 13:08:19.171572625 (71h39m55.211145755s) [upload=63076]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 13:08:19.418622323 (71h39m55.458195443s) [seg_pos={0 0}, upload=63076]: Begin upload segment... Sep 9 13:08:19.418668421 (71h39m55.458241541s) [seg_pos={0 0}, upload=63076]: Done begin upload segment. Sep 9 13:08:19.418690584 (71h39m55.458263694s) [noise=true , address=77.90.31.18:4807 , piece_id=QQ4NVMHF3SNCSNEYLESPU7MMYO7KWB7PY536ORNXFSRW4ZEVVVZA, seg_pos={0 0}, upload=63076]: Uploading piece... Sep 9 13:08:19.418738887 (71h39m55.458312007s) [noise=true , address=45.91.116.11:4119 , piece_id=R7CKYUSMTZ4JITTITVQPA4G6PTKJM3K22K64ZNTJ6Y57775SIQSQ, seg_pos={0 0}, upload=63076]: Uploading piece... Sep 9 13:08:19.419057135 (71h39m55.458630255s) [noise=true , address=77.90.31.15:4697 , piece_id=KIKJSUEXEMMKARB52UEH6H2AFCZJLODFGFQQVBQRO5RXE3A4UR5A, seg_pos={0 0}, upload=63076]: Uploading piece... Sep 9 13:08:19.419323515 (71h39m55.458896635s) [noise=true , address=45.91.116.10:4082 , piece_id=SCISKOTOIYPS3PUOT33OQ55KTEDCPYF24MXRWBHPCZOY6FVG32LQ, seg_pos={0 0}, upload=63076]: Uploading piece... Sep 9 13:08:19.419599483 (71h39m55.459172603s) [noise=true , address=45.91.116.14:4190 , piece_id=LZNFPDZLNN6ZKEJZBGRR2FOJEGQYPRN2PSQF6ZGGCS4HJ5LINRXQ, seg_pos={0 0}, upload=63076]: Uploading piece... Sep 9 13:08:19.420033724 (71h39m55.459606844s) [noise=true , address=45.91.116.13:4155 , piece_id=PH7BJLAQZEO2345DC5NM66LYFGE2B3OICWKD57RCWLBFW6UXFW4A, seg_pos={0 0}, upload=63076]: Uploading piece... Sep 9 13:08:19.420318018 (71h39m55.459891138s) [noise=true , address=145.79.227.5:4223 , piece_id=54DZLGEA5TZT7J3E5Y6WKFQTB7TBFP36KTALNB3XHZI5NFR5RFSQ, seg_pos={0 0}, upload=63076]: Uploading piece... Sep 9 13:08:19.420594517 (71h39m55.460167627s) [noise=true , address=145.79.227.13:4804 , piece_id=GINNZNOBMZVPI73EK34UGKYZGV556TEREZLUTBR2NGG43XUH3QJA, seg_pos={0 0}, upload=63076]: Uploading piece... Sep 9 13:08:19.420821191 (71h39m55.460394311s) [noise=true , address=145.79.227.14:4837 , piece_id=2DYLX4EMTHECDUPPYR5Z3RO53OCGU5VUQZ5MWBGCYLYW56RC7IXA, seg_pos={0 0}, upload=63076]: Uploading piece... Sep 9 13:08:19.421035180 (71h39m55.460608291s) [noise=true , address=45.91.116.4:4937 , piece_id=JGZFSQ7BQ3R7RW2LIGVAOEXAVXJM37QKYNB5F4YMDPLZBQACKX5A, seg_pos={0 0}, upload=63076]: Uploading piece... Sep 9 13:08:19.421247116 (71h39m55.460820236s) [noise=true , address=45.91.116.7:4010 , piece_id=D6OHZIXDXMEMK2HYWDKMP725L6IE2QRRSJHJBZJPQ6EOM4S4572A, seg_pos={0 0}, upload=63076]: Uploading piece... Sep 9 13:08:19.421453671 (71h39m55.461026801s) [noise=true , address=45.91.116.9:4263 , piece_id=GG2E4TZWV6TNDOERCPHDZDLKJ7RWPET6JRJU2KAWBJFYP3SE5JYQ, seg_pos={0 0}, upload=63076]: Uploading piece... Sep 9 13:08:19.421646420 (71h39m55.46121954s) [noise=true , address=45.91.116.6:4974 , piece_id=2XKXJYWO4NCHZQMRA3TMNLSTZQQAZA3AJU53DW3SHL3ZXWXKWQCA, seg_pos={0 0}, upload=63076]: Uploading piece... Sep 9 13:08:19.421912038 (71h39m55.461485158s) [noise=true , address=45.91.116.12:4227 , piece_id=YFCWEHVDRYQPOXXY4VIFSV7RDJ2WBALW6Z5MQHPUJXWMQMVKOAHQ, seg_pos={0 0}, upload=63076]: Uploading piece... Sep 9 13:08:19.422114396 (71h39m55.461687516s) [noise=true , address=145.79.227.17:4972 , piece_id=6C4PKYKKJO5XPM7YVBSLHQCJO6SMANGWU3ATELAAY7ZTVPB22RDQ, seg_pos={0 0}, upload=63076]: Uploading piece... Sep 9 13:08:19.422354555 (71h39m55.461927675s) [noise=true , address=45.91.116.4:4938 , piece_id=FYLI6KNYLDYWJQV7ZBDQMIJAZGRSVTKZ4K7ITV37JF2SKIJOJO6A, seg_pos={0 0}, upload=63076]: Uploading piece... Sep 9 13:08:21.181050946 (71h39m57.220624066s) [upload=63076]: Next returned nil segment Sep 9 13:08:21.181069211 (71h39m57.220642332s) [upload=63076]: Waiting for error group managing segments... Sep 9 13:08:21.474490236 (71h39m57.514063356s) [noise=true , address=145.79.227.5:4223 , piece_id=54DZLGEA5TZT7J3E5Y6WKFQTB7TBFP36KTALNB3XHZI5NFR5RFSQ, seg_pos={0 0}, upload=63076]: Done uploading piece. err: <nil> Sep 9 13:08:21.557939596 (71h39m57.597512716s) [noise=true , address=145.79.227.17:4972 , piece_id=6C4PKYKKJO5XPM7YVBSLHQCJO6SMANGWU3ATELAAY7ZTVPB22RDQ, seg_pos={0 0}, upload=63076]: Done uploading piece. err: <nil> Sep 9 13:08:21.589287253 (71h39m57.628860373s) [noise=true , address=45.91.116.7:4010 , piece_id=D6OHZIXDXMEMK2HYWDKMP725L6IE2QRRSJHJBZJPQ6EOM4S4572A, seg_pos={0 0}, upload=63076]: Done uploading piece. err: <nil> Sep 9 13:08:21.623563235 (71h39m57.663136355s) [noise=true , address=45.91.116.14:4190 , piece_id=LZNFPDZLNN6ZKEJZBGRR2FOJEGQYPRN2PSQF6ZGGCS4HJ5LINRXQ, seg_pos={0 0}, upload=63076]: Done uploading piece. err: <nil> Sep 9 13:08:21.633603378 (71h39m57.673176498s) [noise=true , address=45.91.116.11:4119 , piece_id=R7CKYUSMTZ4JITTITVQPA4G6PTKJM3K22K64ZNTJ6Y57775SIQSQ, seg_pos={0 0}, upload=63076]: Done uploading piece. err: <nil> Sep 9 13:08:21.650727637 (71h39m57.690300757s) [noise=true , address=45.91.116.6:4974 , piece_id=2XKXJYWO4NCHZQMRA3TMNLSTZQQAZA3AJU53DW3SHL3ZXWXKWQCA, seg_pos={0 0}, upload=63076]: Done uploading piece. err: <nil> Sep 9 13:08:21.651977960 (71h39m57.69155108s) [noise=true , address=45.91.116.12:4227 , piece_id=YFCWEHVDRYQPOXXY4VIFSV7RDJ2WBALW6Z5MQHPUJXWMQMVKOAHQ, seg_pos={0 0}, upload=63076]: Done uploading piece. err: <nil> Sep 9 13:08:21.662125519 (71h39m57.701698639s) [noise=true , address=145.79.227.13:4804 , piece_id=GINNZNOBMZVPI73EK34UGKYZGV556TEREZLUTBR2NGG43XUH3QJA, seg_pos={0 0}, upload=63076]: Done uploading piece. err: <nil> Sep 9 13:08:21.667562312 (71h39m57.707135432s) [noise=true , address=77.90.31.15:4697 , piece_id=KIKJSUEXEMMKARB52UEH6H2AFCZJLODFGFQQVBQRO5RXE3A4UR5A, seg_pos={0 0}, upload=63076]: Done uploading piece. err: <nil> Sep 9 13:08:21.674854848 (71h39m57.714427968s) [noise=true , address=45.91.116.9:4263 , piece_id=GG2E4TZWV6TNDOERCPHDZDLKJ7RWPET6JRJU2KAWBJFYP3SE5JYQ, seg_pos={0 0}, upload=63076]: Done uploading piece. err: <nil> Sep 9 13:08:21.774400841 (71h39m57.813973961s) [noise=true , address=45.91.116.4:4938 , piece_id=FYLI6KNYLDYWJQV7ZBDQMIJAZGRSVTKZ4K7ITV37JF2SKIJOJO6A, seg_pos={0 0}, upload=63076]: Done uploading piece. err: <nil> Sep 9 13:08:21.806671495 (71h39m57.846244635s) [noise=true , address=77.90.31.18:4807 , piece_id=QQ4NVMHF3SNCSNEYLESPU7MMYO7KWB7PY536ORNXFSRW4ZEVVVZA, seg_pos={0 0}, upload=63076]: Done uploading piece. err: <nil> Sep 9 13:08:21.826454731 (71h39m57.866027851s) [noise=true , address=45.91.116.10:4082 , piece_id=SCISKOTOIYPS3PUOT33OQ55KTEDCPYF24MXRWBHPCZOY6FVG32LQ, seg_pos={0 0}, upload=63076]: Done uploading piece. err: <nil> Sep 9 13:08:21.826495009 (71h39m57.866068129s) [seg_pos={0 0}, upload=63076]: Segment reached optimal threshold of 13 pieces. Sep 9 13:08:21.826714008 (71h39m57.866287128s) [noise=true , address=45.91.116.4:4937 , piece_id=JGZFSQ7BQ3R7RW2LIGVAOEXAVXJM37QKYNB5F4YMDPLZBQACKX5A, seg_pos={0 0}, upload=63076]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq): protocol: expected piece hash; context canceled; EOF Sep 9 13:08:21.826795464 (71h39m57.866368584s) [noise=true , address=145.79.227.14:4837 , piece_id=2DYLX4EMTHECDUPPYR5Z3RO53OCGU5VUQZ5MWBGCYLYW56RC7IXA, seg_pos={0 0}, upload=63076]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV): protocol: write tcp 188.166.225.170:38058->145.79.227.14:4837: use of closed network connection; write tcp 188.166.225.170:38058->145.79.227.14:4837: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38058->145.79.227.14:4837: use of closed network connection Sep 9 13:08:21.826858544 (71h39m57.866431664s) [noise=true , address=45.91.116.13:4155 , piece_id=PH7BJLAQZEO2345DC5NM66LYFGE2B3OICWKD57RCWLBFW6UXFW4A, seg_pos={0 0}, upload=63076]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf): protocol: write tcp 188.166.225.170:56292->45.91.116.13:4155: use of closed network connection; write tcp 188.166.225.170:56292->45.91.116.13:4155: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56292->45.91.116.13:4155: use of closed network connection Sep 9 13:08:21.826910604 (71h39m57.866483724s) [seg_pos={0 0}, upload=63076]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 13:08:21.827000786 (71h39m57.866573896s) [upload=63076]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 13:08:21.827005405 (71h39m57.866578525s) [upload=63076]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 13:08:22.150505110 (71h39m58.190078231s) [upload=63076]: Done uploading segments... Sep 9 13:08:22.150526051 (71h39m58.190099171s) [upload=63076]: Upload finished. err: <nil> Duration: 20.754675709s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 13 out of 60 is failed (threshold=3) [...................X................XXX........XXX.XX..XXXX.] duration: 25.875925141s FAIL (2025-09-09 13:09:14 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 13:08:19.171263072 (71h39m55.210836193s) [upload=63076]: Starting upload Sep 9 13:08:19.171327656 (71h39m55.210900766s) [upload=63076]: Done starting upload Sep 9 13:08:19.171404884 (71h39m55.210978014s) [upload=63076]: Uploading segments... Sep 9 13:08:19.171510306 (71h39m55.211083426s) [upload=63076]: Got next segment. Inline: false Sep 9 13:08:19.171566513 (71h39m55.211139643s) [upload=63076]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 13:08:19.171572625 (71h39m55.211145755s) [upload=63076]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 13:08:19.418622323 (71h39m55.458195443s) [seg_pos={0 0}, upload=63076]: Begin upload segment... Sep 9 13:08:19.418668421 (71h39m55.458241541s) [seg_pos={0 0}, upload=63076]: Done begin upload segment. Sep 9 13:08:19.418690584 (71h39m55.458263694s) [noise=true , address=77.90.31.18:4807 , piece_id=QQ4NVMHF3SNCSNEYLESPU7MMYO7KWB7PY536ORNXFSRW4ZEVVVZA, seg_pos={0 0}, upload=63076]: Uploading piece... Sep 9 13:08:19.418738887 (71h39m55.458312007s) [noise=true , address=45.91.116.11:4119 , piece_id=R7CKYUSMTZ4JITTITVQPA4G6PTKJM3K22K64ZNTJ6Y57775SIQSQ, seg_pos={0 0}, upload=63076]: Uploading piece... Sep 9 13:08:19.419057135 (71h39m55.458630255s) [noise=true , address=77.90.31.15:4697 , piece_id=KIKJSUEXEMMKARB52UEH6H2AFCZJLODFGFQQVBQRO5RXE3A4UR5A, seg_pos={0 0}, upload=63076]: Uploading piece... Sep 9 13:08:19.419323515 (71h39m55.458896635s) [noise=true , address=45.91.116.10:4082 , piece_id=SCISKOTOIYPS3PUOT33OQ55KTEDCPYF24MXRWBHPCZOY6FVG32LQ, seg_pos={0 0}, upload=63076]: Uploading piece... Sep 9 13:08:19.419599483 (71h39m55.459172603s) [noise=true , address=45.91.116.14:4190 , piece_id=LZNFPDZLNN6ZKEJZBGRR2FOJEGQYPRN2PSQF6ZGGCS4HJ5LINRXQ, seg_pos={0 0}, upload=63076]: Uploading piece... Sep 9 13:08:19.420033724 (71h39m55.459606844s) [noise=true , address=45.91.116.13:4155 , piece_id=PH7BJLAQZEO2345DC5NM66LYFGE2B3OICWKD57RCWLBFW6UXFW4A, seg_pos={0 0}, upload=63076]: Uploading piece... Sep 9 13:08:19.420318018 (71h39m55.459891138s) [noise=true , address=145.79.227.5:4223 , piece_id=54DZLGEA5TZT7J3E5Y6WKFQTB7TBFP36KTALNB3XHZI5NFR5RFSQ, seg_pos={0 0}, upload=63076]: Uploading piece... Sep 9 13:08:19.420594517 (71h39m55.460167627s) [noise=true , address=145.79.227.13:4804 , piece_id=GINNZNOBMZVPI73EK34UGKYZGV556TEREZLUTBR2NGG43XUH3QJA, seg_pos={0 0}, upload=63076]: Uploading piece... Sep 9 13:08:19.420821191 (71h39m55.460394311s) [noise=true , address=145.79.227.14:4837 , piece_id=2DYLX4EMTHECDUPPYR5Z3RO53OCGU5VUQZ5MWBGCYLYW56RC7IXA, seg_pos={0 0}, upload=63076]: Uploading piece... Sep 9 13:08:19.421035180 (71h39m55.460608291s) [noise=true , address=45.91.116.4:4937 , piece_id=JGZFSQ7BQ3R7RW2LIGVAOEXAVXJM37QKYNB5F4YMDPLZBQACKX5A, seg_pos={0 0}, upload=63076]: Uploading piece... Sep 9 13:08:19.421247116 (71h39m55.460820236s) [noise=true , address=45.91.116.7:4010 , piece_id=D6OHZIXDXMEMK2HYWDKMP725L6IE2QRRSJHJBZJPQ6EOM4S4572A, seg_pos={0 0}, upload=63076]: Uploading piece... Sep 9 13:08:19.421453671 (71h39m55.461026801s) [noise=true , address=45.91.116.9:4263 , piece_id=GG2E4TZWV6TNDOERCPHDZDLKJ7RWPET6JRJU2KAWBJFYP3SE5JYQ, seg_pos={0 0}, upload=63076]: Uploading piece... Sep 9 13:08:19.421646420 (71h39m55.46121954s) [noise=true , address=45.91.116.6:4974 , piece_id=2XKXJYWO4NCHZQMRA3TMNLSTZQQAZA3AJU53DW3SHL3ZXWXKWQCA, seg_pos={0 0}, upload=63076]: Uploading piece... Sep 9 13:08:19.421912038 (71h39m55.461485158s) [noise=true , address=45.91.116.12:4227 , piece_id=YFCWEHVDRYQPOXXY4VIFSV7RDJ2WBALW6Z5MQHPUJXWMQMVKOAHQ, seg_pos={0 0}, upload=63076]: Uploading piece... Sep 9 13:08:19.422114396 (71h39m55.461687516s) [noise=true , address=145.79.227.17:4972 , piece_id=6C4PKYKKJO5XPM7YVBSLHQCJO6SMANGWU3ATELAAY7ZTVPB22RDQ, seg_pos={0 0}, upload=63076]: Uploading piece... Sep 9 13:08:19.422354555 (71h39m55.461927675s) [noise=true , address=45.91.116.4:4938 , piece_id=FYLI6KNYLDYWJQV7ZBDQMIJAZGRSVTKZ4K7ITV37JF2SKIJOJO6A, seg_pos={0 0}, upload=63076]: Uploading piece... Sep 9 13:08:21.181050946 (71h39m57.220624066s) [upload=63076]: Next returned nil segment Sep 9 13:08:21.181069211 (71h39m57.220642332s) [upload=63076]: Waiting for error group managing segments... Sep 9 13:08:21.474490236 (71h39m57.514063356s) [noise=true , address=145.79.227.5:4223 , piece_id=54DZLGEA5TZT7J3E5Y6WKFQTB7TBFP36KTALNB3XHZI5NFR5RFSQ, seg_pos={0 0}, upload=63076]: Done uploading piece. err: <nil> Sep 9 13:08:21.557939596 (71h39m57.597512716s) [noise=true , address=145.79.227.17:4972 , piece_id=6C4PKYKKJO5XPM7YVBSLHQCJO6SMANGWU3ATELAAY7ZTVPB22RDQ, seg_pos={0 0}, upload=63076]: Done uploading piece. err: <nil> Sep 9 13:08:21.589287253 (71h39m57.628860373s) [noise=true , address=45.91.116.7:4010 , piece_id=D6OHZIXDXMEMK2HYWDKMP725L6IE2QRRSJHJBZJPQ6EOM4S4572A, seg_pos={0 0}, upload=63076]: Done uploading piece. err: <nil> Sep 9 13:08:21.623563235 (71h39m57.663136355s) [noise=true , address=45.91.116.14:4190 , piece_id=LZNFPDZLNN6ZKEJZBGRR2FOJEGQYPRN2PSQF6ZGGCS4HJ5LINRXQ, seg_pos={0 0}, upload=63076]: Done uploading piece. err: <nil> Sep 9 13:08:21.633603378 (71h39m57.673176498s) [noise=true , address=45.91.116.11:4119 , piece_id=R7CKYUSMTZ4JITTITVQPA4G6PTKJM3K22K64ZNTJ6Y57775SIQSQ, seg_pos={0 0}, upload=63076]: Done uploading piece. err: <nil> Sep 9 13:08:21.650727637 (71h39m57.690300757s) [noise=true , address=45.91.116.6:4974 , piece_id=2XKXJYWO4NCHZQMRA3TMNLSTZQQAZA3AJU53DW3SHL3ZXWXKWQCA, seg_pos={0 0}, upload=63076]: Done uploading piece. err: <nil> Sep 9 13:08:21.651977960 (71h39m57.69155108s) [noise=true , address=45.91.116.12:4227 , piece_id=YFCWEHVDRYQPOXXY4VIFSV7RDJ2WBALW6Z5MQHPUJXWMQMVKOAHQ, seg_pos={0 0}, upload=63076]: Done uploading piece. err: <nil> Sep 9 13:08:21.662125519 (71h39m57.701698639s) [noise=true , address=145.79.227.13:4804 , piece_id=GINNZNOBMZVPI73EK34UGKYZGV556TEREZLUTBR2NGG43XUH3QJA, seg_pos={0 0}, upload=63076]: Done uploading piece. err: <nil> Sep 9 13:08:21.667562312 (71h39m57.707135432s) [noise=true , address=77.90.31.15:4697 , piece_id=KIKJSUEXEMMKARB52UEH6H2AFCZJLODFGFQQVBQRO5RXE3A4UR5A, seg_pos={0 0}, upload=63076]: Done uploading piece. err: <nil> Sep 9 13:08:21.674854848 (71h39m57.714427968s) [noise=true , address=45.91.116.9:4263 , piece_id=GG2E4TZWV6TNDOERCPHDZDLKJ7RWPET6JRJU2KAWBJFYP3SE5JYQ, seg_pos={0 0}, upload=63076]: Done uploading piece. err: <nil> Sep 9 13:08:21.774400841 (71h39m57.813973961s) [noise=true , address=45.91.116.4:4938 , piece_id=FYLI6KNYLDYWJQV7ZBDQMIJAZGRSVTKZ4K7ITV37JF2SKIJOJO6A, seg_pos={0 0}, upload=63076]: Done uploading piece. err: <nil> Sep 9 13:08:21.806671495 (71h39m57.846244635s) [noise=true , address=77.90.31.18:4807 , piece_id=QQ4NVMHF3SNCSNEYLESPU7MMYO7KWB7PY536ORNXFSRW4ZEVVVZA, seg_pos={0 0}, upload=63076]: Done uploading piece. err: <nil> Sep 9 13:08:21.826454731 (71h39m57.866027851s) [noise=true , address=45.91.116.10:4082 , piece_id=SCISKOTOIYPS3PUOT33OQ55KTEDCPYF24MXRWBHPCZOY6FVG32LQ, seg_pos={0 0}, upload=63076]: Done uploading piece. err: <nil> Sep 9 13:08:21.826495009 (71h39m57.866068129s) [seg_pos={0 0}, upload=63076]: Segment reached optimal threshold of 13 pieces. Sep 9 13:08:21.826714008 (71h39m57.866287128s) [noise=true , address=45.91.116.4:4937 , piece_id=JGZFSQ7BQ3R7RW2LIGVAOEXAVXJM37QKYNB5F4YMDPLZBQACKX5A, seg_pos={0 0}, upload=63076]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq): protocol: expected piece hash; context canceled; EOF Sep 9 13:08:21.826795464 (71h39m57.866368584s) [noise=true , address=145.79.227.14:4837 , piece_id=2DYLX4EMTHECDUPPYR5Z3RO53OCGU5VUQZ5MWBGCYLYW56RC7IXA, seg_pos={0 0}, upload=63076]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV): protocol: write tcp 188.166.225.170:38058->145.79.227.14:4837: use of closed network connection; write tcp 188.166.225.170:38058->145.79.227.14:4837: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38058->145.79.227.14:4837: use of closed network connection Sep 9 13:08:21.826858544 (71h39m57.866431664s) [noise=true , address=45.91.116.13:4155 , piece_id=PH7BJLAQZEO2345DC5NM66LYFGE2B3OICWKD57RCWLBFW6UXFW4A, seg_pos={0 0}, upload=63076]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf): protocol: write tcp 188.166.225.170:56292->45.91.116.13:4155: use of closed network connection; write tcp 188.166.225.170:56292->45.91.116.13:4155: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56292->45.91.116.13:4155: use of closed network connection Sep 9 13:08:21.826910604 (71h39m57.866483724s) [seg_pos={0 0}, upload=63076]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 13:08:21.827000786 (71h39m57.866573896s) [upload=63076]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 13:08:21.827005405 (71h39m57.866578525s) [upload=63076]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 13:08:22.150505110 (71h39m58.190078231s) [upload=63076]: Done uploading segments... Sep 9 13:08:22.150526051 (71h39m58.190099171s) [upload=63076]: Upload finished. err: <nil> Duration: 25.875938997s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 13 out of 60 is failed (threshold=3) [....................X................XXX........XXX.XX..XXXX] duration: 30.002200217s FAIL (2025-09-09 13:08:48 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 13:08:19.171263072 (71h39m55.210836193s) [upload=63076]: Starting upload Sep 9 13:08:19.171327656 (71h39m55.210900766s) [upload=63076]: Done starting upload Sep 9 13:08:19.171404884 (71h39m55.210978014s) [upload=63076]: Uploading segments... Sep 9 13:08:19.171510306 (71h39m55.211083426s) [upload=63076]: Got next segment. Inline: false Sep 9 13:08:19.171566513 (71h39m55.211139643s) [upload=63076]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 13:08:19.171572625 (71h39m55.211145755s) [upload=63076]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 13:08:19.418622323 (71h39m55.458195443s) [seg_pos={0 0}, upload=63076]: Begin upload segment... Sep 9 13:08:19.418668421 (71h39m55.458241541s) [seg_pos={0 0}, upload=63076]: Done begin upload segment. Sep 9 13:08:19.418690584 (71h39m55.458263694s) [noise=true , address=77.90.31.18:4807 , piece_id=QQ4NVMHF3SNCSNEYLESPU7MMYO7KWB7PY536ORNXFSRW4ZEVVVZA, seg_pos={0 0}, upload=63076]: Uploading piece... Sep 9 13:08:19.418738887 (71h39m55.458312007s) [noise=true , address=45.91.116.11:4119 , piece_id=R7CKYUSMTZ4JITTITVQPA4G6PTKJM3K22K64ZNTJ6Y57775SIQSQ, seg_pos={0 0}, upload=63076]: Uploading piece... Sep 9 13:08:19.419057135 (71h39m55.458630255s) [noise=true , address=77.90.31.15:4697 , piece_id=KIKJSUEXEMMKARB52UEH6H2AFCZJLODFGFQQVBQRO5RXE3A4UR5A, seg_pos={0 0}, upload=63076]: Uploading piece... Sep 9 13:08:19.419323515 (71h39m55.458896635s) [noise=true , address=45.91.116.10:4082 , piece_id=SCISKOTOIYPS3PUOT33OQ55KTEDCPYF24MXRWBHPCZOY6FVG32LQ, seg_pos={0 0}, upload=63076]: Uploading piece... Sep 9 13:08:19.419599483 (71h39m55.459172603s) [noise=true , address=45.91.116.14:4190 , piece_id=LZNFPDZLNN6ZKEJZBGRR2FOJEGQYPRN2PSQF6ZGGCS4HJ5LINRXQ, seg_pos={0 0}, upload=63076]: Uploading piece... Sep 9 13:08:19.420033724 (71h39m55.459606844s) [noise=true , address=45.91.116.13:4155 , piece_id=PH7BJLAQZEO2345DC5NM66LYFGE2B3OICWKD57RCWLBFW6UXFW4A, seg_pos={0 0}, upload=63076]: Uploading piece... Sep 9 13:08:19.420318018 (71h39m55.459891138s) [noise=true , address=145.79.227.5:4223 , piece_id=54DZLGEA5TZT7J3E5Y6WKFQTB7TBFP36KTALNB3XHZI5NFR5RFSQ, seg_pos={0 0}, upload=63076]: Uploading piece... Sep 9 13:08:19.420594517 (71h39m55.460167627s) [noise=true , address=145.79.227.13:4804 , piece_id=GINNZNOBMZVPI73EK34UGKYZGV556TEREZLUTBR2NGG43XUH3QJA, seg_pos={0 0}, upload=63076]: Uploading piece... Sep 9 13:08:19.420821191 (71h39m55.460394311s) [noise=true , address=145.79.227.14:4837 , piece_id=2DYLX4EMTHECDUPPYR5Z3RO53OCGU5VUQZ5MWBGCYLYW56RC7IXA, seg_pos={0 0}, upload=63076]: Uploading piece... Sep 9 13:08:19.421035180 (71h39m55.460608291s) [noise=true , address=45.91.116.4:4937 , piece_id=JGZFSQ7BQ3R7RW2LIGVAOEXAVXJM37QKYNB5F4YMDPLZBQACKX5A, seg_pos={0 0}, upload=63076]: Uploading piece... Sep 9 13:08:19.421247116 (71h39m55.460820236s) [noise=true , address=45.91.116.7:4010 , piece_id=D6OHZIXDXMEMK2HYWDKMP725L6IE2QRRSJHJBZJPQ6EOM4S4572A, seg_pos={0 0}, upload=63076]: Uploading piece... Sep 9 13:08:19.421453671 (71h39m55.461026801s) [noise=true , address=45.91.116.9:4263 , piece_id=GG2E4TZWV6TNDOERCPHDZDLKJ7RWPET6JRJU2KAWBJFYP3SE5JYQ, seg_pos={0 0}, upload=63076]: Uploading piece... Sep 9 13:08:19.421646420 (71h39m55.46121954s) [noise=true , address=45.91.116.6:4974 , piece_id=2XKXJYWO4NCHZQMRA3TMNLSTZQQAZA3AJU53DW3SHL3ZXWXKWQCA, seg_pos={0 0}, upload=63076]: Uploading piece... Sep 9 13:08:19.421912038 (71h39m55.461485158s) [noise=true , address=45.91.116.12:4227 , piece_id=YFCWEHVDRYQPOXXY4VIFSV7RDJ2WBALW6Z5MQHPUJXWMQMVKOAHQ, seg_pos={0 0}, upload=63076]: Uploading piece... Sep 9 13:08:19.422114396 (71h39m55.461687516s) [noise=true , address=145.79.227.17:4972 , piece_id=6C4PKYKKJO5XPM7YVBSLHQCJO6SMANGWU3ATELAAY7ZTVPB22RDQ, seg_pos={0 0}, upload=63076]: Uploading piece... Sep 9 13:08:19.422354555 (71h39m55.461927675s) [noise=true , address=45.91.116.4:4938 , piece_id=FYLI6KNYLDYWJQV7ZBDQMIJAZGRSVTKZ4K7ITV37JF2SKIJOJO6A, seg_pos={0 0}, upload=63076]: Uploading piece... Sep 9 13:08:21.181050946 (71h39m57.220624066s) [upload=63076]: Next returned nil segment Sep 9 13:08:21.181069211 (71h39m57.220642332s) [upload=63076]: Waiting for error group managing segments... Sep 9 13:08:21.474490236 (71h39m57.514063356s) [noise=true , address=145.79.227.5:4223 , piece_id=54DZLGEA5TZT7J3E5Y6WKFQTB7TBFP36KTALNB3XHZI5NFR5RFSQ, seg_pos={0 0}, upload=63076]: Done uploading piece. err: <nil> Sep 9 13:08:21.557939596 (71h39m57.597512716s) [noise=true , address=145.79.227.17:4972 , piece_id=6C4PKYKKJO5XPM7YVBSLHQCJO6SMANGWU3ATELAAY7ZTVPB22RDQ, seg_pos={0 0}, upload=63076]: Done uploading piece. err: <nil> Sep 9 13:08:21.589287253 (71h39m57.628860373s) [noise=true , address=45.91.116.7:4010 , piece_id=D6OHZIXDXMEMK2HYWDKMP725L6IE2QRRSJHJBZJPQ6EOM4S4572A, seg_pos={0 0}, upload=63076]: Done uploading piece. err: <nil> Sep 9 13:08:21.623563235 (71h39m57.663136355s) [noise=true , address=45.91.116.14:4190 , piece_id=LZNFPDZLNN6ZKEJZBGRR2FOJEGQYPRN2PSQF6ZGGCS4HJ5LINRXQ, seg_pos={0 0}, upload=63076]: Done uploading piece. err: <nil> Sep 9 13:08:21.633603378 (71h39m57.673176498s) [noise=true , address=45.91.116.11:4119 , piece_id=R7CKYUSMTZ4JITTITVQPA4G6PTKJM3K22K64ZNTJ6Y57775SIQSQ, seg_pos={0 0}, upload=63076]: Done uploading piece. err: <nil> Sep 9 13:08:21.650727637 (71h39m57.690300757s) [noise=true , address=45.91.116.6:4974 , piece_id=2XKXJYWO4NCHZQMRA3TMNLSTZQQAZA3AJU53DW3SHL3ZXWXKWQCA, seg_pos={0 0}, upload=63076]: Done uploading piece. err: <nil> Sep 9 13:08:21.651977960 (71h39m57.69155108s) [noise=true , address=45.91.116.12:4227 , piece_id=YFCWEHVDRYQPOXXY4VIFSV7RDJ2WBALW6Z5MQHPUJXWMQMVKOAHQ, seg_pos={0 0}, upload=63076]: Done uploading piece. err: <nil> Sep 9 13:08:21.662125519 (71h39m57.701698639s) [noise=true , address=145.79.227.13:4804 , piece_id=GINNZNOBMZVPI73EK34UGKYZGV556TEREZLUTBR2NGG43XUH3QJA, seg_pos={0 0}, upload=63076]: Done uploading piece. err: <nil> Sep 9 13:08:21.667562312 (71h39m57.707135432s) [noise=true , address=77.90.31.15:4697 , piece_id=KIKJSUEXEMMKARB52UEH6H2AFCZJLODFGFQQVBQRO5RXE3A4UR5A, seg_pos={0 0}, upload=63076]: Done uploading piece. err: <nil> Sep 9 13:08:21.674854848 (71h39m57.714427968s) [noise=true , address=45.91.116.9:4263 , piece_id=GG2E4TZWV6TNDOERCPHDZDLKJ7RWPET6JRJU2KAWBJFYP3SE5JYQ, seg_pos={0 0}, upload=63076]: Done uploading piece. err: <nil> Sep 9 13:08:21.774400841 (71h39m57.813973961s) [noise=true , address=45.91.116.4:4938 , piece_id=FYLI6KNYLDYWJQV7ZBDQMIJAZGRSVTKZ4K7ITV37JF2SKIJOJO6A, seg_pos={0 0}, upload=63076]: Done uploading piece. err: <nil> Sep 9 13:08:21.806671495 (71h39m57.846244635s) [noise=true , address=77.90.31.18:4807 , piece_id=QQ4NVMHF3SNCSNEYLESPU7MMYO7KWB7PY536ORNXFSRW4ZEVVVZA, seg_pos={0 0}, upload=63076]: Done uploading piece. err: <nil> Sep 9 13:08:21.826454731 (71h39m57.866027851s) [noise=true , address=45.91.116.10:4082 , piece_id=SCISKOTOIYPS3PUOT33OQ55KTEDCPYF24MXRWBHPCZOY6FVG32LQ, seg_pos={0 0}, upload=63076]: Done uploading piece. err: <nil> Sep 9 13:08:21.826495009 (71h39m57.866068129s) [seg_pos={0 0}, upload=63076]: Segment reached optimal threshold of 13 pieces. Sep 9 13:08:21.826714008 (71h39m57.866287128s) [noise=true , address=45.91.116.4:4937 , piece_id=JGZFSQ7BQ3R7RW2LIGVAOEXAVXJM37QKYNB5F4YMDPLZBQACKX5A, seg_pos={0 0}, upload=63076]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq): protocol: expected piece hash; context canceled; EOF Sep 9 13:08:21.826795464 (71h39m57.866368584s) [noise=true , address=145.79.227.14:4837 , piece_id=2DYLX4EMTHECDUPPYR5Z3RO53OCGU5VUQZ5MWBGCYLYW56RC7IXA, seg_pos={0 0}, upload=63076]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV): protocol: write tcp 188.166.225.170:38058->145.79.227.14:4837: use of closed network connection; write tcp 188.166.225.170:38058->145.79.227.14:4837: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38058->145.79.227.14:4837: use of closed network connection Sep 9 13:08:21.826858544 (71h39m57.866431664s) [noise=true , address=45.91.116.13:4155 , piece_id=PH7BJLAQZEO2345DC5NM66LYFGE2B3OICWKD57RCWLBFW6UXFW4A, seg_pos={0 0}, upload=63076]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf): protocol: write tcp 188.166.225.170:56292->45.91.116.13:4155: use of closed network connection; write tcp 188.166.225.170:56292->45.91.116.13:4155: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56292->45.91.116.13:4155: use of closed network connection Sep 9 13:08:21.826910604 (71h39m57.866483724s) [seg_pos={0 0}, upload=63076]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 13:08:21.827000786 (71h39m57.866573896s) [upload=63076]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 13:08:21.827005405 (71h39m57.866578525s) [upload=63076]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 13:08:22.150505110 (71h39m58.190078231s) [upload=63076]: Done uploading segments... Sep 9 13:08:22.150526051 (71h39m58.190099171s) [upload=63076]: Upload finished. err: <nil> Duration: 30.002226779s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [.....................X................XXX........XXX.XX..XXX] duration: 30.001735072s FAIL (2025-09-09 13:07:49 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 13:07:19.703826104 (71h38m55.743399224s) [upload=63064]: Starting upload Sep 9 13:07:19.703920766 (71h38m55.743493886s) [upload=63064]: Done starting upload Sep 9 13:07:19.704018442 (71h38m55.743591562s) [upload=63064]: Uploading segments... Sep 9 13:07:19.704092985 (71h38m55.743666105s) [upload=63064]: Got next segment. Inline: false Sep 9 13:07:19.704145435 (71h38m55.743718555s) [upload=63064]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 13:07:19.704150094 (71h38m55.743723214s) [upload=63064]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 13:07:20.171307535 (71h38m56.210880655s) [seg_pos={0 0}, upload=63064]: Begin upload segment... Sep 9 13:07:20.171356068 (71h38m56.210929188s) [seg_pos={0 0}, upload=63064]: Done begin upload segment. Sep 9 13:07:20.171388330 (71h38m56.21096145s) [noise=true , address=45.91.116.11:4117 , piece_id=VCV7PDH4QOJZ5VVX2EJKX7S6LHSQLPTRN4YZJZSVMHMG4BI7WZUA, seg_pos={0 0}, upload=63064]: Uploading piece... Sep 9 13:07:20.171392678 (71h38m56.210965798s) [noise=true , address=45.91.116.6:4973 , piece_id=TRCECCNDMGOIMAJGBLMTE5NFE3MCSYDEE6YREXIQRSMB4UIINNXQ, seg_pos={0 0}, upload=63064]: Uploading piece... Sep 9 13:07:20.171445469 (71h38m56.211018589s) [noise=true , address=45.91.116.9:4263 , piece_id=OR5B5JUZZNB3HPVZMMAMAKNOKKG4MQJ3XGZVSXANZAQCPCTLYCOA, seg_pos={0 0}, upload=63064]: Uploading piece... Sep 9 13:07:20.171765782 (71h38m56.211338902s) [noise=true , address=145.79.227.5:4222 , piece_id=GV2LIIFBH7NZ7N7R5HABPZOX67YE72KH3DZTV7ZKN73WRXYYA2RA, seg_pos={0 0}, upload=63064]: Uploading piece... Sep 9 13:07:20.172058914 (71h38m56.211632034s) [noise=true , address=77.90.31.16:4734 , piece_id=YTPV53UKG5BP33PCDFHPNWUJAGVC3IQN4VO5AYBZRCBEQZX5G2QQ, seg_pos={0 0}, upload=63064]: Uploading piece... Sep 9 13:07:20.172349269 (71h38m56.211922389s) [noise=true , address=77.90.31.13:4627 , piece_id=CNGKEYJRITFTY4XZYMHAPRLKHPNCJY3QVDLENPZHPJA4C6FYUBZQ, seg_pos={0 0}, upload=63064]: Uploading piece... Sep 9 13:07:20.172661777 (71h38m56.212234897s) [noise=true , address=45.91.116.7:4009 , piece_id=66B4HDYA365MOHT3A4Z5KCO4QSRD2Z7BSWIOHS6ZSXE65NQM77EQ, seg_pos={0 0}, upload=63064]: Uploading piece... Sep 9 13:07:20.173054799 (71h38m56.212627919s) [noise=true , address=145.79.227.11:4732 , piece_id=2NFJGJTFVMCHMTACYE6NKQWP72SCDQSITKDZRBOICM76PBAQJFTA, seg_pos={0 0}, upload=63064]: Uploading piece... Sep 9 13:07:20.173307522 (71h38m56.212880642s) [noise=true , address=77.90.31.15:4699 , piece_id=KTOXQVIOLRJHSINXUMBXNTSOFT26UU6D5JPYMOLUZKCFW7UOHD7A, seg_pos={0 0}, upload=63064]: Uploading piece... Sep 9 13:07:20.173667561 (71h38m56.213240681s) [noise=true , address=77.90.31.19:4841 , piece_id=O2YPLA6XX34SZARIEYYEBKKE7ITUJYOKJ6JKUJMN6D7DDWLE4YMQ, seg_pos={0 0}, upload=63064]: Uploading piece... Sep 9 13:07:20.173993855 (71h38m56.213566965s) [noise=true , address=77.90.31.18:4806 , piece_id=TZ5AJ7HREJCTKVV2MSSE3MSPQCFOXDDJ6CRAHG7Y4R5CWLV52Q7A, seg_pos={0 0}, upload=63064]: Uploading piece... Sep 9 13:07:20.174220379 (71h38m56.2137935s) [noise=true , address=45.91.116.5:4299 , piece_id=OWUPASJOETC2PTAIXPT4G26NUMOQCTO6LXJUCRYGGAR2JCINICTA, seg_pos={0 0}, upload=63064]: Uploading piece... Sep 9 13:07:20.174546213 (71h38m56.214119333s) [noise=true , address=77.90.31.19:4842 , piece_id=4TQCII2J33UW5JF3WZXPYTRVO5M7ILIYTKG7U6KNWNOEZ7XDJHKA, seg_pos={0 0}, upload=63064]: Uploading piece... Sep 9 13:07:20.174828643 (71h38m56.214401763s) [noise=true , address=77.90.31.14:4663 , piece_id=FUKIWFN5O26TFVXMHBCWGMGNY73U3GV4MS52GAN7T7YEFPULTDDQ, seg_pos={0 0}, upload=63064]: Uploading piece... Sep 9 13:07:20.174839604 (71h38m56.214412724s) [noise=true , address=77.90.31.10:4519 , piece_id=BWXLPKDQEGXXLSJNOBUCR5I35PUDXIIAPQURXE4R4DTTBM5WVFFQ, seg_pos={0 0}, upload=63064]: Uploading piece... Sep 9 13:07:20.175061700 (71h38m56.21463482s) [noise=true , address=45.91.116.8:4048 , piece_id=ONRUIUJQ2X2F5WNV35KFESYHNKZCA3GV5MB5SNU4AEAV4YFBJVLQ, seg_pos={0 0}, upload=63064]: Uploading piece... Sep 9 13:07:22.068438265 (71h38m58.108011385s) [upload=63064]: Next returned nil segment Sep 9 13:07:22.068460708 (71h38m58.108033828s) [upload=63064]: Waiting for error group managing segments... Sep 9 13:07:22.382719750 (71h38m58.42229287s) [noise=true , address=77.90.31.14:4663 , piece_id=FUKIWFN5O26TFVXMHBCWGMGNY73U3GV4MS52GAN7T7YEFPULTDDQ, seg_pos={0 0}, upload=63064]: Done uploading piece. err: <nil> Sep 9 13:07:22.386334446 (71h38m58.425907556s) [noise=true , address=77.90.31.13:4627 , piece_id=CNGKEYJRITFTY4XZYMHAPRLKHPNCJY3QVDLENPZHPJA4C6FYUBZQ, seg_pos={0 0}, upload=63064]: Done uploading piece. err: <nil> Sep 9 13:07:22.390662449 (71h38m58.430235569s) [noise=true , address=45.91.116.6:4973 , piece_id=TRCECCNDMGOIMAJGBLMTE5NFE3MCSYDEE6YREXIQRSMB4UIINNXQ, seg_pos={0 0}, upload=63064]: Done uploading piece. err: <nil> Sep 9 13:07:22.398484818 (71h38m58.438057928s) [noise=true , address=45.91.116.5:4299 , piece_id=OWUPASJOETC2PTAIXPT4G26NUMOQCTO6LXJUCRYGGAR2JCINICTA, seg_pos={0 0}, upload=63064]: Done uploading piece. err: <nil> Sep 9 13:07:22.424991031 (71h38m58.464564141s) [noise=true , address=145.79.227.11:4732 , piece_id=2NFJGJTFVMCHMTACYE6NKQWP72SCDQSITKDZRBOICM76PBAQJFTA, seg_pos={0 0}, upload=63064]: Done uploading piece. err: <nil> Sep 9 13:07:22.448266812 (71h38m58.487839922s) [noise=true , address=77.90.31.19:4841 , piece_id=O2YPLA6XX34SZARIEYYEBKKE7ITUJYOKJ6JKUJMN6D7DDWLE4YMQ, seg_pos={0 0}, upload=63064]: Done uploading piece. err: <nil> Sep 9 13:07:22.448340974 (71h38m58.487914094s) [noise=true , address=45.91.116.7:4009 , piece_id=66B4HDYA365MOHT3A4Z5KCO4QSRD2Z7BSWIOHS6ZSXE65NQM77EQ, seg_pos={0 0}, upload=63064]: Done uploading piece. err: <nil> Sep 9 13:07:22.464923806 (71h38m58.504496926s) [noise=true , address=77.90.31.18:4806 , piece_id=TZ5AJ7HREJCTKVV2MSSE3MSPQCFOXDDJ6CRAHG7Y4R5CWLV52Q7A, seg_pos={0 0}, upload=63064]: Done uploading piece. err: <nil> Sep 9 13:07:22.473562297 (71h38m58.513135417s) [noise=true , address=77.90.31.15:4699 , piece_id=KTOXQVIOLRJHSINXUMBXNTSOFT26UU6D5JPYMOLUZKCFW7UOHD7A, seg_pos={0 0}, upload=63064]: Done uploading piece. err: <nil> Sep 9 13:07:22.474425269 (71h38m58.513998389s) [noise=true , address=77.90.31.10:4519 , piece_id=BWXLPKDQEGXXLSJNOBUCR5I35PUDXIIAPQURXE4R4DTTBM5WVFFQ, seg_pos={0 0}, upload=63064]: Done uploading piece. err: <nil> Sep 9 13:07:22.557744701 (71h38m58.597317821s) [noise=true , address=77.90.31.19:4842 , piece_id=4TQCII2J33UW5JF3WZXPYTRVO5M7ILIYTKG7U6KNWNOEZ7XDJHKA, seg_pos={0 0}, upload=63064]: Done uploading piece. err: <nil> Sep 9 13:07:23.072897545 (71h38m59.112470665s) [noise=true , address=45.91.116.9:4263 , piece_id=OR5B5JUZZNB3HPVZMMAMAKNOKKG4MQJ3XGZVSXANZAQCPCTLYCOA, seg_pos={0 0}, upload=63064]: Done uploading piece. err: <nil> Sep 9 13:07:23.966407268 (71h39m0.005980378s) [noise=true , address=77.90.31.16:4734 , piece_id=YTPV53UKG5BP33PCDFHPNWUJAGVC3IQN4VO5AYBZRCBEQZX5G2QQ, seg_pos={0 0}, upload=63064]: Done uploading piece. err: <nil> Sep 9 13:07:23.966434600 (71h39m0.00600771s) [seg_pos={0 0}, upload=63064]: Segment reached optimal threshold of 13 pieces. Sep 9 13:07:23.966599065 (71h39m0.006172185s) [noise=true , address=145.79.227.5:4222 , piece_id=GV2LIIFBH7NZ7N7R5HABPZOX67YE72KH3DZTV7ZKN73WRXYYA2RA, seg_pos={0 0}, upload=63064]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1): protocol: expected piece hash; context canceled; EOF Sep 9 13:07:23.966610126 (71h39m0.006183246s) [noise=true , address=45.91.116.8:4048 , piece_id=ONRUIUJQ2X2F5WNV35KFESYHNKZCA3GV5MB5SNU4AEAV4YFBJVLQ, seg_pos={0 0}, upload=63064]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Sep 9 13:07:23.966640124 (71h39m0.006213244s) [noise=true , address=45.91.116.11:4117 , piece_id=VCV7PDH4QOJZ5VVX2EJKX7S6LHSQLPTRN4YZJZSVMHMG4BI7WZUA, seg_pos={0 0}, upload=63064]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:35632->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:35632->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35632->45.91.116.11:4117: use of closed network connection Sep 9 13:07:23.966649792 (71h39m0.006222912s) [seg_pos={0 0}, upload=63064]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 13:07:23.966702172 (71h39m0.006275292s) [upload=63064]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 13:07:23.966706430 (71h39m0.00627954s) [upload=63064]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 13:07:24.299977033 (71h39m0.339550153s) [upload=63064]: Done uploading segments... Sep 9 13:07:24.300000418 (71h39m0.339573548s) [upload=63064]: Upload finished. err: <nil> Duration: 30.0017497s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 11 out of 60 is failed (threshold=3) [......................X................XXX........XXX.XX..XX] duration: 30.002062369s FAIL (2025-09-09 13:07:18 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 13:06:49.506878733 (71h38m25.546451853s) [upload=63054]: Starting upload Sep 9 13:06:49.506954227 (71h38m25.546527347s) [upload=63054]: Done starting upload Sep 9 13:06:49.507104025 (71h38m25.546677145s) [upload=63054]: Uploading segments... Sep 9 13:06:49.507193886 (71h38m25.546766996s) [upload=63054]: Got next segment. Inline: false Sep 9 13:06:49.507239794 (71h38m25.546812914s) [upload=63054]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 13:06:49.507245024 (71h38m25.546818144s) [upload=63054]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 13:06:50.004339611 (71h38m26.043912761s) [seg_pos={0 0}, upload=63054]: Begin upload segment... Sep 9 13:06:50.004399226 (71h38m26.043972346s) [seg_pos={0 0}, upload=63054]: Done begin upload segment. Sep 9 13:06:50.004448379 (71h38m26.0440215s) [noise=true , address=77.90.31.15:4699 , piece_id=CC6DD3NKFBNODD76DL6YB7JZFMRBKUMIHCZCED45MW4TE5JJDXTQ, seg_pos={0 0}, upload=63054]: Uploading piece... Sep 9 13:06:50.004497063 (71h38m26.044070193s) [noise=true , address=45.91.116.8:4048 , piece_id=LS2ORVT3HX3EMAS3NBRBBNXYRS7DDY5QRV7LR3JO3U4LP2TLFGCQ, seg_pos={0 0}, upload=63054]: Uploading piece... Sep 9 13:06:50.005007380 (71h38m26.0445805s) [noise=true , address=45.91.116.5:4299 , piece_id=Z6YEJ65CMFS7CCC7M37Q5HRXIV67BG5GJ2XZY35F2BY6SBCGGRDA, seg_pos={0 0}, upload=63054]: Uploading piece... Sep 9 13:06:50.005138972 (71h38m26.044712092s) [noise=true , address=45.91.116.9:4261 , piece_id=2FB2TTHCCANF5T63NHJDGRIRF3RPYHEUXU22FSPAAWWAKQTFVTBQ, seg_pos={0 0}, upload=63054]: Uploading piece... Sep 9 13:06:50.005426461 (71h38m26.044999591s) [noise=true , address=45.91.116.13:4155 , piece_id=TCI3LAL3BKK43MFHVSDWFP7XC4TOM4YUWYIAQ3C45PU5NN2FVXMQ, seg_pos={0 0}, upload=63054]: Uploading piece... Sep 9 13:06:50.005438004 (71h38m26.045011124s) [noise=true , address=145.79.227.7:4294 , piece_id=V7PTBVVU7JFEYYWGM3M7RYZGMPGEDSLA6WZTGXLCCAFWMA535A6Q, seg_pos={0 0}, upload=63054]: Uploading piece... Sep 9 13:06:50.005665158 (71h38m26.045238278s) [noise=true , address=145.79.227.5:4221 , piece_id=DBBPPDFMBCPPQR556SQ5ETBZMTHXR3ZXQOHBIM4N5LXWI6TKLFUA, seg_pos={0 0}, upload=63054]: Uploading piece... Sep 9 13:06:50.005835233 (71h38m26.045408354s) [noise=true , address=77.90.31.18:4807 , piece_id=PFJF2ZUWEBYZMPFCONZA7M7ZY7LIPJYTLHVOPSW2YNNOJNCYZWYQ, seg_pos={0 0}, upload=63054]: Uploading piece... Sep 9 13:06:50.006026550 (71h38m26.0455997s) [noise=true , address=145.79.227.17:4969 , piece_id=APMEI5SACJRTHXYF24QMIUE3YLE3K26ZJRBN74TM7JGRHREDYSOQ, seg_pos={0 0}, upload=63054]: Uploading piece... Sep 9 13:06:50.006516096 (71h38m26.046089216s) [noise=true , address=45.91.116.6:4974 , piece_id=JGNJYJMM2MCGXX6U7G4CJHRCDWZ5VWTJBJHLQDVNUZOY3NFE3HUQ, seg_pos={0 0}, upload=63054]: Uploading piece... Sep 9 13:06:50.006811392 (71h38m26.046384512s) [noise=true , address=77.90.31.13:4627 , piece_id=HZ7ERRHZ5I3V2UHBZTHF5RTFAEYYRBLC5CMCBBOP6T34GOGDYFAQ, seg_pos={0 0}, upload=63054]: Uploading piece... Sep 9 13:06:50.007035911 (71h38m26.046609031s) [noise=true , address=45.91.116.4:4939 , piece_id=3RCLMG5YUNAXDPWYVZZF75FECEP4NV4JRODRRXCLXADEJQHNT7EQ, seg_pos={0 0}, upload=63054]: Uploading piece... Sep 9 13:06:50.007360162 (71h38m26.046933282s) [noise=true , address=145.79.227.16:4912 , piece_id=IVV4CVJ2PVPBJ2JFSB7HHOMSMPMN24QKDWSROSDRZPOXBIZEJ6TA, seg_pos={0 0}, upload=63054]: Uploading piece... Sep 9 13:06:50.007598819 (71h38m26.047171939s) [noise=true , address=45.91.116.12:4225 , piece_id=XYOI6NJXOE35VLWEJSH4MZ6OG3FYQWPQZBJ5F7EHGNIX23ZGDVAQ, seg_pos={0 0}, upload=63054]: Uploading piece... Sep 9 13:06:50.007883132 (71h38m26.047456252s) [noise=true , address=145.79.227.3:4150 , piece_id=WRBCJAWGQGZYNSELKP6SE5TNY356JLUWEQ2M54IDTVQSUOFB34DA, seg_pos={0 0}, upload=63054]: Uploading piece... Sep 9 13:06:50.008105047 (71h38m26.047678167s) [noise=true , address=145.79.227.11:4732 , piece_id=MCWJSUTOGWGXJQ7NWQZWCAI7OSRXCRBVSL6YVREO5E6FGCN7YRIA, seg_pos={0 0}, upload=63054]: Uploading piece... Sep 9 13:06:51.780836337 (71h38m27.820409457s) [upload=63054]: Next returned nil segment Sep 9 13:06:51.780852437 (71h38m27.820425557s) [upload=63054]: Waiting for error group managing segments... Sep 9 13:06:52.155147996 (71h38m28.194721106s) [noise=true , address=145.79.227.16:4912 , piece_id=IVV4CVJ2PVPBJ2JFSB7HHOMSMPMN24QKDWSROSDRZPOXBIZEJ6TA, seg_pos={0 0}, upload=63054]: Done uploading piece. err: <nil> Sep 9 13:06:52.223966096 (71h38m28.263539216s) [noise=true , address=45.91.116.4:4939 , piece_id=3RCLMG5YUNAXDPWYVZZF75FECEP4NV4JRODRRXCLXADEJQHNT7EQ, seg_pos={0 0}, upload=63054]: Done uploading piece. err: <nil> Sep 9 13:06:52.226585479 (71h38m28.266158589s) [noise=true , address=45.91.116.13:4155 , piece_id=TCI3LAL3BKK43MFHVSDWFP7XC4TOM4YUWYIAQ3C45PU5NN2FVXMQ, seg_pos={0 0}, upload=63054]: Done uploading piece. err: <nil> Sep 9 13:06:52.243653862 (71h38m28.283227002s) [noise=true , address=45.91.116.5:4299 , piece_id=Z6YEJ65CMFS7CCC7M37Q5HRXIV67BG5GJ2XZY35F2BY6SBCGGRDA, seg_pos={0 0}, upload=63054]: Done uploading piece. err: <nil> Sep 9 13:06:52.245814226 (71h38m28.285387346s) [noise=true , address=45.91.116.6:4974 , piece_id=JGNJYJMM2MCGXX6U7G4CJHRCDWZ5VWTJBJHLQDVNUZOY3NFE3HUQ, seg_pos={0 0}, upload=63054]: Done uploading piece. err: <nil> Sep 9 13:06:52.251223497 (71h38m28.290796617s) [noise=true , address=45.91.116.9:4261 , piece_id=2FB2TTHCCANF5T63NHJDGRIRF3RPYHEUXU22FSPAAWWAKQTFVTBQ, seg_pos={0 0}, upload=63054]: Done uploading piece. err: <nil> Sep 9 13:06:52.251347935 (71h38m28.290921055s) [noise=true , address=45.91.116.12:4225 , piece_id=XYOI6NJXOE35VLWEJSH4MZ6OG3FYQWPQZBJ5F7EHGNIX23ZGDVAQ, seg_pos={0 0}, upload=63054]: Done uploading piece. err: <nil> Sep 9 13:06:52.251993431 (71h38m28.291566551s) [noise=true , address=45.91.116.8:4048 , piece_id=LS2ORVT3HX3EMAS3NBRBBNXYRS7DDY5QRV7LR3JO3U4LP2TLFGCQ, seg_pos={0 0}, upload=63054]: Done uploading piece. err: <nil> Sep 9 13:06:52.266991191 (71h38m28.306564311s) [noise=true , address=77.90.31.18:4807 , piece_id=PFJF2ZUWEBYZMPFCONZA7M7ZY7LIPJYTLHVOPSW2YNNOJNCYZWYQ, seg_pos={0 0}, upload=63054]: Done uploading piece. err: <nil> Sep 9 13:06:52.282083382 (71h38m28.321656502s) [noise=true , address=145.79.227.17:4969 , piece_id=APMEI5SACJRTHXYF24QMIUE3YLE3K26ZJRBN74TM7JGRHREDYSOQ, seg_pos={0 0}, upload=63054]: Done uploading piece. err: <nil> Sep 9 13:06:52.418519057 (71h38m28.458092177s) [noise=true , address=77.90.31.15:4699 , piece_id=CC6DD3NKFBNODD76DL6YB7JZFMRBKUMIHCZCED45MW4TE5JJDXTQ, seg_pos={0 0}, upload=63054]: Done uploading piece. err: <nil> Sep 9 13:06:52.937167060 (71h38m28.97674019s) [noise=true , address=145.79.227.5:4221 , piece_id=DBBPPDFMBCPPQR556SQ5ETBZMTHXR3ZXQOHBIM4N5LXWI6TKLFUA, seg_pos={0 0}, upload=63054]: Done uploading piece. err: <nil> Sep 9 13:06:53.005328135 (71h38m29.044901255s) [noise=true , address=145.79.227.11:4732 , piece_id=MCWJSUTOGWGXJQ7NWQZWCAI7OSRXCRBVSL6YVREO5E6FGCN7YRIA, seg_pos={0 0}, upload=63054]: Done uploading piece. err: <nil> Sep 9 13:06:53.005352902 (71h38m29.044926022s) [seg_pos={0 0}, upload=63054]: Segment reached optimal threshold of 13 pieces. Sep 9 13:06:53.005623250 (71h38m29.04519638s) [noise=true , address=145.79.227.3:4150 , piece_id=WRBCJAWGQGZYNSELKP6SE5TNY356JLUWEQ2M54IDTVQSUOFB34DA, seg_pos={0 0}, upload=63054]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK): protocol: write tcp 188.166.225.170:39990->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:39990->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39990->145.79.227.3:4150: use of closed network connection Sep 9 13:06:53.005638709 (71h38m29.045211829s) [noise=true , address=77.90.31.13:4627 , piece_id=HZ7ERRHZ5I3V2UHBZTHF5RTFAEYYRBLC5CMCBBOP6T34GOGDYFAQ, seg_pos={0 0}, upload=63054]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB): protocol: expected piece hash; context canceled; EOF Sep 9 13:06:53.005702411 (71h38m29.045275541s) [noise=true , address=145.79.227.7:4294 , piece_id=V7PTBVVU7JFEYYWGM3M7RYZGMPGEDSLA6WZTGXLCCAFWMA535A6Q, seg_pos={0 0}, upload=63054]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: write tcp 188.166.225.170:33238->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:33238->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33238->145.79.227.7:4294: use of closed network connection Sep 9 13:06:53.005731868 (71h38m29.045304988s) [seg_pos={0 0}, upload=63054]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 13:06:53.005841067 (71h38m29.045414187s) [upload=63054]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 13:06:53.005846006 (71h38m29.045419126s) [upload=63054]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 13:06:53.338766848 (71h38m29.378339968s) [upload=63054]: Done uploading segments... Sep 9 13:06:53.338788590 (71h38m29.37836172s) [upload=63054]: Upload finished. err: <nil> Duration: 30.002086786s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 10 out of 60 is failed (threshold=3) [.......................X................XXX........XXX.XX..X] duration: 30.002200007s FAIL (2025-09-09 13:06:41 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 13:06:12.235706174 (71h37m48.275279294s) [upload=63047]: Starting upload Sep 9 13:06:12.235783531 (71h37m48.275356701s) [upload=63047]: Done starting upload Sep 9 13:06:12.235870649 (71h37m48.275443769s) [upload=63047]: Uploading segments... Sep 9 13:06:12.236049410 (71h37m48.27562253s) [upload=63047]: Got next segment. Inline: false Sep 9 13:06:12.236078886 (71h37m48.275652006s) [upload=63047]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 13:06:12.236083796 (71h37m48.275656916s) [upload=63047]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 13:06:14.060551810 (71h37m50.10012495s) [seg_pos={0 0}, upload=63047]: Begin upload segment... Sep 9 13:06:14.060633706 (71h37m50.100206826s) [seg_pos={0 0}, upload=63047]: Done begin upload segment. Sep 9 13:06:14.060671119 (71h37m50.100244239s) [noise=true , address=45.91.116.10:4082 , piece_id=6G6YQ26KMTFH4G7WIO4IJTWHMJQJZKBBWFGONVJMK5JPNHAOMCXA, seg_pos={0 0}, upload=63047]: Uploading piece... Sep 9 13:06:14.060693881 (71h37m50.100267011s) [noise=true , address=77.90.31.21:4877 , piece_id=WBPGUVFPHKOZKWCBL46GQ67DBYCYSVUCRI6DLHA26JGLPRRLWV6Q, seg_pos={0 0}, upload=63047]: Uploading piece... Sep 9 13:06:14.061197245 (71h37m50.100770365s) [noise=true , address=45.91.116.11:4117 , piece_id=4BPCLYX4HWQNGOMD6Y5AZATR3MGN2D4SZXIRUHX6MIOVT6PZGIAQ, seg_pos={0 0}, upload=63047]: Uploading piece... Sep 9 13:06:14.061235207 (71h37m50.100808327s) [noise=true , address=45.91.116.4:4940 , piece_id=IJSM7FY3GSQX2KSKCDQHH4KLNDBASOOAQSKFDEPGPOA6S73OMCEA, seg_pos={0 0}, upload=63047]: Uploading piece... Sep 9 13:06:14.061516536 (71h37m50.101089656s) [noise=true , address=45.91.116.10:4083 , piece_id=U5HIJN3K2S2UYTCGIOSSYYXBJ4SLFU3VJG4O7GN7EHDA4ZS5ZQWA, seg_pos={0 0}, upload=63047]: Uploading piece... Sep 9 13:06:14.061601188 (71h37m50.101174328s) [noise=true , address=145.79.227.3:4150 , piece_id=G7LNW3FJMQXHIOXXXEZMQXOGDC6QX5ZM7YGOEJF3LUEJGRNHNAUA, seg_pos={0 0}, upload=63047]: Uploading piece... Sep 9 13:06:14.061845927 (71h37m50.101419047s) [noise=true , address=45.91.116.14:4189 , piece_id=NBB74CH3HMRK35SWDBSFVYWE6I63RBBULKKQNJI5VR6KO3ICODIQ, seg_pos={0 0}, upload=63047]: Uploading piece... Sep 9 13:06:14.062241172 (71h37m50.101814293s) [noise=true , address=145.79.227.15:4873 , piece_id=CUPVBKT3PJCY7TIKVSSAUKZXVAVXE5GWBVM5RYIGJC7HNJV763ZQ, seg_pos={0 0}, upload=63047]: Uploading piece... Sep 9 13:06:14.062464249 (71h37m50.102037369s) [noise=true , address=45.91.116.9:4262 , piece_id=W4EWYZDANCV3SBKHILMNWX4POSI7LML5X2XESVMRNZZQMITJKAQQ, seg_pos={0 0}, upload=63047]: Uploading piece... Sep 9 13:06:14.062719358 (71h37m50.102292478s) [noise=true , address=145.79.227.17:4972 , piece_id=3H2F5RZEXSJKXE3OXI7JTLATL5UDGPAIZ6I75JUK6QZ3F3TBXNEQ, seg_pos={0 0}, upload=63047]: Uploading piece... Sep 9 13:06:14.062994514 (71h37m50.102567635s) [noise=true , address=77.90.31.10:4519 , piece_id=JGFIV7DVAQPDZ5RU2RTSC54TEJ6572D2PDYCJU7KGSGA5WGHUVWQ, seg_pos={0 0}, upload=63047]: Uploading piece... Sep 9 13:06:14.063311651 (71h37m50.102884781s) [noise=true , address=45.91.116.5:4297 , piece_id=EAN2L2V7IO4RRPCIAOCQHTHASFJOHFEBNSU3QOXVCHVQGQDLYF5Q, seg_pos={0 0}, upload=63047]: Uploading piece... Sep 9 13:06:14.063511604 (71h37m50.103084724s) [noise=true , address=77.90.31.17:4771 , piece_id=3YX747427FXGGAXQW3MHY7TTBH63CSYJCO2SCTQJZBL6JWTFGPEA, seg_pos={0 0}, upload=63047]: Uploading piece... Sep 9 13:06:14.063760480 (71h37m50.1033336s) [noise=true , address=45.91.116.4:4939 , piece_id=6U5TIPNEVLRRIXW747LAG667H2WGXFX4G32HPEQ3QHUA4ERW2S5Q, seg_pos={0 0}, upload=63047]: Uploading piece... Sep 9 13:06:14.063980281 (71h37m50.103553401s) [noise=true , address=45.91.116.12:4225 , piece_id=OPHWXJX3T7G37QVCGCGHUU3S7FTV4D53ESINSRA5LMZVWKLOCCGA, seg_pos={0 0}, upload=63047]: Uploading piece... Sep 9 13:06:14.064310753 (71h37m50.103883873s) [noise=true , address=45.91.116.11:4119 , piece_id=B6ATRXRI5UO6PNXDDH6QN3KWKMAQHNWZSKSPZCKHPM3572XWTH7A, seg_pos={0 0}, upload=63047]: Uploading piece... Sep 9 13:06:15.889917886 (71h37m51.929491006s) [upload=63047]: Next returned nil segment Sep 9 13:06:15.889942352 (71h37m51.929515472s) [upload=63047]: Waiting for error group managing segments... Sep 9 13:06:16.248782886 (71h37m52.288356006s) [noise=true , address=145.79.227.3:4150 , piece_id=G7LNW3FJMQXHIOXXXEZMQXOGDC6QX5ZM7YGOEJF3LUEJGRNHNAUA, seg_pos={0 0}, upload=63047]: Done uploading piece. err: <nil> Sep 9 13:06:16.268598966 (71h37m52.308172086s) [noise=true , address=45.91.116.5:4297 , piece_id=EAN2L2V7IO4RRPCIAOCQHTHASFJOHFEBNSU3QOXVCHVQGQDLYF5Q, seg_pos={0 0}, upload=63047]: Done uploading piece. err: <nil> Sep 9 13:06:16.269044418 (71h37m52.308617538s) [noise=true , address=45.91.116.10:4083 , piece_id=U5HIJN3K2S2UYTCGIOSSYYXBJ4SLFU3VJG4O7GN7EHDA4ZS5ZQWA, seg_pos={0 0}, upload=63047]: Done uploading piece. err: <nil> Sep 9 13:06:16.276211543 (71h37m52.315784664s) [noise=true , address=45.91.116.11:4119 , piece_id=B6ATRXRI5UO6PNXDDH6QN3KWKMAQHNWZSKSPZCKHPM3572XWTH7A, seg_pos={0 0}, upload=63047]: Done uploading piece. err: <nil> Sep 9 13:06:16.276654722 (71h37m52.316227842s) [noise=true , address=45.91.116.14:4189 , piece_id=NBB74CH3HMRK35SWDBSFVYWE6I63RBBULKKQNJI5VR6KO3ICODIQ, seg_pos={0 0}, upload=63047]: Done uploading piece. err: <nil> Sep 9 13:06:16.290028825 (71h37m52.329601955s) [noise=true , address=45.91.116.9:4262 , piece_id=W4EWYZDANCV3SBKHILMNWX4POSI7LML5X2XESVMRNZZQMITJKAQQ, seg_pos={0 0}, upload=63047]: Done uploading piece. err: <nil> Sep 9 13:06:16.292095850 (71h37m52.33166898s) [noise=true , address=45.91.116.4:4940 , piece_id=IJSM7FY3GSQX2KSKCDQHH4KLNDBASOOAQSKFDEPGPOA6S73OMCEA, seg_pos={0 0}, upload=63047]: Done uploading piece. err: <nil> Sep 9 13:06:16.292614102 (71h37m52.332187222s) [noise=true , address=145.79.227.15:4873 , piece_id=CUPVBKT3PJCY7TIKVSSAUKZXVAVXE5GWBVM5RYIGJC7HNJV763ZQ, seg_pos={0 0}, upload=63047]: Done uploading piece. err: <nil> Sep 9 13:06:16.306594876 (71h37m52.346167996s) [noise=true , address=45.91.116.4:4939 , piece_id=6U5TIPNEVLRRIXW747LAG667H2WGXFX4G32HPEQ3QHUA4ERW2S5Q, seg_pos={0 0}, upload=63047]: Done uploading piece. err: <nil> Sep 9 13:06:16.307374979 (71h37m52.346948099s) [noise=true , address=77.90.31.17:4771 , piece_id=3YX747427FXGGAXQW3MHY7TTBH63CSYJCO2SCTQJZBL6JWTFGPEA, seg_pos={0 0}, upload=63047]: Done uploading piece. err: <nil> Sep 9 13:06:16.324224212 (71h37m52.363797342s) [noise=true , address=77.90.31.10:4519 , piece_id=JGFIV7DVAQPDZ5RU2RTSC54TEJ6572D2PDYCJU7KGSGA5WGHUVWQ, seg_pos={0 0}, upload=63047]: Done uploading piece. err: <nil> Sep 9 13:06:16.337156419 (71h37m52.376729539s) [noise=true , address=145.79.227.17:4972 , piece_id=3H2F5RZEXSJKXE3OXI7JTLATL5UDGPAIZ6I75JUK6QZ3F3TBXNEQ, seg_pos={0 0}, upload=63047]: Done uploading piece. err: <nil> Sep 9 13:06:16.363774084 (71h37m52.403347204s) [noise=true , address=45.91.116.11:4117 , piece_id=4BPCLYX4HWQNGOMD6Y5AZATR3MGN2D4SZXIRUHX6MIOVT6PZGIAQ, seg_pos={0 0}, upload=63047]: Done uploading piece. err: <nil> Sep 9 13:06:16.363805185 (71h37m52.403378305s) [seg_pos={0 0}, upload=63047]: Segment reached optimal threshold of 13 pieces. Sep 9 13:06:16.363987373 (71h37m52.403560493s) [noise=true , address=45.91.116.10:4082 , piece_id=6G6YQ26KMTFH4G7WIO4IJTWHMJQJZKBBWFGONVJMK5JPNHAOMCXA, seg_pos={0 0}, upload=63047]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF Sep 9 13:06:16.364086212 (71h37m52.403659342s) [noise=true , address=45.91.116.12:4225 , piece_id=OPHWXJX3T7G37QVCGCGHUU3S7FTV4D53ESINSRA5LMZVWKLOCCGA, seg_pos={0 0}, upload=63047]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy): protocol: expected piece hash; context canceled; EOF Sep 9 13:06:16.364101321 (71h37m52.403674441s) [noise=true , address=77.90.31.21:4877 , piece_id=WBPGUVFPHKOZKWCBL46GQ67DBYCYSVUCRI6DLHA26JGLPRRLWV6Q, seg_pos={0 0}, upload=63047]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2): protocol: expected piece hash; context canceled; EOF Sep 9 13:06:16.364145215 (71h37m52.403718335s) [seg_pos={0 0}, upload=63047]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 13:06:16.364243333 (71h37m52.403816453s) [upload=63047]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 13:06:16.364249715 (71h37m52.403822845s) [upload=63047]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 13:06:16.783104051 (71h37m52.822677221s) [upload=63047]: Done uploading segments... Sep 9 13:06:16.783127195 (71h37m52.822700335s) [upload=63047]: Upload finished. err: <nil> Duration: 30.002217059s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 9 out of 60 is failed (threshold=3) [........................X................XXX........XXX.XX..] duration: 22.269979128s FAIL (2025-09-09 13:05:28 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 13:03:36.127414924 (71h35m12.166988044s) [upload=63008]: Starting upload Sep 9 13:03:36.127475660 (71h35m12.16704879s) [upload=63008]: Done starting upload Sep 9 13:03:36.127573758 (71h35m12.167146878s) [upload=63008]: Uploading segments... Sep 9 13:03:36.127710900 (71h35m12.16728402s) [upload=63008]: Got next segment. Inline: false Sep 9 13:03:36.127743833 (71h35m12.167316953s) [upload=63008]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 13:03:36.127748702 (71h35m12.167321822s) [upload=63008]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 13:03:36.395827293 (71h35m12.435400423s) [seg_pos={0 0}, upload=63008]: Begin upload segment... Sep 9 13:03:36.395887498 (71h35m12.435460628s) [seg_pos={0 0}, upload=63008]: Done begin upload segment. Sep 9 13:03:36.395920551 (71h35m12.435493681s) [noise=true , address=45.91.116.6:4973 , piece_id=SIBYGOR3M6ZHB3AXUWIIZNEZXLJG75W7IFW36CYP3LQBL7JIAVJQ, seg_pos={0 0}, upload=63008]: Uploading piece... Sep 9 13:03:36.395955508 (71h35m12.435528648s) [noise=true , address=45.91.116.5:4298 , piece_id=LQSLV7FY6237ZTN2YBQSDZDBRLWTRDCL5IQ3RLQMB4MYIIAU52HA, seg_pos={0 0}, upload=63008]: Uploading piece... Sep 9 13:03:36.396386112 (71h35m12.435959232s) [noise=true , address=45.91.116.14:4189 , piece_id=U4FOEPQLXZIQNPHR4237FXOKC7OY57ARH6RMUAMGR4DGXEEQVUIA, seg_pos={0 0}, upload=63008]: Uploading piece... Sep 9 13:03:36.396516251 (71h35m12.436089371s) [noise=true , address=45.91.116.11:4117 , piece_id=Q7TMBETM7GK4JXXMOG4RK7TMKO7VPKQKYVIAKPLPURYFXNWHGU7A, seg_pos={0 0}, upload=63008]: Uploading piece... Sep 9 13:03:36.396793542 (71h35m12.436366672s) [noise=true , address=77.90.31.21:4878 , piece_id=QLHADWIHBMR6V6RARHPXHZDC3T23ZKAGU6MKADQ2HALAIXOFQQMA, seg_pos={0 0}, upload=63008]: Uploading piece... Sep 9 13:03:36.397198627 (71h35m12.436771747s) [noise=true , address=77.90.31.14:4663 , piece_id=G7ICL2THGYSKYOBTGRC4ZEVCBCYKNHLR7MRRH5A2QY3K7UQGEWZQ, seg_pos={0 0}, upload=63008]: Uploading piece... Sep 9 13:03:36.397494884 (71h35m12.437068014s) [noise=true , address=145.79.227.14:4838 , piece_id=WF22HZUAYSSFIKHO7RPAQHS3YA3QQQX7RYTFDKFZUFDUXQC5L7NA, seg_pos={0 0}, upload=63008]: Uploading piece... Sep 9 13:03:36.397865773 (71h35m12.437438893s) [noise=true , address=45.91.116.8:4047 , piece_id=SCVPZ7UTSVYDPZGVFCMU5KYDJBGKBZZNEUDBGCJSKGDMVMM734DA, seg_pos={0 0}, upload=63008]: Uploading piece... Sep 9 13:03:36.398381680 (71h35m12.437954801s) [noise=true , address=45.91.116.9:4263 , piece_id=XJUOVETCPCKPSQGX5EMV7TUGEELJA4M3F5WRXYP2BHSCQDIFMBRA, seg_pos={0 0}, upload=63008]: Uploading piece... Sep 9 13:03:36.398717444 (71h35m12.438290564s) [noise=true , address=77.90.31.15:4698 , piece_id=LVZO6D4SRBNO2IYN54CKKFXTCBDNM62ESEG4VGE4Q62KXUMLCWTA, seg_pos={0 0}, upload=63008]: Uploading piece... Sep 9 13:03:36.399035722 (71h35m12.438608852s) [noise=true , address=77.90.31.14:4662 , piece_id=76YOUCT3QWNTHPFDS6LPGAZ3ZDYZGV4FARGSH2RSMCPAO5QVTMKQ, seg_pos={0 0}, upload=63008]: Uploading piece... Sep 9 13:03:36.399546530 (71h35m12.43911965s) [noise=true , address=77.90.31.21:4877 , piece_id=NVAMBM55A6UVR7574U3RMASOV3JRGEDI74ABGTKO332FBDG5CRMA, seg_pos={0 0}, upload=63008]: Uploading piece... Sep 9 13:03:36.399893334 (71h35m12.439466454s) [noise=true , address=45.91.116.10:4083 , piece_id=CXOO4YPXEN72UDCGXG26QFWYBJIU6GGR36XILHZRBFCJ6XZRETCQ, seg_pos={0 0}, upload=63008]: Uploading piece... Sep 9 13:03:36.400189911 (71h35m12.439763031s) [noise=true , address=45.91.116.4:4937 , piece_id=UYEL67XA2ZGBLNGALBZWBMAIGOEAM26PAAIO7VKILFNZHKKVCBQQ, seg_pos={0 0}, upload=63008]: Uploading piece... Sep 9 13:03:36.400510615 (71h35m12.440083745s) [noise=true , address=45.91.116.7:4010 , piece_id=LUV3ZYFNMWJLPAKIAWJLMSWRQV5WDKGEAQDSI6T5ZLWDN5LFM53Q, seg_pos={0 0}, upload=63008]: Uploading piece... Sep 9 13:03:36.400825107 (71h35m12.440398227s) [noise=true , address=45.91.116.9:4261 , piece_id=EJ4737LAH3FJFT7BYJFYTW3W3IFBDUIHI4FXM3ERQBF55RKB7DAA, seg_pos={0 0}, upload=63008]: Uploading piece... Sep 9 13:03:38.281097245 (71h35m14.320670365s) [upload=63008]: Next returned nil segment Sep 9 13:03:38.281115220 (71h35m14.32068834s) [upload=63008]: Waiting for error group managing segments... Sep 9 13:03:38.578093112 (71h35m14.617666232s) [noise=true , address=45.91.116.7:4010 , piece_id=LUV3ZYFNMWJLPAKIAWJLMSWRQV5WDKGEAQDSI6T5ZLWDN5LFM53Q, seg_pos={0 0}, upload=63008]: Done uploading piece. err: <nil> Sep 9 13:03:38.616349020 (71h35m14.65592214s) [noise=true , address=45.91.116.8:4047 , piece_id=SCVPZ7UTSVYDPZGVFCMU5KYDJBGKBZZNEUDBGCJSKGDMVMM734DA, seg_pos={0 0}, upload=63008]: Done uploading piece. err: <nil> Sep 9 13:03:38.625517194 (71h35m14.665090314s) [noise=true , address=77.90.31.14:4662 , piece_id=76YOUCT3QWNTHPFDS6LPGAZ3ZDYZGV4FARGSH2RSMCPAO5QVTMKQ, seg_pos={0 0}, upload=63008]: Done uploading piece. err: <nil> Sep 9 13:03:38.658612355 (71h35m14.698185475s) [noise=true , address=45.91.116.11:4117 , piece_id=Q7TMBETM7GK4JXXMOG4RK7TMKO7VPKQKYVIAKPLPURYFXNWHGU7A, seg_pos={0 0}, upload=63008]: Done uploading piece. err: <nil> Sep 9 13:03:38.661227940 (71h35m14.70080106s) [noise=true , address=45.91.116.6:4973 , piece_id=SIBYGOR3M6ZHB3AXUWIIZNEZXLJG75W7IFW36CYP3LQBL7JIAVJQ, seg_pos={0 0}, upload=63008]: Done uploading piece. err: <nil> Sep 9 13:03:38.665711120 (71h35m14.70528424s) [noise=true , address=45.91.116.10:4083 , piece_id=CXOO4YPXEN72UDCGXG26QFWYBJIU6GGR36XILHZRBFCJ6XZRETCQ, seg_pos={0 0}, upload=63008]: Done uploading piece. err: <nil> Sep 9 13:03:38.676854474 (71h35m14.716427594s) [noise=true , address=45.91.116.4:4937 , piece_id=UYEL67XA2ZGBLNGALBZWBMAIGOEAM26PAAIO7VKILFNZHKKVCBQQ, seg_pos={0 0}, upload=63008]: Done uploading piece. err: <nil> Sep 9 13:03:38.683988575 (71h35m14.723561745s) [noise=true , address=45.91.116.9:4263 , piece_id=XJUOVETCPCKPSQGX5EMV7TUGEELJA4M3F5WRXYP2BHSCQDIFMBRA, seg_pos={0 0}, upload=63008]: Done uploading piece. err: <nil> Sep 9 13:03:38.718528902 (71h35m14.758102022s) [noise=true , address=77.90.31.21:4877 , piece_id=NVAMBM55A6UVR7574U3RMASOV3JRGEDI74ABGTKO332FBDG5CRMA, seg_pos={0 0}, upload=63008]: Done uploading piece. err: <nil> Sep 9 13:03:38.745997176 (71h35m14.785570286s) [noise=true , address=77.90.31.14:4663 , piece_id=G7ICL2THGYSKYOBTGRC4ZEVCBCYKNHLR7MRRH5A2QY3K7UQGEWZQ, seg_pos={0 0}, upload=63008]: Done uploading piece. err: <nil> Sep 9 13:03:38.976465063 (71h35m15.016038183s) [noise=true , address=77.90.31.21:4878 , piece_id=QLHADWIHBMR6V6RARHPXHZDC3T23ZKAGU6MKADQ2HALAIXOFQQMA, seg_pos={0 0}, upload=63008]: Done uploading piece. err: <nil> Sep 9 13:03:39.399368168 (71h35m15.438941288s) [noise=true , address=45.91.116.5:4298 , piece_id=LQSLV7FY6237ZTN2YBQSDZDBRLWTRDCL5IQ3RLQMB4MYIIAU52HA, seg_pos={0 0}, upload=63008]: Done uploading piece. err: <nil> Sep 9 13:03:39.413499450 (71h35m15.45307257s) [noise=true , address=145.79.227.14:4838 , piece_id=WF22HZUAYSSFIKHO7RPAQHS3YA3QQQX7RYTFDKFZUFDUXQC5L7NA, seg_pos={0 0}, upload=63008]: Done uploading piece. err: <nil> Sep 9 13:03:39.413524257 (71h35m15.453097477s) [seg_pos={0 0}, upload=63008]: Segment reached optimal threshold of 13 pieces. Sep 9 13:03:39.413644507 (71h35m15.453217627s) [noise=true , address=77.90.31.15:4698 , piece_id=LVZO6D4SRBNO2IYN54CKKFXTCBDNM62ESEG4VGE4Q62KXUMLCWTA, seg_pos={0 0}, upload=63008]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj): protocol: expected piece hash; context canceled; EOF Sep 9 13:03:39.413714331 (71h35m15.453287451s) [noise=true , address=45.91.116.9:4261 , piece_id=EJ4737LAH3FJFT7BYJFYTW3W3IFBDUIHI4FXM3ERQBF55RKB7DAA, seg_pos={0 0}, upload=63008]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Sep 9 13:03:39.413786319 (71h35m15.453359439s) [noise=true , address=45.91.116.14:4189 , piece_id=U4FOEPQLXZIQNPHR4237FXOKC7OY57ARH6RMUAMGR4DGXEEQVUIA, seg_pos={0 0}, upload=63008]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N): protocol: read tcp 188.166.225.170:55880->45.91.116.14:4189: use of closed network connection; conn closed: op Sep 9 13:03:39.413831315 (71h35m15.453404425s) [seg_pos={0 0}, upload=63008]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 13:03:39.413889045 (71h35m15.453462165s) [upload=63008]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 13:03:39.413892903 (71h35m15.453466013s) [upload=63008]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 13:03:39.757163120 (71h35m15.79673624s) [upload=63008]: Done uploading segments... Sep 9 13:03:39.757182466 (71h35m15.796755586s) [upload=63008]: Upload finished. err: <nil> Duration: 22.269996771s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 9 out of 60 is failed (threshold=3) [.........................X................XXX........XXX.XX.] duration: 24.565339012s FAIL (2025-09-09 13:05:06 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 13:03:36.127414924 (71h35m12.166988044s) [upload=63008]: Starting upload Sep 9 13:03:36.127475660 (71h35m12.16704879s) [upload=63008]: Done starting upload Sep 9 13:03:36.127573758 (71h35m12.167146878s) [upload=63008]: Uploading segments... Sep 9 13:03:36.127710900 (71h35m12.16728402s) [upload=63008]: Got next segment. Inline: false Sep 9 13:03:36.127743833 (71h35m12.167316953s) [upload=63008]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 13:03:36.127748702 (71h35m12.167321822s) [upload=63008]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 13:03:36.395827293 (71h35m12.435400423s) [seg_pos={0 0}, upload=63008]: Begin upload segment... Sep 9 13:03:36.395887498 (71h35m12.435460628s) [seg_pos={0 0}, upload=63008]: Done begin upload segment. Sep 9 13:03:36.395920551 (71h35m12.435493681s) [noise=true , address=45.91.116.6:4973 , piece_id=SIBYGOR3M6ZHB3AXUWIIZNEZXLJG75W7IFW36CYP3LQBL7JIAVJQ, seg_pos={0 0}, upload=63008]: Uploading piece... Sep 9 13:03:36.395955508 (71h35m12.435528648s) [noise=true , address=45.91.116.5:4298 , piece_id=LQSLV7FY6237ZTN2YBQSDZDBRLWTRDCL5IQ3RLQMB4MYIIAU52HA, seg_pos={0 0}, upload=63008]: Uploading piece... Sep 9 13:03:36.396386112 (71h35m12.435959232s) [noise=true , address=45.91.116.14:4189 , piece_id=U4FOEPQLXZIQNPHR4237FXOKC7OY57ARH6RMUAMGR4DGXEEQVUIA, seg_pos={0 0}, upload=63008]: Uploading piece... Sep 9 13:03:36.396516251 (71h35m12.436089371s) [noise=true , address=45.91.116.11:4117 , piece_id=Q7TMBETM7GK4JXXMOG4RK7TMKO7VPKQKYVIAKPLPURYFXNWHGU7A, seg_pos={0 0}, upload=63008]: Uploading piece... Sep 9 13:03:36.396793542 (71h35m12.436366672s) [noise=true , address=77.90.31.21:4878 , piece_id=QLHADWIHBMR6V6RARHPXHZDC3T23ZKAGU6MKADQ2HALAIXOFQQMA, seg_pos={0 0}, upload=63008]: Uploading piece... Sep 9 13:03:36.397198627 (71h35m12.436771747s) [noise=true , address=77.90.31.14:4663 , piece_id=G7ICL2THGYSKYOBTGRC4ZEVCBCYKNHLR7MRRH5A2QY3K7UQGEWZQ, seg_pos={0 0}, upload=63008]: Uploading piece... Sep 9 13:03:36.397494884 (71h35m12.437068014s) [noise=true , address=145.79.227.14:4838 , piece_id=WF22HZUAYSSFIKHO7RPAQHS3YA3QQQX7RYTFDKFZUFDUXQC5L7NA, seg_pos={0 0}, upload=63008]: Uploading piece... Sep 9 13:03:36.397865773 (71h35m12.437438893s) [noise=true , address=45.91.116.8:4047 , piece_id=SCVPZ7UTSVYDPZGVFCMU5KYDJBGKBZZNEUDBGCJSKGDMVMM734DA, seg_pos={0 0}, upload=63008]: Uploading piece... Sep 9 13:03:36.398381680 (71h35m12.437954801s) [noise=true , address=45.91.116.9:4263 , piece_id=XJUOVETCPCKPSQGX5EMV7TUGEELJA4M3F5WRXYP2BHSCQDIFMBRA, seg_pos={0 0}, upload=63008]: Uploading piece... Sep 9 13:03:36.398717444 (71h35m12.438290564s) [noise=true , address=77.90.31.15:4698 , piece_id=LVZO6D4SRBNO2IYN54CKKFXTCBDNM62ESEG4VGE4Q62KXUMLCWTA, seg_pos={0 0}, upload=63008]: Uploading piece... Sep 9 13:03:36.399035722 (71h35m12.438608852s) [noise=true , address=77.90.31.14:4662 , piece_id=76YOUCT3QWNTHPFDS6LPGAZ3ZDYZGV4FARGSH2RSMCPAO5QVTMKQ, seg_pos={0 0}, upload=63008]: Uploading piece... Sep 9 13:03:36.399546530 (71h35m12.43911965s) [noise=true , address=77.90.31.21:4877 , piece_id=NVAMBM55A6UVR7574U3RMASOV3JRGEDI74ABGTKO332FBDG5CRMA, seg_pos={0 0}, upload=63008]: Uploading piece... Sep 9 13:03:36.399893334 (71h35m12.439466454s) [noise=true , address=45.91.116.10:4083 , piece_id=CXOO4YPXEN72UDCGXG26QFWYBJIU6GGR36XILHZRBFCJ6XZRETCQ, seg_pos={0 0}, upload=63008]: Uploading piece... Sep 9 13:03:36.400189911 (71h35m12.439763031s) [noise=true , address=45.91.116.4:4937 , piece_id=UYEL67XA2ZGBLNGALBZWBMAIGOEAM26PAAIO7VKILFNZHKKVCBQQ, seg_pos={0 0}, upload=63008]: Uploading piece... Sep 9 13:03:36.400510615 (71h35m12.440083745s) [noise=true , address=45.91.116.7:4010 , piece_id=LUV3ZYFNMWJLPAKIAWJLMSWRQV5WDKGEAQDSI6T5ZLWDN5LFM53Q, seg_pos={0 0}, upload=63008]: Uploading piece... Sep 9 13:03:36.400825107 (71h35m12.440398227s) [noise=true , address=45.91.116.9:4261 , piece_id=EJ4737LAH3FJFT7BYJFYTW3W3IFBDUIHI4FXM3ERQBF55RKB7DAA, seg_pos={0 0}, upload=63008]: Uploading piece... Sep 9 13:03:38.281097245 (71h35m14.320670365s) [upload=63008]: Next returned nil segment Sep 9 13:03:38.281115220 (71h35m14.32068834s) [upload=63008]: Waiting for error group managing segments... Sep 9 13:03:38.578093112 (71h35m14.617666232s) [noise=true , address=45.91.116.7:4010 , piece_id=LUV3ZYFNMWJLPAKIAWJLMSWRQV5WDKGEAQDSI6T5ZLWDN5LFM53Q, seg_pos={0 0}, upload=63008]: Done uploading piece. err: <nil> Sep 9 13:03:38.616349020 (71h35m14.65592214s) [noise=true , address=45.91.116.8:4047 , piece_id=SCVPZ7UTSVYDPZGVFCMU5KYDJBGKBZZNEUDBGCJSKGDMVMM734DA, seg_pos={0 0}, upload=63008]: Done uploading piece. err: <nil> Sep 9 13:03:38.625517194 (71h35m14.665090314s) [noise=true , address=77.90.31.14:4662 , piece_id=76YOUCT3QWNTHPFDS6LPGAZ3ZDYZGV4FARGSH2RSMCPAO5QVTMKQ, seg_pos={0 0}, upload=63008]: Done uploading piece. err: <nil> Sep 9 13:03:38.658612355 (71h35m14.698185475s) [noise=true , address=45.91.116.11:4117 , piece_id=Q7TMBETM7GK4JXXMOG4RK7TMKO7VPKQKYVIAKPLPURYFXNWHGU7A, seg_pos={0 0}, upload=63008]: Done uploading piece. err: <nil> Sep 9 13:03:38.661227940 (71h35m14.70080106s) [noise=true , address=45.91.116.6:4973 , piece_id=SIBYGOR3M6ZHB3AXUWIIZNEZXLJG75W7IFW36CYP3LQBL7JIAVJQ, seg_pos={0 0}, upload=63008]: Done uploading piece. err: <nil> Sep 9 13:03:38.665711120 (71h35m14.70528424s) [noise=true , address=45.91.116.10:4083 , piece_id=CXOO4YPXEN72UDCGXG26QFWYBJIU6GGR36XILHZRBFCJ6XZRETCQ, seg_pos={0 0}, upload=63008]: Done uploading piece. err: <nil> Sep 9 13:03:38.676854474 (71h35m14.716427594s) [noise=true , address=45.91.116.4:4937 , piece_id=UYEL67XA2ZGBLNGALBZWBMAIGOEAM26PAAIO7VKILFNZHKKVCBQQ, seg_pos={0 0}, upload=63008]: Done uploading piece. err: <nil> Sep 9 13:03:38.683988575 (71h35m14.723561745s) [noise=true , address=45.91.116.9:4263 , piece_id=XJUOVETCPCKPSQGX5EMV7TUGEELJA4M3F5WRXYP2BHSCQDIFMBRA, seg_pos={0 0}, upload=63008]: Done uploading piece. err: <nil> Sep 9 13:03:38.718528902 (71h35m14.758102022s) [noise=true , address=77.90.31.21:4877 , piece_id=NVAMBM55A6UVR7574U3RMASOV3JRGEDI74ABGTKO332FBDG5CRMA, seg_pos={0 0}, upload=63008]: Done uploading piece. err: <nil> Sep 9 13:03:38.745997176 (71h35m14.785570286s) [noise=true , address=77.90.31.14:4663 , piece_id=G7ICL2THGYSKYOBTGRC4ZEVCBCYKNHLR7MRRH5A2QY3K7UQGEWZQ, seg_pos={0 0}, upload=63008]: Done uploading piece. err: <nil> Sep 9 13:03:38.976465063 (71h35m15.016038183s) [noise=true , address=77.90.31.21:4878 , piece_id=QLHADWIHBMR6V6RARHPXHZDC3T23ZKAGU6MKADQ2HALAIXOFQQMA, seg_pos={0 0}, upload=63008]: Done uploading piece. err: <nil> Sep 9 13:03:39.399368168 (71h35m15.438941288s) [noise=true , address=45.91.116.5:4298 , piece_id=LQSLV7FY6237ZTN2YBQSDZDBRLWTRDCL5IQ3RLQMB4MYIIAU52HA, seg_pos={0 0}, upload=63008]: Done uploading piece. err: <nil> Sep 9 13:03:39.413499450 (71h35m15.45307257s) [noise=true , address=145.79.227.14:4838 , piece_id=WF22HZUAYSSFIKHO7RPAQHS3YA3QQQX7RYTFDKFZUFDUXQC5L7NA, seg_pos={0 0}, upload=63008]: Done uploading piece. err: <nil> Sep 9 13:03:39.413524257 (71h35m15.453097477s) [seg_pos={0 0}, upload=63008]: Segment reached optimal threshold of 13 pieces. Sep 9 13:03:39.413644507 (71h35m15.453217627s) [noise=true , address=77.90.31.15:4698 , piece_id=LVZO6D4SRBNO2IYN54CKKFXTCBDNM62ESEG4VGE4Q62KXUMLCWTA, seg_pos={0 0}, upload=63008]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj): protocol: expected piece hash; context canceled; EOF Sep 9 13:03:39.413714331 (71h35m15.453287451s) [noise=true , address=45.91.116.9:4261 , piece_id=EJ4737LAH3FJFT7BYJFYTW3W3IFBDUIHI4FXM3ERQBF55RKB7DAA, seg_pos={0 0}, upload=63008]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Sep 9 13:03:39.413786319 (71h35m15.453359439s) [noise=true , address=45.91.116.14:4189 , piece_id=U4FOEPQLXZIQNPHR4237FXOKC7OY57ARH6RMUAMGR4DGXEEQVUIA, seg_pos={0 0}, upload=63008]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N): protocol: read tcp 188.166.225.170:55880->45.91.116.14:4189: use of closed network connection; conn closed: op Sep 9 13:03:39.413831315 (71h35m15.453404425s) [seg_pos={0 0}, upload=63008]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 13:03:39.413889045 (71h35m15.453462165s) [upload=63008]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 13:03:39.413892903 (71h35m15.453466013s) [upload=63008]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 13:03:39.757163120 (71h35m15.79673624s) [upload=63008]: Done uploading segments... Sep 9 13:03:39.757182466 (71h35m15.796755586s) [upload=63008]: Upload finished. err: <nil> Duration: 24.565385981s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 9 out of 60 is failed (threshold=3) [..........................X................XXX........XXX.XX] duration: 30.002743936s FAIL (2025-09-09 13:04:05 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 13:03:36.127414924 (71h35m12.166988044s) [upload=63008]: Starting upload Sep 9 13:03:36.127475660 (71h35m12.16704879s) [upload=63008]: Done starting upload Sep 9 13:03:36.127573758 (71h35m12.167146878s) [upload=63008]: Uploading segments... Sep 9 13:03:36.127710900 (71h35m12.16728402s) [upload=63008]: Got next segment. Inline: false Sep 9 13:03:36.127743833 (71h35m12.167316953s) [upload=63008]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 13:03:36.127748702 (71h35m12.167321822s) [upload=63008]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 13:03:36.395827293 (71h35m12.435400423s) [seg_pos={0 0}, upload=63008]: Begin upload segment... Sep 9 13:03:36.395887498 (71h35m12.435460628s) [seg_pos={0 0}, upload=63008]: Done begin upload segment. Sep 9 13:03:36.395920551 (71h35m12.435493681s) [noise=true , address=45.91.116.6:4973 , piece_id=SIBYGOR3M6ZHB3AXUWIIZNEZXLJG75W7IFW36CYP3LQBL7JIAVJQ, seg_pos={0 0}, upload=63008]: Uploading piece... Sep 9 13:03:36.395955508 (71h35m12.435528648s) [noise=true , address=45.91.116.5:4298 , piece_id=LQSLV7FY6237ZTN2YBQSDZDBRLWTRDCL5IQ3RLQMB4MYIIAU52HA, seg_pos={0 0}, upload=63008]: Uploading piece... Sep 9 13:03:36.396386112 (71h35m12.435959232s) [noise=true , address=45.91.116.14:4189 , piece_id=U4FOEPQLXZIQNPHR4237FXOKC7OY57ARH6RMUAMGR4DGXEEQVUIA, seg_pos={0 0}, upload=63008]: Uploading piece... Sep 9 13:03:36.396516251 (71h35m12.436089371s) [noise=true , address=45.91.116.11:4117 , piece_id=Q7TMBETM7GK4JXXMOG4RK7TMKO7VPKQKYVIAKPLPURYFXNWHGU7A, seg_pos={0 0}, upload=63008]: Uploading piece... Sep 9 13:03:36.396793542 (71h35m12.436366672s) [noise=true , address=77.90.31.21:4878 , piece_id=QLHADWIHBMR6V6RARHPXHZDC3T23ZKAGU6MKADQ2HALAIXOFQQMA, seg_pos={0 0}, upload=63008]: Uploading piece... Sep 9 13:03:36.397198627 (71h35m12.436771747s) [noise=true , address=77.90.31.14:4663 , piece_id=G7ICL2THGYSKYOBTGRC4ZEVCBCYKNHLR7MRRH5A2QY3K7UQGEWZQ, seg_pos={0 0}, upload=63008]: Uploading piece... Sep 9 13:03:36.397494884 (71h35m12.437068014s) [noise=true , address=145.79.227.14:4838 , piece_id=WF22HZUAYSSFIKHO7RPAQHS3YA3QQQX7RYTFDKFZUFDUXQC5L7NA, seg_pos={0 0}, upload=63008]: Uploading piece... Sep 9 13:03:36.397865773 (71h35m12.437438893s) [noise=true , address=45.91.116.8:4047 , piece_id=SCVPZ7UTSVYDPZGVFCMU5KYDJBGKBZZNEUDBGCJSKGDMVMM734DA, seg_pos={0 0}, upload=63008]: Uploading piece... Sep 9 13:03:36.398381680 (71h35m12.437954801s) [noise=true , address=45.91.116.9:4263 , piece_id=XJUOVETCPCKPSQGX5EMV7TUGEELJA4M3F5WRXYP2BHSCQDIFMBRA, seg_pos={0 0}, upload=63008]: Uploading piece... Sep 9 13:03:36.398717444 (71h35m12.438290564s) [noise=true , address=77.90.31.15:4698 , piece_id=LVZO6D4SRBNO2IYN54CKKFXTCBDNM62ESEG4VGE4Q62KXUMLCWTA, seg_pos={0 0}, upload=63008]: Uploading piece... Sep 9 13:03:36.399035722 (71h35m12.438608852s) [noise=true , address=77.90.31.14:4662 , piece_id=76YOUCT3QWNTHPFDS6LPGAZ3ZDYZGV4FARGSH2RSMCPAO5QVTMKQ, seg_pos={0 0}, upload=63008]: Uploading piece... Sep 9 13:03:36.399546530 (71h35m12.43911965s) [noise=true , address=77.90.31.21:4877 , piece_id=NVAMBM55A6UVR7574U3RMASOV3JRGEDI74ABGTKO332FBDG5CRMA, seg_pos={0 0}, upload=63008]: Uploading piece... Sep 9 13:03:36.399893334 (71h35m12.439466454s) [noise=true , address=45.91.116.10:4083 , piece_id=CXOO4YPXEN72UDCGXG26QFWYBJIU6GGR36XILHZRBFCJ6XZRETCQ, seg_pos={0 0}, upload=63008]: Uploading piece... Sep 9 13:03:36.400189911 (71h35m12.439763031s) [noise=true , address=45.91.116.4:4937 , piece_id=UYEL67XA2ZGBLNGALBZWBMAIGOEAM26PAAIO7VKILFNZHKKVCBQQ, seg_pos={0 0}, upload=63008]: Uploading piece... Sep 9 13:03:36.400510615 (71h35m12.440083745s) [noise=true , address=45.91.116.7:4010 , piece_id=LUV3ZYFNMWJLPAKIAWJLMSWRQV5WDKGEAQDSI6T5ZLWDN5LFM53Q, seg_pos={0 0}, upload=63008]: Uploading piece... Sep 9 13:03:36.400825107 (71h35m12.440398227s) [noise=true , address=45.91.116.9:4261 , piece_id=EJ4737LAH3FJFT7BYJFYTW3W3IFBDUIHI4FXM3ERQBF55RKB7DAA, seg_pos={0 0}, upload=63008]: Uploading piece... Sep 9 13:03:38.281097245 (71h35m14.320670365s) [upload=63008]: Next returned nil segment Sep 9 13:03:38.281115220 (71h35m14.32068834s) [upload=63008]: Waiting for error group managing segments... Sep 9 13:03:38.578093112 (71h35m14.617666232s) [noise=true , address=45.91.116.7:4010 , piece_id=LUV3ZYFNMWJLPAKIAWJLMSWRQV5WDKGEAQDSI6T5ZLWDN5LFM53Q, seg_pos={0 0}, upload=63008]: Done uploading piece. err: <nil> Sep 9 13:03:38.616349020 (71h35m14.65592214s) [noise=true , address=45.91.116.8:4047 , piece_id=SCVPZ7UTSVYDPZGVFCMU5KYDJBGKBZZNEUDBGCJSKGDMVMM734DA, seg_pos={0 0}, upload=63008]: Done uploading piece. err: <nil> Sep 9 13:03:38.625517194 (71h35m14.665090314s) [noise=true , address=77.90.31.14:4662 , piece_id=76YOUCT3QWNTHPFDS6LPGAZ3ZDYZGV4FARGSH2RSMCPAO5QVTMKQ, seg_pos={0 0}, upload=63008]: Done uploading piece. err: <nil> Sep 9 13:03:38.658612355 (71h35m14.698185475s) [noise=true , address=45.91.116.11:4117 , piece_id=Q7TMBETM7GK4JXXMOG4RK7TMKO7VPKQKYVIAKPLPURYFXNWHGU7A, seg_pos={0 0}, upload=63008]: Done uploading piece. err: <nil> Sep 9 13:03:38.661227940 (71h35m14.70080106s) [noise=true , address=45.91.116.6:4973 , piece_id=SIBYGOR3M6ZHB3AXUWIIZNEZXLJG75W7IFW36CYP3LQBL7JIAVJQ, seg_pos={0 0}, upload=63008]: Done uploading piece. err: <nil> Sep 9 13:03:38.665711120 (71h35m14.70528424s) [noise=true , address=45.91.116.10:4083 , piece_id=CXOO4YPXEN72UDCGXG26QFWYBJIU6GGR36XILHZRBFCJ6XZRETCQ, seg_pos={0 0}, upload=63008]: Done uploading piece. err: <nil> Sep 9 13:03:38.676854474 (71h35m14.716427594s) [noise=true , address=45.91.116.4:4937 , piece_id=UYEL67XA2ZGBLNGALBZWBMAIGOEAM26PAAIO7VKILFNZHKKVCBQQ, seg_pos={0 0}, upload=63008]: Done uploading piece. err: <nil> Sep 9 13:03:38.683988575 (71h35m14.723561745s) [noise=true , address=45.91.116.9:4263 , piece_id=XJUOVETCPCKPSQGX5EMV7TUGEELJA4M3F5WRXYP2BHSCQDIFMBRA, seg_pos={0 0}, upload=63008]: Done uploading piece. err: <nil> Sep 9 13:03:38.718528902 (71h35m14.758102022s) [noise=true , address=77.90.31.21:4877 , piece_id=NVAMBM55A6UVR7574U3RMASOV3JRGEDI74ABGTKO332FBDG5CRMA, seg_pos={0 0}, upload=63008]: Done uploading piece. err: <nil> Sep 9 13:03:38.745997176 (71h35m14.785570286s) [noise=true , address=77.90.31.14:4663 , piece_id=G7ICL2THGYSKYOBTGRC4ZEVCBCYKNHLR7MRRH5A2QY3K7UQGEWZQ, seg_pos={0 0}, upload=63008]: Done uploading piece. err: <nil> Sep 9 13:03:38.976465063 (71h35m15.016038183s) [noise=true , address=77.90.31.21:4878 , piece_id=QLHADWIHBMR6V6RARHPXHZDC3T23ZKAGU6MKADQ2HALAIXOFQQMA, seg_pos={0 0}, upload=63008]: Done uploading piece. err: <nil> Sep 9 13:03:39.399368168 (71h35m15.438941288s) [noise=true , address=45.91.116.5:4298 , piece_id=LQSLV7FY6237ZTN2YBQSDZDBRLWTRDCL5IQ3RLQMB4MYIIAU52HA, seg_pos={0 0}, upload=63008]: Done uploading piece. err: <nil> Sep 9 13:03:39.413499450 (71h35m15.45307257s) [noise=true , address=145.79.227.14:4838 , piece_id=WF22HZUAYSSFIKHO7RPAQHS3YA3QQQX7RYTFDKFZUFDUXQC5L7NA, seg_pos={0 0}, upload=63008]: Done uploading piece. err: <nil> Sep 9 13:03:39.413524257 (71h35m15.453097477s) [seg_pos={0 0}, upload=63008]: Segment reached optimal threshold of 13 pieces. Sep 9 13:03:39.413644507 (71h35m15.453217627s) [noise=true , address=77.90.31.15:4698 , piece_id=LVZO6D4SRBNO2IYN54CKKFXTCBDNM62ESEG4VGE4Q62KXUMLCWTA, seg_pos={0 0}, upload=63008]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj): protocol: expected piece hash; context canceled; EOF Sep 9 13:03:39.413714331 (71h35m15.453287451s) [noise=true , address=45.91.116.9:4261 , piece_id=EJ4737LAH3FJFT7BYJFYTW3W3IFBDUIHI4FXM3ERQBF55RKB7DAA, seg_pos={0 0}, upload=63008]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Sep 9 13:03:39.413786319 (71h35m15.453359439s) [noise=true , address=45.91.116.14:4189 , piece_id=U4FOEPQLXZIQNPHR4237FXOKC7OY57ARH6RMUAMGR4DGXEEQVUIA, seg_pos={0 0}, upload=63008]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N): protocol: read tcp 188.166.225.170:55880->45.91.116.14:4189: use of closed network connection; conn closed: op Sep 9 13:03:39.413831315 (71h35m15.453404425s) [seg_pos={0 0}, upload=63008]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 13:03:39.413889045 (71h35m15.453462165s) [upload=63008]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 13:03:39.413892903 (71h35m15.453466013s) [upload=63008]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 13:03:39.757163120 (71h35m15.79673624s) [upload=63008]: Done uploading segments... Sep 9 13:03:39.757182466 (71h35m15.796755586s) [upload=63008]: Upload finished. err: <nil> Duration: 30.002763693s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 8 out of 60 is failed (threshold=3) [...........................X................XXX........XXX.X] duration: 30.001967539s FAIL (2025-09-09 13:03:31 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 13:03:02.642263916 (71h34m38.681837036s) [upload=62997]: Starting upload Sep 9 13:03:02.642316767 (71h34m38.681889897s) [upload=62997]: Done starting upload Sep 9 13:03:02.642485510 (71h34m38.68205863s) [upload=62997]: Uploading segments... Sep 9 13:03:02.642521128 (71h34m38.682094248s) [upload=62997]: Got next segment. Inline: false Sep 9 13:03:02.642550784 (71h34m38.682123904s) [upload=62997]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 13:03:02.642555965 (71h34m38.682129095s) [upload=62997]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 13:03:02.900064005 (71h34m38.939637125s) [seg_pos={0 0}, upload=62997]: Begin upload segment... Sep 9 13:03:02.900120303 (71h34m38.939693423s) [seg_pos={0 0}, upload=62997]: Done begin upload segment. Sep 9 13:03:02.900146723 (71h34m38.939719843s) [noise=true , address=45.91.116.14:4191 , piece_id=4YGAJ7DSNBTSWQUIL7TTLMLS3VNK25YI2F24Q3C7BG5HF4JXKTAQ, seg_pos={0 0}, upload=62997]: Uploading piece... Sep 9 13:03:02.900547520 (71h34m38.94012064s) [noise=true , address=45.91.116.6:4974 , piece_id=AE4U7F43ZTQZBLXLYC7QSHZTYYOTEZX4WM2BBAXLF2MVP6FMBZJQ, seg_pos={0 0}, upload=62997]: Uploading piece... Sep 9 13:03:02.900770797 (71h34m38.940343917s) [noise=true , address=77.90.31.13:4628 , piece_id=MZ5GYUU3MIDNOBMB4J5YMUN3PLCBHTWTW5OXPNTXO6YYBK7BPPHA, seg_pos={0 0}, upload=62997]: Uploading piece... Sep 9 13:03:02.901096761 (71h34m38.940669881s) [noise=true , address=145.79.227.11:4732 , piece_id=FJLCFUA6DMOBZF4HFD4G625DN6KJLWPSEFOOPP6THJ7WTQXYU4VQ, seg_pos={0 0}, upload=62997]: Uploading piece... Sep 9 13:03:02.901331521 (71h34m38.940904641s) [noise=true , address=45.91.116.14:4189 , piece_id=RITWSQ7AT37IRPUZZNKXQJWRXCCVMLBUBRIHKGSEI2UMO4KLEHZA, seg_pos={0 0}, upload=62997]: Uploading piece... Sep 9 13:03:02.901597369 (71h34m38.941170489s) [noise=true , address=45.91.116.12:4227 , piece_id=J4PUPVCDB6TQB6ROHEGTL7WFFO763U3FQMFUYHOQUR2VYHZ22HZA, seg_pos={0 0}, upload=62997]: Uploading piece... Sep 9 13:03:02.901967798 (71h34m38.941540918s) [noise=true , address=77.90.31.10:4517 , piece_id=HP4WV7YGQN5LQDFNFZSODACAIK2ZZY663MBITHURTOLO7RV2IJNA, seg_pos={0 0}, upload=62997]: Uploading piece... Sep 9 13:03:02.902144626 (71h34m38.941717756s) [noise=true , address=45.91.116.9:4263 , piece_id=D5J6PTNZ3W5ZLZU26VRZ74DXK5FWLDCL5SPF4MSWVRBXKV4NOZOQ, seg_pos={0 0}, upload=62997]: Uploading piece... Sep 9 13:03:02.902671866 (71h34m38.942244986s) [noise=true , address=45.91.116.10:4083 , piece_id=BF35KTBVHL5VBFM4U6PWFVIKOEWE7E2W3VWS2AG55OAU3JRSCGWQ, seg_pos={0 0}, upload=62997]: Uploading piece... Sep 9 13:03:02.903034098 (71h34m38.942607219s) [noise=true , address=45.91.116.9:4261 , piece_id=UZVC2BCACAVOWLEBTGMMM3AAKWBMJWNMRD2WC7VNQVXVFEEH5CFQ, seg_pos={0 0}, upload=62997]: Uploading piece... Sep 9 13:03:02.903567039 (71h34m38.943140159s) [noise=true , address=145.79.227.3:4151 , piece_id=4G5WVOGNAYEBA5NBXUSB72FAZCQQCHLU7P7QAIIBPPTCAGO4CIMQ, seg_pos={0 0}, upload=62997]: Uploading piece... Sep 9 13:03:02.904108836 (71h34m38.943681956s) [noise=true , address=77.90.31.19:4841 , piece_id=2EG7CMZVIXEMJC5SSZJDVUNFDHQTWWNJOZYICZSE5H4B7E74P6ZA, seg_pos={0 0}, upload=62997]: Uploading piece... Sep 9 13:03:02.904428637 (71h34m38.944001767s) [noise=true , address=77.90.31.19:4843 , piece_id=FSKYOZWO4FA2NDYH42BSUYUN5X5T6DROIUG77YEXNM66CZZQDQYA, seg_pos={0 0}, upload=62997]: Uploading piece... Sep 9 13:03:02.904811179 (71h34m38.944384299s) [noise=true , address=77.90.31.18:4807 , piece_id=ZOF62XKCMLQCAW5RRBQJ4ZQRCRKEEUYAIS5U7NNZP42OQ6YGSFWA, seg_pos={0 0}, upload=62997]: Uploading piece... Sep 9 13:03:02.905142995 (71h34m38.944716115s) [noise=true , address=45.91.116.8:4047 , piece_id=GIQL2GZBRBMAUVXYUIJMBUWE45KEBYBMS6WUXFZOF7KDSPN2JDQA, seg_pos={0 0}, upload=62997]: Uploading piece... Sep 9 13:03:02.905732212 (71h34m38.945305342s) [noise=true , address=45.91.116.11:4119 , piece_id=7I3DSG6Q6EPREH6LMR3EOY2LXBMHNTTWDCRGBQJ4QXUIYXL2WUMA, seg_pos={0 0}, upload=62997]: Uploading piece... Sep 9 13:03:04.808053890 (71h34m40.84762701s) [upload=62997]: Next returned nil segment Sep 9 13:03:04.808076794 (71h34m40.847649914s) [upload=62997]: Waiting for error group managing segments... Sep 9 13:03:05.127144087 (71h34m41.166717217s) [noise=true , address=45.91.116.6:4974 , piece_id=AE4U7F43ZTQZBLXLYC7QSHZTYYOTEZX4WM2BBAXLF2MVP6FMBZJQ, seg_pos={0 0}, upload=62997]: Done uploading piece. err: <nil> Sep 9 13:03:05.128124733 (71h34m41.167697854s) [noise=true , address=45.91.116.14:4189 , piece_id=RITWSQ7AT37IRPUZZNKXQJWRXCCVMLBUBRIHKGSEI2UMO4KLEHZA, seg_pos={0 0}, upload=62997]: Done uploading piece. err: <nil> Sep 9 13:03:05.142751242 (71h34m41.182324362s) [noise=true , address=45.91.116.9:4261 , piece_id=UZVC2BCACAVOWLEBTGMMM3AAKWBMJWNMRD2WC7VNQVXVFEEH5CFQ, seg_pos={0 0}, upload=62997]: Done uploading piece. err: <nil> Sep 9 13:03:05.147250734 (71h34m41.186823864s) [noise=true , address=77.90.31.13:4628 , piece_id=MZ5GYUU3MIDNOBMB4J5YMUN3PLCBHTWTW5OXPNTXO6YYBK7BPPHA, seg_pos={0 0}, upload=62997]: Done uploading piece. err: <nil> Sep 9 13:03:05.155093381 (71h34m41.194666501s) [noise=true , address=77.90.31.10:4517 , piece_id=HP4WV7YGQN5LQDFNFZSODACAIK2ZZY663MBITHURTOLO7RV2IJNA, seg_pos={0 0}, upload=62997]: Done uploading piece. err: <nil> Sep 9 13:03:05.155545456 (71h34m41.195118576s) [noise=true , address=77.90.31.19:4843 , piece_id=FSKYOZWO4FA2NDYH42BSUYUN5X5T6DROIUG77YEXNM66CZZQDQYA, seg_pos={0 0}, upload=62997]: Done uploading piece. err: <nil> Sep 9 13:03:05.166113259 (71h34m41.205686379s) [noise=true , address=45.91.116.14:4191 , piece_id=4YGAJ7DSNBTSWQUIL7TTLMLS3VNK25YI2F24Q3C7BG5HF4JXKTAQ, seg_pos={0 0}, upload=62997]: Done uploading piece. err: <nil> Sep 9 13:03:05.177168845 (71h34m41.216741965s) [noise=true , address=45.91.116.9:4263 , piece_id=D5J6PTNZ3W5ZLZU26VRZ74DXK5FWLDCL5SPF4MSWVRBXKV4NOZOQ, seg_pos={0 0}, upload=62997]: Done uploading piece. err: <nil> Sep 9 13:03:05.181381166 (71h34m41.220954296s) [noise=true , address=145.79.227.3:4151 , piece_id=4G5WVOGNAYEBA5NBXUSB72FAZCQQCHLU7P7QAIIBPPTCAGO4CIMQ, seg_pos={0 0}, upload=62997]: Done uploading piece. err: <nil> Sep 9 13:03:05.199783822 (71h34m41.239356942s) [noise=true , address=45.91.116.10:4083 , piece_id=BF35KTBVHL5VBFM4U6PWFVIKOEWE7E2W3VWS2AG55OAU3JRSCGWQ, seg_pos={0 0}, upload=62997]: Done uploading piece. err: <nil> Sep 9 13:03:05.208452550 (71h34m41.24802567s) [noise=true , address=77.90.31.18:4807 , piece_id=ZOF62XKCMLQCAW5RRBQJ4ZQRCRKEEUYAIS5U7NNZP42OQ6YGSFWA, seg_pos={0 0}, upload=62997]: Done uploading piece. err: <nil> Sep 9 13:03:05.226941711 (71h34m41.266514841s) [noise=true , address=45.91.116.8:4047 , piece_id=GIQL2GZBRBMAUVXYUIJMBUWE45KEBYBMS6WUXFZOF7KDSPN2JDQA, seg_pos={0 0}, upload=62997]: Done uploading piece. err: <nil> Sep 9 13:03:05.234111912 (71h34m41.273685032s) [noise=true , address=45.91.116.12:4227 , piece_id=J4PUPVCDB6TQB6ROHEGTL7WFFO763U3FQMFUYHOQUR2VYHZ22HZA, seg_pos={0 0}, upload=62997]: Done uploading piece. err: <nil> Sep 9 13:03:05.234130767 (71h34m41.273703888s) [seg_pos={0 0}, upload=62997]: Segment reached optimal threshold of 13 pieces. Sep 9 13:03:05.234233715 (71h34m41.273806835s) [noise=true , address=45.91.116.11:4119 , piece_id=7I3DSG6Q6EPREH6LMR3EOY2LXBMHNTTWDCRGBQJ4QXUIYXL2WUMA, seg_pos={0 0}, upload=62997]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm): protocol: expected piece hash; context canceled; EOF Sep 9 13:03:05.234307586 (71h34m41.273880706s) [noise=true , address=145.79.227.11:4732 , piece_id=FJLCFUA6DMOBZF4HFD4G625DN6KJLWPSEFOOPP6THJ7WTQXYU4VQ, seg_pos={0 0}, upload=62997]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE): protocol: expected piece hash; context canceled; EOF Sep 9 13:03:05.234462012 (71h34m41.274035142s) [noise=true , address=77.90.31.19:4841 , piece_id=2EG7CMZVIXEMJC5SSZJDVUNFDHQTWWNJOZYICZSE5H4B7E74P6ZA, seg_pos={0 0}, upload=62997]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA): protocol: write tcp 188.166.225.170:55346->77.90.31.19:4841: use of closed network connection; write tcp 188.166.225.170:55346->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55346->77.90.31.19:4841: use of closed network connection Sep 9 13:03:05.234621407 (71h34m41.274194527s) [seg_pos={0 0}, upload=62997]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 13:03:05.234725856 (71h34m41.274298976s) [upload=62997]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 13:03:05.234730957 (71h34m41.274304077s) [upload=62997]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 13:03:05.678150241 (71h34m41.717723371s) [upload=62997]: Done uploading segments... Sep 9 13:03:05.678171733 (71h34m41.717744873s) [upload=62997]: Upload finished. err: <nil> Duration: 30.002004079s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 7 out of 60 is failed (threshold=3) [............................X................XXX........XXX.] duration: 26.738546345s FAIL (2025-09-09 13:02:58 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 13:02:02.099411653 (71h33m38.138984773s) [upload=62984]: Starting upload Sep 9 13:02:02.099494372 (71h33m38.139067492s) [upload=62984]: Done starting upload Sep 9 13:02:02.099619001 (71h33m38.139192131s) [upload=62984]: Uploading segments... Sep 9 13:02:02.099701118 (71h33m38.139274258s) [upload=62984]: Got next segment. Inline: false Sep 9 13:02:02.099762365 (71h33m38.139335495s) [upload=62984]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 13:02:02.099769329 (71h33m38.139342449s) [upload=62984]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 13:02:02.421764203 (71h33m38.461337333s) [seg_pos={0 0}, upload=62984]: Begin upload segment... Sep 9 13:02:02.421920031 (71h33m38.461493151s) [noise=true , address=45.91.116.6:4975 , piece_id=CUMM6NUWSZLDL5VEJRWGC34D3WAU6KF25NUAA7F6AGFCGIZMINQQ, seg_pos={0 0}, upload=62984]: Uploading piece... Sep 9 13:02:02.422448462 (71h33m38.462021592s) [noise=true , address=77.90.31.15:4697 , piece_id=NWZ7SWEEM335EET7XKKCXASAFPSCAKDVPGV3NL3PSTVJZUSBJWFQ, seg_pos={0 0}, upload=62984]: Uploading piece... Sep 9 13:02:02.422462329 (71h33m38.462035459s) [seg_pos={0 0}, upload=62984]: Done begin upload segment. Sep 9 13:02:02.422618006 (71h33m38.462191136s) [noise=true , address=145.79.227.3:4151 , piece_id=A5YPHPZGFGF7HYD5YBQAMQPW5PZWEBE4CDAD4OKFA2MXFS46CGAA, seg_pos={0 0}, upload=62984]: Uploading piece... Sep 9 13:02:02.422787642 (71h33m38.462360772s) [noise=true , address=45.91.116.14:4189 , piece_id=YAOLLYSLMHRTS4FILGROPS5T5Z7KJTFPO6EWN3R6BTCFYXVY5TSA, seg_pos={0 0}, upload=62984]: Uploading piece... Sep 9 13:02:02.423102584 (71h33m38.462675704s) [noise=true , address=145.79.227.14:4838 , piece_id=FH4HHUR4VXWOGWOJTYTBZSZWLMJZGYECX7PWH2YNQHJBJFTNVVXA, seg_pos={0 0}, upload=62984]: Uploading piece... Sep 9 13:02:02.423227343 (71h33m38.462800463s) [noise=true , address=45.91.116.5:4299 , piece_id=226BJEJXHVG6VMZ3PNIX6GBWRAXLLBSBDKKWRCOODLYAOOY5ZP2A, seg_pos={0 0}, upload=62984]: Uploading piece... Sep 9 13:02:02.423617109 (71h33m38.463190229s) [noise=true , address=45.91.116.4:4939 , piece_id=NOHOVQIONYLMGVQZIV3ASV26FOTE4FOPMZV5ZV7M2LXKC2IGXSQQ, seg_pos={0 0}, upload=62984]: Uploading piece... Sep 9 13:02:02.423985975 (71h33m38.463559095s) [noise=true , address=45.91.116.12:4227 , piece_id=SMHKNOK455ADUNPCSQT2WPXBTS6VEYIS2YGDS3D7D2N5CK53XQ6A, seg_pos={0 0}, upload=62984]: Uploading piece... Sep 9 13:02:02.424356303 (71h33m38.463929423s) [noise=true , address=145.79.227.17:4972 , piece_id=S3G7RQM6IZUYT5IO3BNQHAURQXJY5MKXMHGGTYP5E4ZJQWAI3NSQ, seg_pos={0 0}, upload=62984]: Uploading piece... Sep 9 13:02:02.424720230 (71h33m38.46429336s) [noise=true , address=45.91.116.7:4009 , piece_id=H6PLR7VXVLGJQHO6AUC6B54D6ZNSYLTHVXEPCI2S257WOZOEATHA, seg_pos={0 0}, upload=62984]: Uploading piece... Sep 9 13:02:02.425059308 (71h33m38.464632429s) [noise=true , address=45.91.116.12:4225 , piece_id=6A3S4FAENMPF7KMVKLDH2GXMGF5IKG64JQDPJ5LYIU43EPWVTR4A, seg_pos={0 0}, upload=62984]: Uploading piece... Sep 9 13:02:02.425450777 (71h33m38.465023907s) [noise=true , address=77.90.31.18:4807 , piece_id=GCXI3SX7HMQDWXWLUIU3ISWJ4RI4C7XSS2PRSX2RJ37SBCSUHQJQ, seg_pos={0 0}, upload=62984]: Uploading piece... Sep 9 13:02:02.425852546 (71h33m38.465425676s) [noise=true , address=45.91.116.8:4045 , piece_id=KYM34DJEVFSPQIHNZLEJBNUGQY6HUMOCYUDDZV6QPBSXFILX7XOA, seg_pos={0 0}, upload=62984]: Uploading piece... Sep 9 13:02:02.426191155 (71h33m38.465764275s) [noise=true , address=77.90.31.12:4589 , piece_id=QWYUWBP6AX6KGTSTLEFVOBQGDFKL2VNI43OXSBRDTK2MY7ESNQ7A, seg_pos={0 0}, upload=62984]: Uploading piece... Sep 9 13:02:02.426424761 (71h33m38.465997881s) [noise=true , address=77.90.31.21:4878 , piece_id=ZPJQ77EPISRXLIRDV37PG22Q5FUY3J6FTSD6SAYCTXWK77ZLSQTQ, seg_pos={0 0}, upload=62984]: Uploading piece... Sep 9 13:02:02.426713945 (71h33m38.466287065s) [noise=true , address=77.90.31.14:4663 , piece_id=WVBAWQDHM5A4ME2W2RIC6XBHS7OHO23RK4ZJBX42U6UL7NLFK5XQ, seg_pos={0 0}, upload=62984]: Uploading piece... Sep 9 13:02:04.270452365 (71h33m40.310025485s) [upload=62984]: Next returned nil segment Sep 9 13:02:04.270468977 (71h33m40.310042097s) [upload=62984]: Waiting for error group managing segments... Sep 9 13:02:04.603326979 (71h33m40.642900099s) [noise=true , address=45.91.116.5:4299 , piece_id=226BJEJXHVG6VMZ3PNIX6GBWRAXLLBSBDKKWRCOODLYAOOY5ZP2A, seg_pos={0 0}, upload=62984]: Done uploading piece. err: <nil> Sep 9 13:02:04.603651089 (71h33m40.643224209s) [noise=true , address=145.79.227.3:4151 , piece_id=A5YPHPZGFGF7HYD5YBQAMQPW5PZWEBE4CDAD4OKFA2MXFS46CGAA, seg_pos={0 0}, upload=62984]: Done uploading piece. err: <nil> Sep 9 13:02:04.635128545 (71h33m40.674701665s) [noise=true , address=77.90.31.12:4589 , piece_id=QWYUWBP6AX6KGTSTLEFVOBQGDFKL2VNI43OXSBRDTK2MY7ESNQ7A, seg_pos={0 0}, upload=62984]: Done uploading piece. err: <nil> Sep 9 13:02:04.663976650 (71h33m40.70354977s) [noise=true , address=45.91.116.12:4227 , piece_id=SMHKNOK455ADUNPCSQT2WPXBTS6VEYIS2YGDS3D7D2N5CK53XQ6A, seg_pos={0 0}, upload=62984]: Done uploading piece. err: <nil> Sep 9 13:02:04.664709242 (71h33m40.704282362s) [noise=true , address=145.79.227.14:4838 , piece_id=FH4HHUR4VXWOGWOJTYTBZSZWLMJZGYECX7PWH2YNQHJBJFTNVVXA, seg_pos={0 0}, upload=62984]: Done uploading piece. err: <nil> Sep 9 13:02:04.694298624 (71h33m40.733871745s) [noise=true , address=45.91.116.8:4045 , piece_id=KYM34DJEVFSPQIHNZLEJBNUGQY6HUMOCYUDDZV6QPBSXFILX7XOA, seg_pos={0 0}, upload=62984]: Done uploading piece. err: <nil> Sep 9 13:02:04.697232700 (71h33m40.73680582s) [noise=true , address=45.91.116.7:4009 , piece_id=H6PLR7VXVLGJQHO6AUC6B54D6ZNSYLTHVXEPCI2S257WOZOEATHA, seg_pos={0 0}, upload=62984]: Done uploading piece. err: <nil> Sep 9 13:02:04.700793934 (71h33m40.740367054s) [noise=true , address=45.91.116.14:4189 , piece_id=YAOLLYSLMHRTS4FILGROPS5T5Z7KJTFPO6EWN3R6BTCFYXVY5TSA, seg_pos={0 0}, upload=62984]: Done uploading piece. err: <nil> Sep 9 13:02:04.723504473 (71h33m40.763077593s) [noise=true , address=45.91.116.4:4939 , piece_id=NOHOVQIONYLMGVQZIV3ASV26FOTE4FOPMZV5ZV7M2LXKC2IGXSQQ, seg_pos={0 0}, upload=62984]: Done uploading piece. err: <nil> Sep 9 13:02:04.739922792 (71h33m40.779495912s) [noise=true , address=77.90.31.14:4663 , piece_id=WVBAWQDHM5A4ME2W2RIC6XBHS7OHO23RK4ZJBX42U6UL7NLFK5XQ, seg_pos={0 0}, upload=62984]: Done uploading piece. err: <nil> Sep 9 13:02:04.765146991 (71h33m40.804720111s) [noise=true , address=77.90.31.18:4807 , piece_id=GCXI3SX7HMQDWXWLUIU3ISWJ4RI4C7XSS2PRSX2RJ37SBCSUHQJQ, seg_pos={0 0}, upload=62984]: Done uploading piece. err: <nil> Sep 9 13:02:04.822916549 (71h33m40.862489669s) [noise=true , address=77.90.31.21:4878 , piece_id=ZPJQ77EPISRXLIRDV37PG22Q5FUY3J6FTSD6SAYCTXWK77ZLSQTQ, seg_pos={0 0}, upload=62984]: Done uploading piece. err: <nil> Sep 9 13:02:04.957335736 (71h33m40.996908856s) [noise=true , address=45.91.116.12:4225 , piece_id=6A3S4FAENMPF7KMVKLDH2GXMGF5IKG64JQDPJ5LYIU43EPWVTR4A, seg_pos={0 0}, upload=62984]: Done uploading piece. err: <nil> Sep 9 13:02:04.957363088 (71h33m40.996936208s) [seg_pos={0 0}, upload=62984]: Segment reached optimal threshold of 13 pieces. Sep 9 13:02:04.957544426 (71h33m40.997117546s) [noise=true , address=145.79.227.17:4972 , piece_id=S3G7RQM6IZUYT5IO3BNQHAURQXJY5MKXMHGGTYP5E4ZJQWAI3NSQ, seg_pos={0 0}, upload=62984]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX): protocol: expected piece hash; context canceled; EOF Sep 9 13:02:04.957659506 (71h33m40.997232626s) [noise=true , address=77.90.31.15:4697 , piece_id=NWZ7SWEEM335EET7XKKCXASAFPSCAKDVPGV3NL3PSTVJZUSBJWFQ, seg_pos={0 0}, upload=62984]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5): protocol: write tcp 188.166.225.170:35158->77.90.31.15:4697: use of closed network connection; write tcp 188.166.225.170:35158->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35158->77.90.31.15:4697: use of closed network connection Sep 9 13:02:04.957685205 (71h33m40.997258325s) [noise=true , address=45.91.116.6:4975 , piece_id=CUMM6NUWSZLDL5VEJRWGC34D3WAU6KF25NUAA7F6AGFCGIZMINQQ, seg_pos={0 0}, upload=62984]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: write tcp 188.166.225.170:59238->45.91.116.6:4975: use of closed network connection; write tcp 188.166.225.170:59238->45.91.116.6:4975: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59238->45.91.116.6:4975: use of closed network connection Sep 9 13:02:04.957721435 (71h33m40.997294555s) [seg_pos={0 0}, upload=62984]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 13:02:04.957822718 (71h33m40.997395838s) [upload=62984]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 13:02:04.957827487 (71h33m40.997400607s) [upload=62984]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 13:02:05.466956195 (71h33m41.506529315s) [upload=62984]: Done uploading segments... Sep 9 13:02:05.466974429 (71h33m41.506547549s) [upload=62984]: Upload finished. err: <nil> Duration: 26.738569378s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 7 out of 60 is failed (threshold=3) [.............................X................XXX........XXX] duration: 30.002219008s FAIL (2025-09-09 13:02:31 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 13:02:02.099411653 (71h33m38.138984773s) [upload=62984]: Starting upload Sep 9 13:02:02.099494372 (71h33m38.139067492s) [upload=62984]: Done starting upload Sep 9 13:02:02.099619001 (71h33m38.139192131s) [upload=62984]: Uploading segments... Sep 9 13:02:02.099701118 (71h33m38.139274258s) [upload=62984]: Got next segment. Inline: false Sep 9 13:02:02.099762365 (71h33m38.139335495s) [upload=62984]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 13:02:02.099769329 (71h33m38.139342449s) [upload=62984]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 13:02:02.421764203 (71h33m38.461337333s) [seg_pos={0 0}, upload=62984]: Begin upload segment... Sep 9 13:02:02.421920031 (71h33m38.461493151s) [noise=true , address=45.91.116.6:4975 , piece_id=CUMM6NUWSZLDL5VEJRWGC34D3WAU6KF25NUAA7F6AGFCGIZMINQQ, seg_pos={0 0}, upload=62984]: Uploading piece... Sep 9 13:02:02.422448462 (71h33m38.462021592s) [noise=true , address=77.90.31.15:4697 , piece_id=NWZ7SWEEM335EET7XKKCXASAFPSCAKDVPGV3NL3PSTVJZUSBJWFQ, seg_pos={0 0}, upload=62984]: Uploading piece... Sep 9 13:02:02.422462329 (71h33m38.462035459s) [seg_pos={0 0}, upload=62984]: Done begin upload segment. Sep 9 13:02:02.422618006 (71h33m38.462191136s) [noise=true , address=145.79.227.3:4151 , piece_id=A5YPHPZGFGF7HYD5YBQAMQPW5PZWEBE4CDAD4OKFA2MXFS46CGAA, seg_pos={0 0}, upload=62984]: Uploading piece... Sep 9 13:02:02.422787642 (71h33m38.462360772s) [noise=true , address=45.91.116.14:4189 , piece_id=YAOLLYSLMHRTS4FILGROPS5T5Z7KJTFPO6EWN3R6BTCFYXVY5TSA, seg_pos={0 0}, upload=62984]: Uploading piece... Sep 9 13:02:02.423102584 (71h33m38.462675704s) [noise=true , address=145.79.227.14:4838 , piece_id=FH4HHUR4VXWOGWOJTYTBZSZWLMJZGYECX7PWH2YNQHJBJFTNVVXA, seg_pos={0 0}, upload=62984]: Uploading piece... Sep 9 13:02:02.423227343 (71h33m38.462800463s) [noise=true , address=45.91.116.5:4299 , piece_id=226BJEJXHVG6VMZ3PNIX6GBWRAXLLBSBDKKWRCOODLYAOOY5ZP2A, seg_pos={0 0}, upload=62984]: Uploading piece... Sep 9 13:02:02.423617109 (71h33m38.463190229s) [noise=true , address=45.91.116.4:4939 , piece_id=NOHOVQIONYLMGVQZIV3ASV26FOTE4FOPMZV5ZV7M2LXKC2IGXSQQ, seg_pos={0 0}, upload=62984]: Uploading piece... Sep 9 13:02:02.423985975 (71h33m38.463559095s) [noise=true , address=45.91.116.12:4227 , piece_id=SMHKNOK455ADUNPCSQT2WPXBTS6VEYIS2YGDS3D7D2N5CK53XQ6A, seg_pos={0 0}, upload=62984]: Uploading piece... Sep 9 13:02:02.424356303 (71h33m38.463929423s) [noise=true , address=145.79.227.17:4972 , piece_id=S3G7RQM6IZUYT5IO3BNQHAURQXJY5MKXMHGGTYP5E4ZJQWAI3NSQ, seg_pos={0 0}, upload=62984]: Uploading piece... Sep 9 13:02:02.424720230 (71h33m38.46429336s) [noise=true , address=45.91.116.7:4009 , piece_id=H6PLR7VXVLGJQHO6AUC6B54D6ZNSYLTHVXEPCI2S257WOZOEATHA, seg_pos={0 0}, upload=62984]: Uploading piece... Sep 9 13:02:02.425059308 (71h33m38.464632429s) [noise=true , address=45.91.116.12:4225 , piece_id=6A3S4FAENMPF7KMVKLDH2GXMGF5IKG64JQDPJ5LYIU43EPWVTR4A, seg_pos={0 0}, upload=62984]: Uploading piece... Sep 9 13:02:02.425450777 (71h33m38.465023907s) [noise=true , address=77.90.31.18:4807 , piece_id=GCXI3SX7HMQDWXWLUIU3ISWJ4RI4C7XSS2PRSX2RJ37SBCSUHQJQ, seg_pos={0 0}, upload=62984]: Uploading piece... Sep 9 13:02:02.425852546 (71h33m38.465425676s) [noise=true , address=45.91.116.8:4045 , piece_id=KYM34DJEVFSPQIHNZLEJBNUGQY6HUMOCYUDDZV6QPBSXFILX7XOA, seg_pos={0 0}, upload=62984]: Uploading piece... Sep 9 13:02:02.426191155 (71h33m38.465764275s) [noise=true , address=77.90.31.12:4589 , piece_id=QWYUWBP6AX6KGTSTLEFVOBQGDFKL2VNI43OXSBRDTK2MY7ESNQ7A, seg_pos={0 0}, upload=62984]: Uploading piece... Sep 9 13:02:02.426424761 (71h33m38.465997881s) [noise=true , address=77.90.31.21:4878 , piece_id=ZPJQ77EPISRXLIRDV37PG22Q5FUY3J6FTSD6SAYCTXWK77ZLSQTQ, seg_pos={0 0}, upload=62984]: Uploading piece... Sep 9 13:02:02.426713945 (71h33m38.466287065s) [noise=true , address=77.90.31.14:4663 , piece_id=WVBAWQDHM5A4ME2W2RIC6XBHS7OHO23RK4ZJBX42U6UL7NLFK5XQ, seg_pos={0 0}, upload=62984]: Uploading piece... Sep 9 13:02:04.270452365 (71h33m40.310025485s) [upload=62984]: Next returned nil segment Sep 9 13:02:04.270468977 (71h33m40.310042097s) [upload=62984]: Waiting for error group managing segments... Sep 9 13:02:04.603326979 (71h33m40.642900099s) [noise=true , address=45.91.116.5:4299 , piece_id=226BJEJXHVG6VMZ3PNIX6GBWRAXLLBSBDKKWRCOODLYAOOY5ZP2A, seg_pos={0 0}, upload=62984]: Done uploading piece. err: <nil> Sep 9 13:02:04.603651089 (71h33m40.643224209s) [noise=true , address=145.79.227.3:4151 , piece_id=A5YPHPZGFGF7HYD5YBQAMQPW5PZWEBE4CDAD4OKFA2MXFS46CGAA, seg_pos={0 0}, upload=62984]: Done uploading piece. err: <nil> Sep 9 13:02:04.635128545 (71h33m40.674701665s) [noise=true , address=77.90.31.12:4589 , piece_id=QWYUWBP6AX6KGTSTLEFVOBQGDFKL2VNI43OXSBRDTK2MY7ESNQ7A, seg_pos={0 0}, upload=62984]: Done uploading piece. err: <nil> Sep 9 13:02:04.663976650 (71h33m40.70354977s) [noise=true , address=45.91.116.12:4227 , piece_id=SMHKNOK455ADUNPCSQT2WPXBTS6VEYIS2YGDS3D7D2N5CK53XQ6A, seg_pos={0 0}, upload=62984]: Done uploading piece. err: <nil> Sep 9 13:02:04.664709242 (71h33m40.704282362s) [noise=true , address=145.79.227.14:4838 , piece_id=FH4HHUR4VXWOGWOJTYTBZSZWLMJZGYECX7PWH2YNQHJBJFTNVVXA, seg_pos={0 0}, upload=62984]: Done uploading piece. err: <nil> Sep 9 13:02:04.694298624 (71h33m40.733871745s) [noise=true , address=45.91.116.8:4045 , piece_id=KYM34DJEVFSPQIHNZLEJBNUGQY6HUMOCYUDDZV6QPBSXFILX7XOA, seg_pos={0 0}, upload=62984]: Done uploading piece. err: <nil> Sep 9 13:02:04.697232700 (71h33m40.73680582s) [noise=true , address=45.91.116.7:4009 , piece_id=H6PLR7VXVLGJQHO6AUC6B54D6ZNSYLTHVXEPCI2S257WOZOEATHA, seg_pos={0 0}, upload=62984]: Done uploading piece. err: <nil> Sep 9 13:02:04.700793934 (71h33m40.740367054s) [noise=true , address=45.91.116.14:4189 , piece_id=YAOLLYSLMHRTS4FILGROPS5T5Z7KJTFPO6EWN3R6BTCFYXVY5TSA, seg_pos={0 0}, upload=62984]: Done uploading piece. err: <nil> Sep 9 13:02:04.723504473 (71h33m40.763077593s) [noise=true , address=45.91.116.4:4939 , piece_id=NOHOVQIONYLMGVQZIV3ASV26FOTE4FOPMZV5ZV7M2LXKC2IGXSQQ, seg_pos={0 0}, upload=62984]: Done uploading piece. err: <nil> Sep 9 13:02:04.739922792 (71h33m40.779495912s) [noise=true , address=77.90.31.14:4663 , piece_id=WVBAWQDHM5A4ME2W2RIC6XBHS7OHO23RK4ZJBX42U6UL7NLFK5XQ, seg_pos={0 0}, upload=62984]: Done uploading piece. err: <nil> Sep 9 13:02:04.765146991 (71h33m40.804720111s) [noise=true , address=77.90.31.18:4807 , piece_id=GCXI3SX7HMQDWXWLUIU3ISWJ4RI4C7XSS2PRSX2RJ37SBCSUHQJQ, seg_pos={0 0}, upload=62984]: Done uploading piece. err: <nil> Sep 9 13:02:04.822916549 (71h33m40.862489669s) [noise=true , address=77.90.31.21:4878 , piece_id=ZPJQ77EPISRXLIRDV37PG22Q5FUY3J6FTSD6SAYCTXWK77ZLSQTQ, seg_pos={0 0}, upload=62984]: Done uploading piece. err: <nil> Sep 9 13:02:04.957335736 (71h33m40.996908856s) [noise=true , address=45.91.116.12:4225 , piece_id=6A3S4FAENMPF7KMVKLDH2GXMGF5IKG64JQDPJ5LYIU43EPWVTR4A, seg_pos={0 0}, upload=62984]: Done uploading piece. err: <nil> Sep 9 13:02:04.957363088 (71h33m40.996936208s) [seg_pos={0 0}, upload=62984]: Segment reached optimal threshold of 13 pieces. Sep 9 13:02:04.957544426 (71h33m40.997117546s) [noise=true , address=145.79.227.17:4972 , piece_id=S3G7RQM6IZUYT5IO3BNQHAURQXJY5MKXMHGGTYP5E4ZJQWAI3NSQ, seg_pos={0 0}, upload=62984]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX): protocol: expected piece hash; context canceled; EOF Sep 9 13:02:04.957659506 (71h33m40.997232626s) [noise=true , address=77.90.31.15:4697 , piece_id=NWZ7SWEEM335EET7XKKCXASAFPSCAKDVPGV3NL3PSTVJZUSBJWFQ, seg_pos={0 0}, upload=62984]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5): protocol: write tcp 188.166.225.170:35158->77.90.31.15:4697: use of closed network connection; write tcp 188.166.225.170:35158->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35158->77.90.31.15:4697: use of closed network connection Sep 9 13:02:04.957685205 (71h33m40.997258325s) [noise=true , address=45.91.116.6:4975 , piece_id=CUMM6NUWSZLDL5VEJRWGC34D3WAU6KF25NUAA7F6AGFCGIZMINQQ, seg_pos={0 0}, upload=62984]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: write tcp 188.166.225.170:59238->45.91.116.6:4975: use of closed network connection; write tcp 188.166.225.170:59238->45.91.116.6:4975: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59238->45.91.116.6:4975: use of closed network connection Sep 9 13:02:04.957721435 (71h33m40.997294555s) [seg_pos={0 0}, upload=62984]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 13:02:04.957822718 (71h33m40.997395838s) [upload=62984]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 13:02:04.957827487 (71h33m40.997400607s) [upload=62984]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 13:02:05.466956195 (71h33m41.506529315s) [upload=62984]: Done uploading segments... Sep 9 13:02:05.466974429 (71h33m41.506547549s) [upload=62984]: Upload finished. err: <nil> Duration: 30.002246683s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 6 out of 60 is failed (threshold=3) [..............................X................XXX........XX] duration: 30.002206662s FAIL (2025-09-09 13:01:32 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 13:01:04.485029002 (71h32m40.524602133s) [upload=62966]: Starting upload Sep 9 13:01:04.485103665 (71h32m40.524676785s) [upload=62966]: Done starting upload Sep 9 13:01:04.485200891 (71h32m40.524774021s) [upload=62966]: Uploading segments... Sep 9 13:01:04.485281826 (71h32m40.524854956s) [upload=62966]: Got next segment. Inline: false Sep 9 13:01:04.485311082 (71h32m40.524884202s) [upload=62966]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 13:01:04.485317514 (71h32m40.524890634s) [upload=62966]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 13:01:06.501626660 (71h32m42.54119978s) [seg_pos={0 0}, upload=62966]: Begin upload segment... Sep 9 13:01:06.501687766 (71h32m42.541260896s) [seg_pos={0 0}, upload=62966]: Done begin upload segment. Sep 9 13:01:06.501718395 (71h32m42.541291515s) [noise=true , address=145.79.227.7:4295 , piece_id=TJAHWBNKHH5ZMUM5I2RFHMY2SYXB7AOYQ2ZMAMEEBC5HKM7TIHEQ, seg_pos={0 0}, upload=62966]: Uploading piece... Sep 9 13:01:06.501751197 (71h32m42.541324327s) [noise=true , address=145.79.227.11:4732 , piece_id=4O6XJLX4NT226ALKCFICJMQZCRKE5ZCEFGJMPTHNQLINO6GQCO4A, seg_pos={0 0}, upload=62966]: Uploading piece... Sep 9 13:01:06.502440897 (71h32m42.542014017s) [noise=true , address=45.91.116.5:4298 , piece_id=X3Q5WB3WDON5SB2ALN3ACU6NTSYSAOLCDYIRITP76CBBEVT3TETA, seg_pos={0 0}, upload=62966]: Uploading piece... Sep 9 13:01:06.502520960 (71h32m42.54209408s) [noise=true , address=145.79.227.14:4840 , piece_id=EICJBR7XJ5N3P5LHU3JBHEONLMEA6IHJ5OUVFHS2BOYVNIRQCOIA, seg_pos={0 0}, upload=62966]: Uploading piece... Sep 9 13:01:06.502932988 (71h32m42.542506119s) [noise=true , address=77.90.31.19:4842 , piece_id=EQRAOYBKB43DSH5QCICLCCXWHQ552JF64QF46PZTI2LTLVB4JQBA, seg_pos={0 0}, upload=62966]: Uploading piece... Sep 9 13:01:06.503309429 (71h32m42.542882549s) [noise=true , address=45.91.116.11:4118 , piece_id=TYFR4K3JRICEHI74U2PEHIYPBQGVMSS5DQNF5GMPR6CDPKCSWN3Q, seg_pos={0 0}, upload=62966]: Uploading piece... Sep 9 13:01:06.503679137 (71h32m42.543252257s) [noise=true , address=77.90.31.19:4841 , piece_id=ON4TEXCWJHEWOJ5ATZ42NUIBGZKGRTH7NGS6R6AC2JLXZ5KZANXQ, seg_pos={0 0}, upload=62966]: Uploading piece... Sep 9 13:01:06.504028666 (71h32m42.543601786s) [noise=true , address=45.91.116.4:4937 , piece_id=VMY26GHKAJTWETNJT5M6Z5AH6S5VJEUYRJHBZTQCTEJ7HUZIOCIA, seg_pos={0 0}, upload=62966]: Uploading piece... Sep 9 13:01:06.504378736 (71h32m42.543951866s) [noise=true , address=77.90.31.12:4589 , piece_id=B7U7WETRZTRLWO5CUUZDGRRWAK56CHSPSGM5RMONUAMB6QHPGOZA, seg_pos={0 0}, upload=62966]: Uploading piece... Sep 9 13:01:06.504743383 (71h32m42.544316503s) [noise=true , address=145.79.227.16:4912 , piece_id=QFKNKDSGFKQGJQ6CAKCSRSBNMDHPSBQFGPXUMHASTK6GZD3CRA5Q, seg_pos={0 0}, upload=62966]: Uploading piece... Sep 9 13:01:06.505089065 (71h32m42.544662185s) [noise=true , address=77.90.31.18:4807 , piece_id=VOFDXNYDMJ6UORK4CIEM3KKA4F5BFBJW7SCOYTVU6HOIXAKFW3BQ, seg_pos={0 0}, upload=62966]: Uploading piece... Sep 9 13:01:06.505453753 (71h32m42.545026873s) [noise=true , address=45.91.116.14:4189 , piece_id=XE67AOIEH2MZT3SX4ESJOQGKI2WTYUCQLJ5ILT2NMYZO4EGVH2CQ, seg_pos={0 0}, upload=62966]: Uploading piece... Sep 9 13:01:06.505860130 (71h32m42.545433251s) [noise=true , address=77.90.31.17:4770 , piece_id=DZVEJUTOKTMLECEMBX6M7NGYT2YPNOTDBYXNIN7GFXPDHUSXICRA, seg_pos={0 0}, upload=62966]: Uploading piece... Sep 9 13:01:06.506247612 (71h32m42.545820732s) [noise=true , address=145.79.227.7:4293 , piece_id=AJ7W2FLV2SJ53UAG4POP2DATCZ7JWKN5W32UK7IXT57D7PHPXAHQ, seg_pos={0 0}, upload=62966]: Uploading piece... Sep 9 13:01:06.506632879 (71h32m42.546205999s) [noise=true , address=45.91.116.6:4973 , piece_id=IRPZHTTYWSEV7EPEAK57CYGDYWXL4OLBRZKGULKV4UPG3HTTDTPA, seg_pos={0 0}, upload=62966]: Uploading piece... Sep 9 13:01:06.507005612 (71h32m42.546578743s) [noise=true , address=45.91.116.7:4010 , piece_id=LSVGWPZ5JCRVF664E4NIXCK4T5NEZ6XV44YYXGHSZIXJVZ7UPCMA, seg_pos={0 0}, upload=62966]: Uploading piece... Sep 9 13:01:08.299355233 (71h32m44.338928353s) [upload=62966]: Next returned nil segment Sep 9 13:01:08.299413454 (71h32m44.338986574s) [upload=62966]: Waiting for error group managing segments... Sep 9 13:01:08.596328325 (71h32m44.635901456s) [noise=true , address=145.79.227.14:4840 , piece_id=EICJBR7XJ5N3P5LHU3JBHEONLMEA6IHJ5OUVFHS2BOYVNIRQCOIA, seg_pos={0 0}, upload=62966]: Done uploading piece. err: <nil> Sep 9 13:01:08.619566014 (71h32m44.659139134s) [noise=true , address=145.79.227.11:4732 , piece_id=4O6XJLX4NT226ALKCFICJMQZCRKE5ZCEFGJMPTHNQLINO6GQCO4A, seg_pos={0 0}, upload=62966]: Done uploading piece. err: <nil> Sep 9 13:01:08.682719916 (71h32m44.722293037s) [noise=true , address=45.91.116.4:4937 , piece_id=VMY26GHKAJTWETNJT5M6Z5AH6S5VJEUYRJHBZTQCTEJ7HUZIOCIA, seg_pos={0 0}, upload=62966]: Done uploading piece. err: <nil> Sep 9 13:01:08.713316156 (71h32m44.752889286s) [noise=true , address=145.79.227.7:4295 , piece_id=TJAHWBNKHH5ZMUM5I2RFHMY2SYXB7AOYQ2ZMAMEEBC5HKM7TIHEQ, seg_pos={0 0}, upload=62966]: Done uploading piece. err: <nil> Sep 9 13:01:08.721312859 (71h32m44.760885979s) [noise=true , address=145.79.227.16:4912 , piece_id=QFKNKDSGFKQGJQ6CAKCSRSBNMDHPSBQFGPXUMHASTK6GZD3CRA5Q, seg_pos={0 0}, upload=62966]: Done uploading piece. err: <nil> Sep 9 13:01:08.738453949 (71h32m44.778027079s) [noise=true , address=45.91.116.5:4298 , piece_id=X3Q5WB3WDON5SB2ALN3ACU6NTSYSAOLCDYIRITP76CBBEVT3TETA, seg_pos={0 0}, upload=62966]: Done uploading piece. err: <nil> Sep 9 13:01:08.749261461 (71h32m44.788834581s) [noise=true , address=77.90.31.17:4770 , piece_id=DZVEJUTOKTMLECEMBX6M7NGYT2YPNOTDBYXNIN7GFXPDHUSXICRA, seg_pos={0 0}, upload=62966]: Done uploading piece. err: <nil> Sep 9 13:01:08.762314159 (71h32m44.801887279s) [noise=true , address=45.91.116.6:4973 , piece_id=IRPZHTTYWSEV7EPEAK57CYGDYWXL4OLBRZKGULKV4UPG3HTTDTPA, seg_pos={0 0}, upload=62966]: Done uploading piece. err: <nil> Sep 9 13:01:08.774196467 (71h32m44.813769587s) [noise=true , address=45.91.116.14:4189 , piece_id=XE67AOIEH2MZT3SX4ESJOQGKI2WTYUCQLJ5ILT2NMYZO4EGVH2CQ, seg_pos={0 0}, upload=62966]: Done uploading piece. err: <nil> Sep 9 13:01:08.775232309 (71h32m44.814805429s) [noise=true , address=77.90.31.18:4807 , piece_id=VOFDXNYDMJ6UORK4CIEM3KKA4F5BFBJW7SCOYTVU6HOIXAKFW3BQ, seg_pos={0 0}, upload=62966]: Done uploading piece. err: <nil> Sep 9 13:01:08.794313954 (71h32m44.833887074s) [noise=true , address=77.90.31.12:4589 , piece_id=B7U7WETRZTRLWO5CUUZDGRRWAK56CHSPSGM5RMONUAMB6QHPGOZA, seg_pos={0 0}, upload=62966]: Done uploading piece. err: <nil> Sep 9 13:01:08.797868837 (71h32m44.837441957s) [noise=true , address=77.90.31.19:4841 , piece_id=ON4TEXCWJHEWOJ5ATZ42NUIBGZKGRTH7NGS6R6AC2JLXZ5KZANXQ, seg_pos={0 0}, upload=62966]: Done uploading piece. err: <nil> Sep 9 13:01:08.819349463 (71h32m44.858922583s) [noise=true , address=145.79.227.7:4293 , piece_id=AJ7W2FLV2SJ53UAG4POP2DATCZ7JWKN5W32UK7IXT57D7PHPXAHQ, seg_pos={0 0}, upload=62966]: Done uploading piece. err: <nil> Sep 9 13:01:08.819412723 (71h32m44.858985843s) [seg_pos={0 0}, upload=62966]: Segment reached optimal threshold of 13 pieces. Sep 9 13:01:08.819679674 (71h32m44.859252795s) [noise=true , address=45.91.116.7:4010 , piece_id=LSVGWPZ5JCRVF664E4NIXCK4T5NEZ6XV44YYXGHSZIXJVZ7UPCMA, seg_pos={0 0}, upload=62966]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w): protocol: expected piece hash; context canceled; EOF Sep 9 13:01:08.819710123 (71h32m44.859283253s) [noise=true , address=77.90.31.19:4842 , piece_id=EQRAOYBKB43DSH5QCICLCCXWHQ552JF64QF46PZTI2LTLVB4JQBA, seg_pos={0 0}, upload=62966]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF Sep 9 13:01:08.819760269 (71h32m44.859333389s) [noise=true , address=45.91.116.11:4118 , piece_id=TYFR4K3JRICEHI74U2PEHIYPBQGVMSS5DQNF5GMPR6CDPKCSWN3Q, seg_pos={0 0}, upload=62966]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: write tcp 188.166.225.170:53282->45.91.116.11:4118: use of closed network connection; write tcp 188.166.225.170:53282->45.91.116.11:4118: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53282->45.91.116.11:4118: use of closed network connection Sep 9 13:01:08.819775138 (71h32m44.859348258s) [seg_pos={0 0}, upload=62966]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 13:01:08.819851314 (71h32m44.859424434s) [upload=62966]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 13:01:08.819855652 (71h32m44.859428772s) [upload=62966]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 13:01:09.232080342 (71h32m45.271653472s) [upload=62966]: Done uploading segments... Sep 9 13:01:09.232121831 (71h32m45.271694961s) [upload=62966]: Upload finished. err: <nil> Duration: 30.002237852s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [...............................X................XXX........X] duration: 30.002544015s FAIL (2025-09-09 13:00:31 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 13:00:02.546893079 (71h31m38.586466209s) [upload=62949]: Starting upload Sep 9 13:00:02.547003921 (71h31m38.586577041s) [upload=62949]: Done starting upload Sep 9 13:00:02.547094374 (71h31m38.586667514s) [upload=62949]: Uploading segments... Sep 9 13:00:02.547368308 (71h31m38.586941438s) [upload=62949]: Got next segment. Inline: false Sep 9 13:00:02.547437010 (71h31m38.58701014s) [upload=62949]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 13:00:02.547445356 (71h31m38.587018486s) [upload=62949]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 13:00:02.818250562 (71h31m38.857823692s) [seg_pos={0 0}, upload=62949]: Begin upload segment... Sep 9 13:00:02.818402934 (71h31m38.857976064s) [seg_pos={0 0}, upload=62949]: Done begin upload segment. Sep 9 13:00:02.818443201 (71h31m38.858016331s) [noise=true , address=77.90.31.12:4592 , piece_id=ODBKFUTOU3FOZ3BXBMUFL2CHXK3W567GBEX6HFJQ3LVQGK3EXCBA, seg_pos={0 0}, upload=62949]: Uploading piece... Sep 9 13:00:02.818454824 (71h31m38.858027954s) [noise=true , address=45.91.116.5:4298 , piece_id=A3HADD6UPGRYJEDAPQEGIMTMOX44SN5HYFVLI67AJYCL2QHHCSGQ, seg_pos={0 0}, upload=62949]: Uploading piece... Sep 9 13:00:02.818585944 (71h31m38.858159074s) [noise=true , address=77.90.31.10:4518 , piece_id=JE3EWYR7UWSW3TMS2VP7H5D5SLJ7FSIA2A5NXOBLHX7NRGYVJEPA, seg_pos={0 0}, upload=62949]: Uploading piece... Sep 9 13:00:02.819060032 (71h31m38.858633162s) [noise=true , address=77.90.31.15:4697 , piece_id=GSCECFAFMOK3DX5MYNW6ZXL5JMZ7JUT52OCMFRGQKVHOG54M6EOQ, seg_pos={0 0}, upload=62949]: Uploading piece... Sep 9 13:00:02.819172948 (71h31m38.858746088s) [noise=true , address=77.90.31.14:4662 , piece_id=AJK2WQFFJJUYGYE2UMKIQPDHOFLT2QOZHZ7G6O5S7CNQ7BTKCYFQ, seg_pos={0 0}, upload=62949]: Uploading piece... Sep 9 13:00:02.819507718 (71h31m38.859080838s) [noise=true , address=45.91.116.6:4975 , piece_id=VUQR4SUFSRAY3WT5ZS5WTCVW2RSQ6RXRS2GYCQLWU35NKYBX63BQ, seg_pos={0 0}, upload=62949]: Uploading piece... Sep 9 13:00:02.819938753 (71h31m38.859511883s) [noise=true , address=45.91.116.10:4081 , piece_id=NYZ4DLAG7DWBZCAK4V7JYPVJTVD4XW5VMYTGXUYCVXU6X6ZJQIWQ, seg_pos={0 0}, upload=62949]: Uploading piece... Sep 9 13:00:02.819955035 (71h31m38.859528165s) [noise=true , address=145.79.227.6:4257 , piece_id=35HBLBFVFCXGJ27AQGXWAEXKSQZ2KRWOFP2UPJZRG7OYAKOMQDIQ, seg_pos={0 0}, upload=62949]: Uploading piece... Sep 9 13:00:02.820404244 (71h31m38.859977374s) [noise=true , address=45.91.116.9:4263 , piece_id=M3PHVDP2UJURQS5WQSDN445OQSGSGICDX5HY2CUHO3FTUPSQ6H2A, seg_pos={0 0}, upload=62949]: Uploading piece... Sep 9 13:00:02.820457245 (71h31m38.860030375s) [noise=true , address=45.91.116.4:4939 , piece_id=GY5VEXH42RDX45JY6ZVCMC3DSRTZEYTW7FHEUJTRAVHXEZDH4PFA, seg_pos={0 0}, upload=62949]: Uploading piece... Sep 9 13:00:02.820855347 (71h31m38.860428477s) [noise=true , address=145.79.227.15:4874 , piece_id=XCVCFUIUBF7RJQJG7V6PGF6SXQO7Y5CWNYHKHQC53D4L7X6J7K6Q, seg_pos={0 0}, upload=62949]: Uploading piece... Sep 9 13:00:02.820882820 (71h31m38.86045595s) [noise=true , address=45.91.116.9:4262 , piece_id=EY3RT45DEGPYYIITM2WRPG54GXZQEOY2X4DT3NQF4PNJKDZNQOWA, seg_pos={0 0}, upload=62949]: Uploading piece... Sep 9 13:00:02.821419115 (71h31m38.860992246s) [noise=true , address=45.91.116.11:4118 , piece_id=AFGLCC7GJMHB66ZPTCBFXBWGVG3UWJDC4IH4IGZTHTLVKGS5237A, seg_pos={0 0}, upload=62949]: Uploading piece... Sep 9 13:00:02.822002072 (71h31m38.861575202s) [noise=true , address=77.90.31.19:4841 , piece_id=KJRKDQUK6XHT4ON7XJ7W7FETHGT37VHP26RWDKMYFZW4RRPYS2OA, seg_pos={0 0}, upload=62949]: Uploading piece... Sep 9 13:00:02.822764239 (71h31m38.862337369s) [noise=true , address=145.79.227.11:4730 , piece_id=JMRXY2BXQJPANAQNZJE77E5YS236QE44V7TL4FKSPEVWWTMBZEYQ, seg_pos={0 0}, upload=62949]: Uploading piece... Sep 9 13:00:02.823277862 (71h31m38.862850992s) [noise=true , address=45.91.116.14:4190 , piece_id=5J6R6LH6AKMNNXQ5L52Y3A3IEHVLF3QYSHXSZZIA7JH3B22TUASQ, seg_pos={0 0}, upload=62949]: Uploading piece... Sep 9 13:00:04.691230469 (71h31m40.730803599s) [upload=62949]: Next returned nil segment Sep 9 13:00:04.691256459 (71h31m40.730829579s) [upload=62949]: Waiting for error group managing segments... Sep 9 13:00:05.005000384 (71h31m41.044573524s) [noise=true , address=45.91.116.6:4975 , piece_id=VUQR4SUFSRAY3WT5ZS5WTCVW2RSQ6RXRS2GYCQLWU35NKYBX63BQ, seg_pos={0 0}, upload=62949]: Done uploading piece. err: <nil> Sep 9 13:00:05.029090273 (71h31m41.068663403s) [noise=true , address=77.90.31.10:4518 , piece_id=JE3EWYR7UWSW3TMS2VP7H5D5SLJ7FSIA2A5NXOBLHX7NRGYVJEPA, seg_pos={0 0}, upload=62949]: Done uploading piece. err: <nil> Sep 9 13:00:05.046996057 (71h31m41.086569187s) [noise=true , address=45.91.116.11:4118 , piece_id=AFGLCC7GJMHB66ZPTCBFXBWGVG3UWJDC4IH4IGZTHTLVKGS5237A, seg_pos={0 0}, upload=62949]: Done uploading piece. err: <nil> Sep 9 13:00:05.056046907 (71h31m41.095620047s) [noise=true , address=77.90.31.15:4697 , piece_id=GSCECFAFMOK3DX5MYNW6ZXL5JMZ7JUT52OCMFRGQKVHOG54M6EOQ, seg_pos={0 0}, upload=62949]: Done uploading piece. err: <nil> Sep 9 13:00:05.056993048 (71h31m41.096566178s) [noise=true , address=45.91.116.9:4262 , piece_id=EY3RT45DEGPYYIITM2WRPG54GXZQEOY2X4DT3NQF4PNJKDZNQOWA, seg_pos={0 0}, upload=62949]: Done uploading piece. err: <nil> Sep 9 13:00:05.069737245 (71h31m41.109310375s) [noise=true , address=145.79.227.6:4257 , piece_id=35HBLBFVFCXGJ27AQGXWAEXKSQZ2KRWOFP2UPJZRG7OYAKOMQDIQ, seg_pos={0 0}, upload=62949]: Done uploading piece. err: <nil> Sep 9 13:00:05.069954040 (71h31m41.10952717s) [noise=true , address=45.91.116.4:4939 , piece_id=GY5VEXH42RDX45JY6ZVCMC3DSRTZEYTW7FHEUJTRAVHXEZDH4PFA, seg_pos={0 0}, upload=62949]: Done uploading piece. err: <nil> Sep 9 13:00:05.073172800 (71h31m41.11274593s) [noise=true , address=145.79.227.11:4730 , piece_id=JMRXY2BXQJPANAQNZJE77E5YS236QE44V7TL4FKSPEVWWTMBZEYQ, seg_pos={0 0}, upload=62949]: Done uploading piece. err: <nil> Sep 9 13:00:05.077378939 (71h31m41.116952069s) [noise=true , address=45.91.116.5:4298 , piece_id=A3HADD6UPGRYJEDAPQEGIMTMOX44SN5HYFVLI67AJYCL2QHHCSGQ, seg_pos={0 0}, upload=62949]: Done uploading piece. err: <nil> Sep 9 13:00:05.078992156 (71h31m41.118565286s) [noise=true , address=77.90.31.12:4592 , piece_id=ODBKFUTOU3FOZ3BXBMUFL2CHXK3W567GBEX6HFJQ3LVQGK3EXCBA, seg_pos={0 0}, upload=62949]: Done uploading piece. err: <nil> Sep 9 13:00:05.081904759 (71h31m41.12147789s) [noise=true , address=77.90.31.14:4662 , piece_id=AJK2WQFFJJUYGYE2UMKIQPDHOFLT2QOZHZ7G6O5S7CNQ7BTKCYFQ, seg_pos={0 0}, upload=62949]: Done uploading piece. err: <nil> Sep 9 13:00:05.122849762 (71h31m41.162422892s) [noise=true , address=45.91.116.9:4263 , piece_id=M3PHVDP2UJURQS5WQSDN445OQSGSGICDX5HY2CUHO3FTUPSQ6H2A, seg_pos={0 0}, upload=62949]: Done uploading piece. err: <nil> Sep 9 13:00:05.184845619 (71h31m41.224418759s) [noise=true , address=77.90.31.19:4841 , piece_id=KJRKDQUK6XHT4ON7XJ7W7FETHGT37VHP26RWDKMYFZW4RRPYS2OA, seg_pos={0 0}, upload=62949]: Done uploading piece. err: <nil> Sep 9 13:00:05.184872421 (71h31m41.224445551s) [seg_pos={0 0}, upload=62949]: Segment reached optimal threshold of 13 pieces. Sep 9 13:00:05.185074667 (71h31m41.224647797s) [noise=true , address=45.91.116.10:4081 , piece_id=NYZ4DLAG7DWBZCAK4V7JYPVJTVD4XW5VMYTGXUYCVXU6X6ZJQIWQ, seg_pos={0 0}, upload=62949]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): internal: context canceled Sep 9 13:00:05.185207001 (71h31m41.224780131s) [noise=true , address=45.91.116.14:4190 , piece_id=5J6R6LH6AKMNNXQ5L52Y3A3IEHVLF3QYSHXSZZIA7JH3B22TUASQ, seg_pos={0 0}, upload=62949]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: write tcp 188.166.225.170:50192->45.91.116.14:4190: use of closed network connection; write tcp 188.166.225.170:50192->45.91.116.14:4190: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50192->45.91.116.14:4190: use of closed network connection Sep 9 13:00:05.185217490 (71h31m41.22479062s) [noise=true , address=145.79.227.15:4874 , piece_id=XCVCFUIUBF7RJQJG7V6PGF6SXQO7Y5CWNYHKHQC53D4L7X6J7K6Q, seg_pos={0 0}, upload=62949]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: write tcp 188.166.225.170:38310->145.79.227.15:4874: use of closed network connection; write tcp 188.166.225.170:38310->145.79.227.15:4874: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38310->145.79.227.15:4874: use of closed network connection Sep 9 13:00:05.185268057 (71h31m41.224841187s) [seg_pos={0 0}, upload=62949]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 13:00:05.185393728 (71h31m41.224966858s) [upload=62949]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 13:00:05.185401493 (71h31m41.224974623s) [upload=62949]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 13:00:05.575421923 (71h31m41.614995053s) [upload=62949]: Done uploading segments... Sep 9 13:00:05.575443595 (71h31m41.615016715s) [upload=62949]: Upload finished. err: <nil> Duration: 30.002571087s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [................................X................XXX........] duration: 16.666561082s FAIL (2025-09-09 13:00:00 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 12:54:45.380565865 (71h26m21.420138985s) [upload=62870]: Starting upload Sep 9 12:54:45.380622493 (71h26m21.420195613s) [upload=62870]: Done starting upload Sep 9 12:54:45.380740448 (71h26m21.420313568s) [upload=62870]: Uploading segments... Sep 9 12:54:45.380902939 (71h26m21.420476059s) [upload=62870]: Got next segment. Inline: false Sep 9 12:54:45.380948337 (71h26m21.420521447s) [upload=62870]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 12:54:45.381123361 (71h26m21.420696501s) [upload=62870]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 12:54:45.861358968 (71h26m21.900932088s) [seg_pos={0 0}, upload=62870]: Begin upload segment... Sep 9 12:54:45.861422110 (71h26m21.90099522s) [seg_pos={0 0}, upload=62870]: Done begin upload segment. Sep 9 12:54:45.861472715 (71h26m21.901045836s) [noise=true , address=45.91.116.8:4045 , piece_id=R5BJPE4Q5O2ZIY3U7JTDJPKZNCRIR33AOUO54SAPNYLVQ4XUV3UQ, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.861519054 (71h26m21.901092175s) [noise=true , address=77.90.31.14:4662 , piece_id=6LVBXKQARG6RCRZKQ3TEAAXMVUXDESLLXFRQSS36ZOYK5CR56G2Q, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.862102111 (71h26m21.901675231s) [noise=true , address=45.91.116.4:4939 , piece_id=D3ZWNOEEFM76GIK3GBXPZAPTKNMAUFZFEIIPSLVY6P6NBOBFEQDQ, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.862126126 (71h26m21.901699246s) [noise=true , address=45.91.116.12:4227 , piece_id=EKQXMW7B7K5BFPOW2Y5RT35LUVBWBIS5EZP3QU74WZCF3JWIYE3Q, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.862446549 (71h26m21.902019669s) [noise=true , address=45.91.116.10:4083 , piece_id=Q43W36TOXEZCOVUZL3AOY6GZANULT3VNNEVRDTT7N26IBVBDD2QQ, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.862516914 (71h26m21.902090034s) [noise=true , address=145.79.227.18:4005 , piece_id=SXQJVRK4JBZ4EBLCPS5EULPEK3KW2AQPHDYFTTREPEUBJ2UZU6YA, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.862857225 (71h26m21.902430345s) [noise=true , address=45.91.116.7:4009 , piece_id=RMM53FYXSXDKG6ZSIHIAMXBTLQ27TUSEMTQKZSGKGOABU5IF4S6Q, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.863002143 (71h26m21.902575283s) [noise=true , address=45.91.116.13:4153 , piece_id=Q3IVWHNJHOBBIWXZIFOC6BNAJFUGA67D2KAQLMHAC2PVZU3EVRFQ, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.863215671 (71h26m21.902788781s) [noise=true , address=45.91.116.5:4297 , piece_id=JPDIQKEWZZN2SRCK3OD7HBYPNWSS7KK3FLDB4GPZ43PG2MD4YNAA, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.863586441 (71h26m21.903159561s) [noise=true , address=45.91.116.9:4263 , piece_id=VG2PVXJD2Z4QGBY4FHMPXKXPUDSABZMVP5SOVCA7AF3DW7QTTGCA, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.863676172 (71h26m21.903249292s) [noise=true , address=45.91.116.11:4119 , piece_id=DFSH5QEMFLNOT4RFAULYJYCUTV7BDDDZSNDEN7TRBTT2GCE4XCMQ, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.864109311 (71h26m21.903682431s) [noise=true , address=77.90.31.19:4841 , piece_id=TIKC27S6UNPTUJLPC47PSYLT2DOBWKXV2FTYKWYONXNVGGYFFGIA, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.864462086 (71h26m21.904035206s) [noise=true , address=77.90.31.21:4879 , piece_id=XPLKFUZU7WVQL76TK5J4V6PR62KLT4ESFVSII5RBRWOZNPXJLARA, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.865168869 (71h26m21.904741989s) [noise=true , address=145.79.227.4:4187 , piece_id=V4XEUKSCCNLTWQ2FVLMUBYPED6REKNKHBOSZDRQMBCWLD4ES4NGA, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.865492809 (71h26m21.905065919s) [noise=true , address=45.91.116.14:4191 , piece_id=DPHEN4XWBF2CYGGS3AYCTYXKQQVU4BCXFSIL7WLHQNUEXGDX2VJQ, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.867918711 (71h26m21.907491831s) [noise=true , address=77.90.31.21:4877 , piece_id=Y6E6U3XJXSDNT6GFWTNYN3KHN4JJXI4CC4NZYEIJ4YTP4TBLTXVA, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:47.698898273 (71h26m23.738471383s) [upload=62870]: Next returned nil segment Sep 9 12:54:47.698920065 (71h26m23.738493185s) [upload=62870]: Waiting for error group managing segments... Sep 9 12:54:47.996322609 (71h26m24.035895719s) [noise=true , address=145.79.227.18:4005 , piece_id=SXQJVRK4JBZ4EBLCPS5EULPEK3KW2AQPHDYFTTREPEUBJ2UZU6YA, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.028352301 (71h26m24.067925421s) [noise=true , address=45.91.116.11:4119 , piece_id=DFSH5QEMFLNOT4RFAULYJYCUTV7BDDDZSNDEN7TRBTT2GCE4XCMQ, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.094974951 (71h26m24.134548072s) [noise=true , address=77.90.31.21:4879 , piece_id=XPLKFUZU7WVQL76TK5J4V6PR62KLT4ESFVSII5RBRWOZNPXJLARA, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.096813110 (71h26m24.13638622s) [noise=true , address=77.90.31.21:4877 , piece_id=Y6E6U3XJXSDNT6GFWTNYN3KHN4JJXI4CC4NZYEIJ4YTP4TBLTXVA, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.097220730 (71h26m24.13679385s) [noise=true , address=77.90.31.14:4662 , piece_id=6LVBXKQARG6RCRZKQ3TEAAXMVUXDESLLXFRQSS36ZOYK5CR56G2Q, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.128446042 (71h26m24.168019162s) [noise=true , address=145.79.227.4:4187 , piece_id=V4XEUKSCCNLTWQ2FVLMUBYPED6REKNKHBOSZDRQMBCWLD4ES4NGA, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.141392066 (71h26m24.180965176s) [noise=true , address=45.91.116.14:4191 , piece_id=DPHEN4XWBF2CYGGS3AYCTYXKQQVU4BCXFSIL7WLHQNUEXGDX2VJQ, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.148560975 (71h26m24.188134095s) [noise=true , address=45.91.116.8:4045 , piece_id=R5BJPE4Q5O2ZIY3U7JTDJPKZNCRIR33AOUO54SAPNYLVQ4XUV3UQ, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.150518240 (71h26m24.19009136s) [noise=true , address=45.91.116.12:4227 , piece_id=EKQXMW7B7K5BFPOW2Y5RT35LUVBWBIS5EZP3QU74WZCF3JWIYE3Q, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.153436375 (71h26m24.193009495s) [noise=true , address=77.90.31.19:4841 , piece_id=TIKC27S6UNPTUJLPC47PSYLT2DOBWKXV2FTYKWYONXNVGGYFFGIA, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.184113700 (71h26m24.22368682s) [noise=true , address=45.91.116.9:4263 , piece_id=VG2PVXJD2Z4QGBY4FHMPXKXPUDSABZMVP5SOVCA7AF3DW7QTTGCA, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.215045140 (71h26m24.25461826s) [noise=true , address=45.91.116.4:4939 , piece_id=D3ZWNOEEFM76GIK3GBXPZAPTKNMAUFZFEIIPSLVY6P6NBOBFEQDQ, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.247604766 (71h26m24.287177886s) [noise=true , address=45.91.116.13:4153 , piece_id=Q3IVWHNJHOBBIWXZIFOC6BNAJFUGA67D2KAQLMHAC2PVZU3EVRFQ, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.247625516 (71h26m24.287198636s) [seg_pos={0 0}, upload=62870]: Segment reached optimal threshold of 13 pieces. Sep 9 12:54:48.247738021 (71h26m24.287311141s) [noise=true , address=45.91.116.5:4297 , piece_id=JPDIQKEWZZN2SRCK3OD7HBYPNWSS7KK3FLDB4GPZ43PG2MD4YNAA, seg_pos={0 0}, upload=62870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Sep 9 12:54:48.247909579 (71h26m24.287482689s) [noise=true , address=45.91.116.10:4083 , piece_id=Q43W36TOXEZCOVUZL3AOY6GZANULT3VNNEVRDTT7N26IBVBDD2QQ, seg_pos={0 0}, upload=62870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: read tcp 188.166.225.170:49636->45.91.116.10:4083: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 9 12:54:48.247932804 (71h26m24.287505924s) [noise=true , address=45.91.116.7:4009 , piece_id=RMM53FYXSXDKG6ZSIHIAMXBTLQ27TUSEMTQKZSGKGOABU5IF4S6Q, seg_pos={0 0}, upload=62870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: write tcp 188.166.225.170:38196->45.91.116.7:4009: use of closed network connection; write tcp 188.166.225.170:38196->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38196->45.91.116.7:4009: use of closed network connection Sep 9 12:54:48.247983561 (71h26m24.287556681s) [seg_pos={0 0}, upload=62870]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 12:54:48.248073142 (71h26m24.287646262s) [upload=62870]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 12:54:48.248077821 (71h26m24.287650941s) [upload=62870]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 12:54:48.571633944 (71h26m24.611207064s) [upload=62870]: Done uploading segments... Sep 9 12:54:48.571653581 (71h26m24.611226701s) [upload=62870]: Upload finished. err: <nil> Duration: 16.666590569s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.................................X................XXX.......] duration: 10.343884345s FAIL (2025-09-09 12:59:35 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 12:54:45.380565865 (71h26m21.420138985s) [upload=62870]: Starting upload Sep 9 12:54:45.380622493 (71h26m21.420195613s) [upload=62870]: Done starting upload Sep 9 12:54:45.380740448 (71h26m21.420313568s) [upload=62870]: Uploading segments... Sep 9 12:54:45.380902939 (71h26m21.420476059s) [upload=62870]: Got next segment. Inline: false Sep 9 12:54:45.380948337 (71h26m21.420521447s) [upload=62870]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 12:54:45.381123361 (71h26m21.420696501s) [upload=62870]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 12:54:45.861358968 (71h26m21.900932088s) [seg_pos={0 0}, upload=62870]: Begin upload segment... Sep 9 12:54:45.861422110 (71h26m21.90099522s) [seg_pos={0 0}, upload=62870]: Done begin upload segment. Sep 9 12:54:45.861472715 (71h26m21.901045836s) [noise=true , address=45.91.116.8:4045 , piece_id=R5BJPE4Q5O2ZIY3U7JTDJPKZNCRIR33AOUO54SAPNYLVQ4XUV3UQ, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.861519054 (71h26m21.901092175s) [noise=true , address=77.90.31.14:4662 , piece_id=6LVBXKQARG6RCRZKQ3TEAAXMVUXDESLLXFRQSS36ZOYK5CR56G2Q, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.862102111 (71h26m21.901675231s) [noise=true , address=45.91.116.4:4939 , piece_id=D3ZWNOEEFM76GIK3GBXPZAPTKNMAUFZFEIIPSLVY6P6NBOBFEQDQ, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.862126126 (71h26m21.901699246s) [noise=true , address=45.91.116.12:4227 , piece_id=EKQXMW7B7K5BFPOW2Y5RT35LUVBWBIS5EZP3QU74WZCF3JWIYE3Q, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.862446549 (71h26m21.902019669s) [noise=true , address=45.91.116.10:4083 , piece_id=Q43W36TOXEZCOVUZL3AOY6GZANULT3VNNEVRDTT7N26IBVBDD2QQ, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.862516914 (71h26m21.902090034s) [noise=true , address=145.79.227.18:4005 , piece_id=SXQJVRK4JBZ4EBLCPS5EULPEK3KW2AQPHDYFTTREPEUBJ2UZU6YA, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.862857225 (71h26m21.902430345s) [noise=true , address=45.91.116.7:4009 , piece_id=RMM53FYXSXDKG6ZSIHIAMXBTLQ27TUSEMTQKZSGKGOABU5IF4S6Q, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.863002143 (71h26m21.902575283s) [noise=true , address=45.91.116.13:4153 , piece_id=Q3IVWHNJHOBBIWXZIFOC6BNAJFUGA67D2KAQLMHAC2PVZU3EVRFQ, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.863215671 (71h26m21.902788781s) [noise=true , address=45.91.116.5:4297 , piece_id=JPDIQKEWZZN2SRCK3OD7HBYPNWSS7KK3FLDB4GPZ43PG2MD4YNAA, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.863586441 (71h26m21.903159561s) [noise=true , address=45.91.116.9:4263 , piece_id=VG2PVXJD2Z4QGBY4FHMPXKXPUDSABZMVP5SOVCA7AF3DW7QTTGCA, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.863676172 (71h26m21.903249292s) [noise=true , address=45.91.116.11:4119 , piece_id=DFSH5QEMFLNOT4RFAULYJYCUTV7BDDDZSNDEN7TRBTT2GCE4XCMQ, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.864109311 (71h26m21.903682431s) [noise=true , address=77.90.31.19:4841 , piece_id=TIKC27S6UNPTUJLPC47PSYLT2DOBWKXV2FTYKWYONXNVGGYFFGIA, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.864462086 (71h26m21.904035206s) [noise=true , address=77.90.31.21:4879 , piece_id=XPLKFUZU7WVQL76TK5J4V6PR62KLT4ESFVSII5RBRWOZNPXJLARA, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.865168869 (71h26m21.904741989s) [noise=true , address=145.79.227.4:4187 , piece_id=V4XEUKSCCNLTWQ2FVLMUBYPED6REKNKHBOSZDRQMBCWLD4ES4NGA, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.865492809 (71h26m21.905065919s) [noise=true , address=45.91.116.14:4191 , piece_id=DPHEN4XWBF2CYGGS3AYCTYXKQQVU4BCXFSIL7WLHQNUEXGDX2VJQ, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.867918711 (71h26m21.907491831s) [noise=true , address=77.90.31.21:4877 , piece_id=Y6E6U3XJXSDNT6GFWTNYN3KHN4JJXI4CC4NZYEIJ4YTP4TBLTXVA, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:47.698898273 (71h26m23.738471383s) [upload=62870]: Next returned nil segment Sep 9 12:54:47.698920065 (71h26m23.738493185s) [upload=62870]: Waiting for error group managing segments... Sep 9 12:54:47.996322609 (71h26m24.035895719s) [noise=true , address=145.79.227.18:4005 , piece_id=SXQJVRK4JBZ4EBLCPS5EULPEK3KW2AQPHDYFTTREPEUBJ2UZU6YA, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.028352301 (71h26m24.067925421s) [noise=true , address=45.91.116.11:4119 , piece_id=DFSH5QEMFLNOT4RFAULYJYCUTV7BDDDZSNDEN7TRBTT2GCE4XCMQ, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.094974951 (71h26m24.134548072s) [noise=true , address=77.90.31.21:4879 , piece_id=XPLKFUZU7WVQL76TK5J4V6PR62KLT4ESFVSII5RBRWOZNPXJLARA, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.096813110 (71h26m24.13638622s) [noise=true , address=77.90.31.21:4877 , piece_id=Y6E6U3XJXSDNT6GFWTNYN3KHN4JJXI4CC4NZYEIJ4YTP4TBLTXVA, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.097220730 (71h26m24.13679385s) [noise=true , address=77.90.31.14:4662 , piece_id=6LVBXKQARG6RCRZKQ3TEAAXMVUXDESLLXFRQSS36ZOYK5CR56G2Q, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.128446042 (71h26m24.168019162s) [noise=true , address=145.79.227.4:4187 , piece_id=V4XEUKSCCNLTWQ2FVLMUBYPED6REKNKHBOSZDRQMBCWLD4ES4NGA, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.141392066 (71h26m24.180965176s) [noise=true , address=45.91.116.14:4191 , piece_id=DPHEN4XWBF2CYGGS3AYCTYXKQQVU4BCXFSIL7WLHQNUEXGDX2VJQ, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.148560975 (71h26m24.188134095s) [noise=true , address=45.91.116.8:4045 , piece_id=R5BJPE4Q5O2ZIY3U7JTDJPKZNCRIR33AOUO54SAPNYLVQ4XUV3UQ, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.150518240 (71h26m24.19009136s) [noise=true , address=45.91.116.12:4227 , piece_id=EKQXMW7B7K5BFPOW2Y5RT35LUVBWBIS5EZP3QU74WZCF3JWIYE3Q, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.153436375 (71h26m24.193009495s) [noise=true , address=77.90.31.19:4841 , piece_id=TIKC27S6UNPTUJLPC47PSYLT2DOBWKXV2FTYKWYONXNVGGYFFGIA, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.184113700 (71h26m24.22368682s) [noise=true , address=45.91.116.9:4263 , piece_id=VG2PVXJD2Z4QGBY4FHMPXKXPUDSABZMVP5SOVCA7AF3DW7QTTGCA, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.215045140 (71h26m24.25461826s) [noise=true , address=45.91.116.4:4939 , piece_id=D3ZWNOEEFM76GIK3GBXPZAPTKNMAUFZFEIIPSLVY6P6NBOBFEQDQ, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.247604766 (71h26m24.287177886s) [noise=true , address=45.91.116.13:4153 , piece_id=Q3IVWHNJHOBBIWXZIFOC6BNAJFUGA67D2KAQLMHAC2PVZU3EVRFQ, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.247625516 (71h26m24.287198636s) [seg_pos={0 0}, upload=62870]: Segment reached optimal threshold of 13 pieces. Sep 9 12:54:48.247738021 (71h26m24.287311141s) [noise=true , address=45.91.116.5:4297 , piece_id=JPDIQKEWZZN2SRCK3OD7HBYPNWSS7KK3FLDB4GPZ43PG2MD4YNAA, seg_pos={0 0}, upload=62870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Sep 9 12:54:48.247909579 (71h26m24.287482689s) [noise=true , address=45.91.116.10:4083 , piece_id=Q43W36TOXEZCOVUZL3AOY6GZANULT3VNNEVRDTT7N26IBVBDD2QQ, seg_pos={0 0}, upload=62870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: read tcp 188.166.225.170:49636->45.91.116.10:4083: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 9 12:54:48.247932804 (71h26m24.287505924s) [noise=true , address=45.91.116.7:4009 , piece_id=RMM53FYXSXDKG6ZSIHIAMXBTLQ27TUSEMTQKZSGKGOABU5IF4S6Q, seg_pos={0 0}, upload=62870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: write tcp 188.166.225.170:38196->45.91.116.7:4009: use of closed network connection; write tcp 188.166.225.170:38196->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38196->45.91.116.7:4009: use of closed network connection Sep 9 12:54:48.247983561 (71h26m24.287556681s) [seg_pos={0 0}, upload=62870]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 12:54:48.248073142 (71h26m24.287646262s) [upload=62870]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 12:54:48.248077821 (71h26m24.287650941s) [upload=62870]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 12:54:48.571633944 (71h26m24.611207064s) [upload=62870]: Done uploading segments... Sep 9 12:54:48.571653581 (71h26m24.611226701s) [upload=62870]: Upload finished. err: <nil> Duration: 10.343911016s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [..................................X................XXX......] duration: 14.480359414s FAIL (2025-09-09 12:58:54 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 12:54:45.380565865 (71h26m21.420138985s) [upload=62870]: Starting upload Sep 9 12:54:45.380622493 (71h26m21.420195613s) [upload=62870]: Done starting upload Sep 9 12:54:45.380740448 (71h26m21.420313568s) [upload=62870]: Uploading segments... Sep 9 12:54:45.380902939 (71h26m21.420476059s) [upload=62870]: Got next segment. Inline: false Sep 9 12:54:45.380948337 (71h26m21.420521447s) [upload=62870]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 12:54:45.381123361 (71h26m21.420696501s) [upload=62870]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 12:54:45.861358968 (71h26m21.900932088s) [seg_pos={0 0}, upload=62870]: Begin upload segment... Sep 9 12:54:45.861422110 (71h26m21.90099522s) [seg_pos={0 0}, upload=62870]: Done begin upload segment. Sep 9 12:54:45.861472715 (71h26m21.901045836s) [noise=true , address=45.91.116.8:4045 , piece_id=R5BJPE4Q5O2ZIY3U7JTDJPKZNCRIR33AOUO54SAPNYLVQ4XUV3UQ, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.861519054 (71h26m21.901092175s) [noise=true , address=77.90.31.14:4662 , piece_id=6LVBXKQARG6RCRZKQ3TEAAXMVUXDESLLXFRQSS36ZOYK5CR56G2Q, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.862102111 (71h26m21.901675231s) [noise=true , address=45.91.116.4:4939 , piece_id=D3ZWNOEEFM76GIK3GBXPZAPTKNMAUFZFEIIPSLVY6P6NBOBFEQDQ, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.862126126 (71h26m21.901699246s) [noise=true , address=45.91.116.12:4227 , piece_id=EKQXMW7B7K5BFPOW2Y5RT35LUVBWBIS5EZP3QU74WZCF3JWIYE3Q, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.862446549 (71h26m21.902019669s) [noise=true , address=45.91.116.10:4083 , piece_id=Q43W36TOXEZCOVUZL3AOY6GZANULT3VNNEVRDTT7N26IBVBDD2QQ, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.862516914 (71h26m21.902090034s) [noise=true , address=145.79.227.18:4005 , piece_id=SXQJVRK4JBZ4EBLCPS5EULPEK3KW2AQPHDYFTTREPEUBJ2UZU6YA, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.862857225 (71h26m21.902430345s) [noise=true , address=45.91.116.7:4009 , piece_id=RMM53FYXSXDKG6ZSIHIAMXBTLQ27TUSEMTQKZSGKGOABU5IF4S6Q, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.863002143 (71h26m21.902575283s) [noise=true , address=45.91.116.13:4153 , piece_id=Q3IVWHNJHOBBIWXZIFOC6BNAJFUGA67D2KAQLMHAC2PVZU3EVRFQ, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.863215671 (71h26m21.902788781s) [noise=true , address=45.91.116.5:4297 , piece_id=JPDIQKEWZZN2SRCK3OD7HBYPNWSS7KK3FLDB4GPZ43PG2MD4YNAA, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.863586441 (71h26m21.903159561s) [noise=true , address=45.91.116.9:4263 , piece_id=VG2PVXJD2Z4QGBY4FHMPXKXPUDSABZMVP5SOVCA7AF3DW7QTTGCA, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.863676172 (71h26m21.903249292s) [noise=true , address=45.91.116.11:4119 , piece_id=DFSH5QEMFLNOT4RFAULYJYCUTV7BDDDZSNDEN7TRBTT2GCE4XCMQ, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.864109311 (71h26m21.903682431s) [noise=true , address=77.90.31.19:4841 , piece_id=TIKC27S6UNPTUJLPC47PSYLT2DOBWKXV2FTYKWYONXNVGGYFFGIA, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.864462086 (71h26m21.904035206s) [noise=true , address=77.90.31.21:4879 , piece_id=XPLKFUZU7WVQL76TK5J4V6PR62KLT4ESFVSII5RBRWOZNPXJLARA, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.865168869 (71h26m21.904741989s) [noise=true , address=145.79.227.4:4187 , piece_id=V4XEUKSCCNLTWQ2FVLMUBYPED6REKNKHBOSZDRQMBCWLD4ES4NGA, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.865492809 (71h26m21.905065919s) [noise=true , address=45.91.116.14:4191 , piece_id=DPHEN4XWBF2CYGGS3AYCTYXKQQVU4BCXFSIL7WLHQNUEXGDX2VJQ, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.867918711 (71h26m21.907491831s) [noise=true , address=77.90.31.21:4877 , piece_id=Y6E6U3XJXSDNT6GFWTNYN3KHN4JJXI4CC4NZYEIJ4YTP4TBLTXVA, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:47.698898273 (71h26m23.738471383s) [upload=62870]: Next returned nil segment Sep 9 12:54:47.698920065 (71h26m23.738493185s) [upload=62870]: Waiting for error group managing segments... Sep 9 12:54:47.996322609 (71h26m24.035895719s) [noise=true , address=145.79.227.18:4005 , piece_id=SXQJVRK4JBZ4EBLCPS5EULPEK3KW2AQPHDYFTTREPEUBJ2UZU6YA, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.028352301 (71h26m24.067925421s) [noise=true , address=45.91.116.11:4119 , piece_id=DFSH5QEMFLNOT4RFAULYJYCUTV7BDDDZSNDEN7TRBTT2GCE4XCMQ, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.094974951 (71h26m24.134548072s) [noise=true , address=77.90.31.21:4879 , piece_id=XPLKFUZU7WVQL76TK5J4V6PR62KLT4ESFVSII5RBRWOZNPXJLARA, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.096813110 (71h26m24.13638622s) [noise=true , address=77.90.31.21:4877 , piece_id=Y6E6U3XJXSDNT6GFWTNYN3KHN4JJXI4CC4NZYEIJ4YTP4TBLTXVA, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.097220730 (71h26m24.13679385s) [noise=true , address=77.90.31.14:4662 , piece_id=6LVBXKQARG6RCRZKQ3TEAAXMVUXDESLLXFRQSS36ZOYK5CR56G2Q, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.128446042 (71h26m24.168019162s) [noise=true , address=145.79.227.4:4187 , piece_id=V4XEUKSCCNLTWQ2FVLMUBYPED6REKNKHBOSZDRQMBCWLD4ES4NGA, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.141392066 (71h26m24.180965176s) [noise=true , address=45.91.116.14:4191 , piece_id=DPHEN4XWBF2CYGGS3AYCTYXKQQVU4BCXFSIL7WLHQNUEXGDX2VJQ, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.148560975 (71h26m24.188134095s) [noise=true , address=45.91.116.8:4045 , piece_id=R5BJPE4Q5O2ZIY3U7JTDJPKZNCRIR33AOUO54SAPNYLVQ4XUV3UQ, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.150518240 (71h26m24.19009136s) [noise=true , address=45.91.116.12:4227 , piece_id=EKQXMW7B7K5BFPOW2Y5RT35LUVBWBIS5EZP3QU74WZCF3JWIYE3Q, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.153436375 (71h26m24.193009495s) [noise=true , address=77.90.31.19:4841 , piece_id=TIKC27S6UNPTUJLPC47PSYLT2DOBWKXV2FTYKWYONXNVGGYFFGIA, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.184113700 (71h26m24.22368682s) [noise=true , address=45.91.116.9:4263 , piece_id=VG2PVXJD2Z4QGBY4FHMPXKXPUDSABZMVP5SOVCA7AF3DW7QTTGCA, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.215045140 (71h26m24.25461826s) [noise=true , address=45.91.116.4:4939 , piece_id=D3ZWNOEEFM76GIK3GBXPZAPTKNMAUFZFEIIPSLVY6P6NBOBFEQDQ, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.247604766 (71h26m24.287177886s) [noise=true , address=45.91.116.13:4153 , piece_id=Q3IVWHNJHOBBIWXZIFOC6BNAJFUGA67D2KAQLMHAC2PVZU3EVRFQ, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.247625516 (71h26m24.287198636s) [seg_pos={0 0}, upload=62870]: Segment reached optimal threshold of 13 pieces. Sep 9 12:54:48.247738021 (71h26m24.287311141s) [noise=true , address=45.91.116.5:4297 , piece_id=JPDIQKEWZZN2SRCK3OD7HBYPNWSS7KK3FLDB4GPZ43PG2MD4YNAA, seg_pos={0 0}, upload=62870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Sep 9 12:54:48.247909579 (71h26m24.287482689s) [noise=true , address=45.91.116.10:4083 , piece_id=Q43W36TOXEZCOVUZL3AOY6GZANULT3VNNEVRDTT7N26IBVBDD2QQ, seg_pos={0 0}, upload=62870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: read tcp 188.166.225.170:49636->45.91.116.10:4083: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 9 12:54:48.247932804 (71h26m24.287505924s) [noise=true , address=45.91.116.7:4009 , piece_id=RMM53FYXSXDKG6ZSIHIAMXBTLQ27TUSEMTQKZSGKGOABU5IF4S6Q, seg_pos={0 0}, upload=62870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: write tcp 188.166.225.170:38196->45.91.116.7:4009: use of closed network connection; write tcp 188.166.225.170:38196->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38196->45.91.116.7:4009: use of closed network connection Sep 9 12:54:48.247983561 (71h26m24.287556681s) [seg_pos={0 0}, upload=62870]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 12:54:48.248073142 (71h26m24.287646262s) [upload=62870]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 12:54:48.248077821 (71h26m24.287650941s) [upload=62870]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 12:54:48.571633944 (71h26m24.611207064s) [upload=62870]: Done uploading segments... Sep 9 12:54:48.571653581 (71h26m24.611226701s) [upload=62870]: Upload finished. err: <nil> Duration: 14.48038371s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [...................................X................XXX.....] duration: 12.139957995s FAIL (2025-09-09 12:58:31 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 12:54:45.380565865 (71h26m21.420138985s) [upload=62870]: Starting upload Sep 9 12:54:45.380622493 (71h26m21.420195613s) [upload=62870]: Done starting upload Sep 9 12:54:45.380740448 (71h26m21.420313568s) [upload=62870]: Uploading segments... Sep 9 12:54:45.380902939 (71h26m21.420476059s) [upload=62870]: Got next segment. Inline: false Sep 9 12:54:45.380948337 (71h26m21.420521447s) [upload=62870]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 12:54:45.381123361 (71h26m21.420696501s) [upload=62870]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 12:54:45.861358968 (71h26m21.900932088s) [seg_pos={0 0}, upload=62870]: Begin upload segment... Sep 9 12:54:45.861422110 (71h26m21.90099522s) [seg_pos={0 0}, upload=62870]: Done begin upload segment. Sep 9 12:54:45.861472715 (71h26m21.901045836s) [noise=true , address=45.91.116.8:4045 , piece_id=R5BJPE4Q5O2ZIY3U7JTDJPKZNCRIR33AOUO54SAPNYLVQ4XUV3UQ, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.861519054 (71h26m21.901092175s) [noise=true , address=77.90.31.14:4662 , piece_id=6LVBXKQARG6RCRZKQ3TEAAXMVUXDESLLXFRQSS36ZOYK5CR56G2Q, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.862102111 (71h26m21.901675231s) [noise=true , address=45.91.116.4:4939 , piece_id=D3ZWNOEEFM76GIK3GBXPZAPTKNMAUFZFEIIPSLVY6P6NBOBFEQDQ, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.862126126 (71h26m21.901699246s) [noise=true , address=45.91.116.12:4227 , piece_id=EKQXMW7B7K5BFPOW2Y5RT35LUVBWBIS5EZP3QU74WZCF3JWIYE3Q, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.862446549 (71h26m21.902019669s) [noise=true , address=45.91.116.10:4083 , piece_id=Q43W36TOXEZCOVUZL3AOY6GZANULT3VNNEVRDTT7N26IBVBDD2QQ, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.862516914 (71h26m21.902090034s) [noise=true , address=145.79.227.18:4005 , piece_id=SXQJVRK4JBZ4EBLCPS5EULPEK3KW2AQPHDYFTTREPEUBJ2UZU6YA, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.862857225 (71h26m21.902430345s) [noise=true , address=45.91.116.7:4009 , piece_id=RMM53FYXSXDKG6ZSIHIAMXBTLQ27TUSEMTQKZSGKGOABU5IF4S6Q, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.863002143 (71h26m21.902575283s) [noise=true , address=45.91.116.13:4153 , piece_id=Q3IVWHNJHOBBIWXZIFOC6BNAJFUGA67D2KAQLMHAC2PVZU3EVRFQ, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.863215671 (71h26m21.902788781s) [noise=true , address=45.91.116.5:4297 , piece_id=JPDIQKEWZZN2SRCK3OD7HBYPNWSS7KK3FLDB4GPZ43PG2MD4YNAA, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.863586441 (71h26m21.903159561s) [noise=true , address=45.91.116.9:4263 , piece_id=VG2PVXJD2Z4QGBY4FHMPXKXPUDSABZMVP5SOVCA7AF3DW7QTTGCA, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.863676172 (71h26m21.903249292s) [noise=true , address=45.91.116.11:4119 , piece_id=DFSH5QEMFLNOT4RFAULYJYCUTV7BDDDZSNDEN7TRBTT2GCE4XCMQ, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.864109311 (71h26m21.903682431s) [noise=true , address=77.90.31.19:4841 , piece_id=TIKC27S6UNPTUJLPC47PSYLT2DOBWKXV2FTYKWYONXNVGGYFFGIA, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.864462086 (71h26m21.904035206s) [noise=true , address=77.90.31.21:4879 , piece_id=XPLKFUZU7WVQL76TK5J4V6PR62KLT4ESFVSII5RBRWOZNPXJLARA, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.865168869 (71h26m21.904741989s) [noise=true , address=145.79.227.4:4187 , piece_id=V4XEUKSCCNLTWQ2FVLMUBYPED6REKNKHBOSZDRQMBCWLD4ES4NGA, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.865492809 (71h26m21.905065919s) [noise=true , address=45.91.116.14:4191 , piece_id=DPHEN4XWBF2CYGGS3AYCTYXKQQVU4BCXFSIL7WLHQNUEXGDX2VJQ, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.867918711 (71h26m21.907491831s) [noise=true , address=77.90.31.21:4877 , piece_id=Y6E6U3XJXSDNT6GFWTNYN3KHN4JJXI4CC4NZYEIJ4YTP4TBLTXVA, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:47.698898273 (71h26m23.738471383s) [upload=62870]: Next returned nil segment Sep 9 12:54:47.698920065 (71h26m23.738493185s) [upload=62870]: Waiting for error group managing segments... Sep 9 12:54:47.996322609 (71h26m24.035895719s) [noise=true , address=145.79.227.18:4005 , piece_id=SXQJVRK4JBZ4EBLCPS5EULPEK3KW2AQPHDYFTTREPEUBJ2UZU6YA, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.028352301 (71h26m24.067925421s) [noise=true , address=45.91.116.11:4119 , piece_id=DFSH5QEMFLNOT4RFAULYJYCUTV7BDDDZSNDEN7TRBTT2GCE4XCMQ, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.094974951 (71h26m24.134548072s) [noise=true , address=77.90.31.21:4879 , piece_id=XPLKFUZU7WVQL76TK5J4V6PR62KLT4ESFVSII5RBRWOZNPXJLARA, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.096813110 (71h26m24.13638622s) [noise=true , address=77.90.31.21:4877 , piece_id=Y6E6U3XJXSDNT6GFWTNYN3KHN4JJXI4CC4NZYEIJ4YTP4TBLTXVA, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.097220730 (71h26m24.13679385s) [noise=true , address=77.90.31.14:4662 , piece_id=6LVBXKQARG6RCRZKQ3TEAAXMVUXDESLLXFRQSS36ZOYK5CR56G2Q, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.128446042 (71h26m24.168019162s) [noise=true , address=145.79.227.4:4187 , piece_id=V4XEUKSCCNLTWQ2FVLMUBYPED6REKNKHBOSZDRQMBCWLD4ES4NGA, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.141392066 (71h26m24.180965176s) [noise=true , address=45.91.116.14:4191 , piece_id=DPHEN4XWBF2CYGGS3AYCTYXKQQVU4BCXFSIL7WLHQNUEXGDX2VJQ, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.148560975 (71h26m24.188134095s) [noise=true , address=45.91.116.8:4045 , piece_id=R5BJPE4Q5O2ZIY3U7JTDJPKZNCRIR33AOUO54SAPNYLVQ4XUV3UQ, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.150518240 (71h26m24.19009136s) [noise=true , address=45.91.116.12:4227 , piece_id=EKQXMW7B7K5BFPOW2Y5RT35LUVBWBIS5EZP3QU74WZCF3JWIYE3Q, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.153436375 (71h26m24.193009495s) [noise=true , address=77.90.31.19:4841 , piece_id=TIKC27S6UNPTUJLPC47PSYLT2DOBWKXV2FTYKWYONXNVGGYFFGIA, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.184113700 (71h26m24.22368682s) [noise=true , address=45.91.116.9:4263 , piece_id=VG2PVXJD2Z4QGBY4FHMPXKXPUDSABZMVP5SOVCA7AF3DW7QTTGCA, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.215045140 (71h26m24.25461826s) [noise=true , address=45.91.116.4:4939 , piece_id=D3ZWNOEEFM76GIK3GBXPZAPTKNMAUFZFEIIPSLVY6P6NBOBFEQDQ, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.247604766 (71h26m24.287177886s) [noise=true , address=45.91.116.13:4153 , piece_id=Q3IVWHNJHOBBIWXZIFOC6BNAJFUGA67D2KAQLMHAC2PVZU3EVRFQ, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.247625516 (71h26m24.287198636s) [seg_pos={0 0}, upload=62870]: Segment reached optimal threshold of 13 pieces. Sep 9 12:54:48.247738021 (71h26m24.287311141s) [noise=true , address=45.91.116.5:4297 , piece_id=JPDIQKEWZZN2SRCK3OD7HBYPNWSS7KK3FLDB4GPZ43PG2MD4YNAA, seg_pos={0 0}, upload=62870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Sep 9 12:54:48.247909579 (71h26m24.287482689s) [noise=true , address=45.91.116.10:4083 , piece_id=Q43W36TOXEZCOVUZL3AOY6GZANULT3VNNEVRDTT7N26IBVBDD2QQ, seg_pos={0 0}, upload=62870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: read tcp 188.166.225.170:49636->45.91.116.10:4083: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 9 12:54:48.247932804 (71h26m24.287505924s) [noise=true , address=45.91.116.7:4009 , piece_id=RMM53FYXSXDKG6ZSIHIAMXBTLQ27TUSEMTQKZSGKGOABU5IF4S6Q, seg_pos={0 0}, upload=62870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: write tcp 188.166.225.170:38196->45.91.116.7:4009: use of closed network connection; write tcp 188.166.225.170:38196->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38196->45.91.116.7:4009: use of closed network connection Sep 9 12:54:48.247983561 (71h26m24.287556681s) [seg_pos={0 0}, upload=62870]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 12:54:48.248073142 (71h26m24.287646262s) [upload=62870]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 12:54:48.248077821 (71h26m24.287650941s) [upload=62870]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 12:54:48.571633944 (71h26m24.611207064s) [upload=62870]: Done uploading segments... Sep 9 12:54:48.571653581 (71h26m24.611226701s) [upload=62870]: Upload finished. err: <nil> Duration: 12.13999234s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [....................................X................XXX....] duration: 17.511087563s FAIL (2025-09-09 12:58:00 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 12:54:45.380565865 (71h26m21.420138985s) [upload=62870]: Starting upload Sep 9 12:54:45.380622493 (71h26m21.420195613s) [upload=62870]: Done starting upload Sep 9 12:54:45.380740448 (71h26m21.420313568s) [upload=62870]: Uploading segments... Sep 9 12:54:45.380902939 (71h26m21.420476059s) [upload=62870]: Got next segment. Inline: false Sep 9 12:54:45.380948337 (71h26m21.420521447s) [upload=62870]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 12:54:45.381123361 (71h26m21.420696501s) [upload=62870]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 12:54:45.861358968 (71h26m21.900932088s) [seg_pos={0 0}, upload=62870]: Begin upload segment... Sep 9 12:54:45.861422110 (71h26m21.90099522s) [seg_pos={0 0}, upload=62870]: Done begin upload segment. Sep 9 12:54:45.861472715 (71h26m21.901045836s) [noise=true , address=45.91.116.8:4045 , piece_id=R5BJPE4Q5O2ZIY3U7JTDJPKZNCRIR33AOUO54SAPNYLVQ4XUV3UQ, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.861519054 (71h26m21.901092175s) [noise=true , address=77.90.31.14:4662 , piece_id=6LVBXKQARG6RCRZKQ3TEAAXMVUXDESLLXFRQSS36ZOYK5CR56G2Q, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.862102111 (71h26m21.901675231s) [noise=true , address=45.91.116.4:4939 , piece_id=D3ZWNOEEFM76GIK3GBXPZAPTKNMAUFZFEIIPSLVY6P6NBOBFEQDQ, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.862126126 (71h26m21.901699246s) [noise=true , address=45.91.116.12:4227 , piece_id=EKQXMW7B7K5BFPOW2Y5RT35LUVBWBIS5EZP3QU74WZCF3JWIYE3Q, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.862446549 (71h26m21.902019669s) [noise=true , address=45.91.116.10:4083 , piece_id=Q43W36TOXEZCOVUZL3AOY6GZANULT3VNNEVRDTT7N26IBVBDD2QQ, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.862516914 (71h26m21.902090034s) [noise=true , address=145.79.227.18:4005 , piece_id=SXQJVRK4JBZ4EBLCPS5EULPEK3KW2AQPHDYFTTREPEUBJ2UZU6YA, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.862857225 (71h26m21.902430345s) [noise=true , address=45.91.116.7:4009 , piece_id=RMM53FYXSXDKG6ZSIHIAMXBTLQ27TUSEMTQKZSGKGOABU5IF4S6Q, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.863002143 (71h26m21.902575283s) [noise=true , address=45.91.116.13:4153 , piece_id=Q3IVWHNJHOBBIWXZIFOC6BNAJFUGA67D2KAQLMHAC2PVZU3EVRFQ, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.863215671 (71h26m21.902788781s) [noise=true , address=45.91.116.5:4297 , piece_id=JPDIQKEWZZN2SRCK3OD7HBYPNWSS7KK3FLDB4GPZ43PG2MD4YNAA, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.863586441 (71h26m21.903159561s) [noise=true , address=45.91.116.9:4263 , piece_id=VG2PVXJD2Z4QGBY4FHMPXKXPUDSABZMVP5SOVCA7AF3DW7QTTGCA, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.863676172 (71h26m21.903249292s) [noise=true , address=45.91.116.11:4119 , piece_id=DFSH5QEMFLNOT4RFAULYJYCUTV7BDDDZSNDEN7TRBTT2GCE4XCMQ, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.864109311 (71h26m21.903682431s) [noise=true , address=77.90.31.19:4841 , piece_id=TIKC27S6UNPTUJLPC47PSYLT2DOBWKXV2FTYKWYONXNVGGYFFGIA, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.864462086 (71h26m21.904035206s) [noise=true , address=77.90.31.21:4879 , piece_id=XPLKFUZU7WVQL76TK5J4V6PR62KLT4ESFVSII5RBRWOZNPXJLARA, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.865168869 (71h26m21.904741989s) [noise=true , address=145.79.227.4:4187 , piece_id=V4XEUKSCCNLTWQ2FVLMUBYPED6REKNKHBOSZDRQMBCWLD4ES4NGA, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.865492809 (71h26m21.905065919s) [noise=true , address=45.91.116.14:4191 , piece_id=DPHEN4XWBF2CYGGS3AYCTYXKQQVU4BCXFSIL7WLHQNUEXGDX2VJQ, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.867918711 (71h26m21.907491831s) [noise=true , address=77.90.31.21:4877 , piece_id=Y6E6U3XJXSDNT6GFWTNYN3KHN4JJXI4CC4NZYEIJ4YTP4TBLTXVA, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:47.698898273 (71h26m23.738471383s) [upload=62870]: Next returned nil segment Sep 9 12:54:47.698920065 (71h26m23.738493185s) [upload=62870]: Waiting for error group managing segments... Sep 9 12:54:47.996322609 (71h26m24.035895719s) [noise=true , address=145.79.227.18:4005 , piece_id=SXQJVRK4JBZ4EBLCPS5EULPEK3KW2AQPHDYFTTREPEUBJ2UZU6YA, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.028352301 (71h26m24.067925421s) [noise=true , address=45.91.116.11:4119 , piece_id=DFSH5QEMFLNOT4RFAULYJYCUTV7BDDDZSNDEN7TRBTT2GCE4XCMQ, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.094974951 (71h26m24.134548072s) [noise=true , address=77.90.31.21:4879 , piece_id=XPLKFUZU7WVQL76TK5J4V6PR62KLT4ESFVSII5RBRWOZNPXJLARA, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.096813110 (71h26m24.13638622s) [noise=true , address=77.90.31.21:4877 , piece_id=Y6E6U3XJXSDNT6GFWTNYN3KHN4JJXI4CC4NZYEIJ4YTP4TBLTXVA, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.097220730 (71h26m24.13679385s) [noise=true , address=77.90.31.14:4662 , piece_id=6LVBXKQARG6RCRZKQ3TEAAXMVUXDESLLXFRQSS36ZOYK5CR56G2Q, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.128446042 (71h26m24.168019162s) [noise=true , address=145.79.227.4:4187 , piece_id=V4XEUKSCCNLTWQ2FVLMUBYPED6REKNKHBOSZDRQMBCWLD4ES4NGA, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.141392066 (71h26m24.180965176s) [noise=true , address=45.91.116.14:4191 , piece_id=DPHEN4XWBF2CYGGS3AYCTYXKQQVU4BCXFSIL7WLHQNUEXGDX2VJQ, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.148560975 (71h26m24.188134095s) [noise=true , address=45.91.116.8:4045 , piece_id=R5BJPE4Q5O2ZIY3U7JTDJPKZNCRIR33AOUO54SAPNYLVQ4XUV3UQ, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.150518240 (71h26m24.19009136s) [noise=true , address=45.91.116.12:4227 , piece_id=EKQXMW7B7K5BFPOW2Y5RT35LUVBWBIS5EZP3QU74WZCF3JWIYE3Q, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.153436375 (71h26m24.193009495s) [noise=true , address=77.90.31.19:4841 , piece_id=TIKC27S6UNPTUJLPC47PSYLT2DOBWKXV2FTYKWYONXNVGGYFFGIA, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.184113700 (71h26m24.22368682s) [noise=true , address=45.91.116.9:4263 , piece_id=VG2PVXJD2Z4QGBY4FHMPXKXPUDSABZMVP5SOVCA7AF3DW7QTTGCA, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.215045140 (71h26m24.25461826s) [noise=true , address=45.91.116.4:4939 , piece_id=D3ZWNOEEFM76GIK3GBXPZAPTKNMAUFZFEIIPSLVY6P6NBOBFEQDQ, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.247604766 (71h26m24.287177886s) [noise=true , address=45.91.116.13:4153 , piece_id=Q3IVWHNJHOBBIWXZIFOC6BNAJFUGA67D2KAQLMHAC2PVZU3EVRFQ, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.247625516 (71h26m24.287198636s) [seg_pos={0 0}, upload=62870]: Segment reached optimal threshold of 13 pieces. Sep 9 12:54:48.247738021 (71h26m24.287311141s) [noise=true , address=45.91.116.5:4297 , piece_id=JPDIQKEWZZN2SRCK3OD7HBYPNWSS7KK3FLDB4GPZ43PG2MD4YNAA, seg_pos={0 0}, upload=62870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Sep 9 12:54:48.247909579 (71h26m24.287482689s) [noise=true , address=45.91.116.10:4083 , piece_id=Q43W36TOXEZCOVUZL3AOY6GZANULT3VNNEVRDTT7N26IBVBDD2QQ, seg_pos={0 0}, upload=62870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: read tcp 188.166.225.170:49636->45.91.116.10:4083: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 9 12:54:48.247932804 (71h26m24.287505924s) [noise=true , address=45.91.116.7:4009 , piece_id=RMM53FYXSXDKG6ZSIHIAMXBTLQ27TUSEMTQKZSGKGOABU5IF4S6Q, seg_pos={0 0}, upload=62870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: write tcp 188.166.225.170:38196->45.91.116.7:4009: use of closed network connection; write tcp 188.166.225.170:38196->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38196->45.91.116.7:4009: use of closed network connection Sep 9 12:54:48.247983561 (71h26m24.287556681s) [seg_pos={0 0}, upload=62870]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 12:54:48.248073142 (71h26m24.287646262s) [upload=62870]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 12:54:48.248077821 (71h26m24.287650941s) [upload=62870]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 12:54:48.571633944 (71h26m24.611207064s) [upload=62870]: Done uploading segments... Sep 9 12:54:48.571653581 (71h26m24.611226701s) [upload=62870]: Upload finished. err: <nil> Duration: 17.511121739s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.....................................X................XXX...] duration: 14.879821574s FAIL (2025-09-09 12:57:31 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 12:54:45.380565865 (71h26m21.420138985s) [upload=62870]: Starting upload Sep 9 12:54:45.380622493 (71h26m21.420195613s) [upload=62870]: Done starting upload Sep 9 12:54:45.380740448 (71h26m21.420313568s) [upload=62870]: Uploading segments... Sep 9 12:54:45.380902939 (71h26m21.420476059s) [upload=62870]: Got next segment. Inline: false Sep 9 12:54:45.380948337 (71h26m21.420521447s) [upload=62870]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 12:54:45.381123361 (71h26m21.420696501s) [upload=62870]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 12:54:45.861358968 (71h26m21.900932088s) [seg_pos={0 0}, upload=62870]: Begin upload segment... Sep 9 12:54:45.861422110 (71h26m21.90099522s) [seg_pos={0 0}, upload=62870]: Done begin upload segment. Sep 9 12:54:45.861472715 (71h26m21.901045836s) [noise=true , address=45.91.116.8:4045 , piece_id=R5BJPE4Q5O2ZIY3U7JTDJPKZNCRIR33AOUO54SAPNYLVQ4XUV3UQ, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.861519054 (71h26m21.901092175s) [noise=true , address=77.90.31.14:4662 , piece_id=6LVBXKQARG6RCRZKQ3TEAAXMVUXDESLLXFRQSS36ZOYK5CR56G2Q, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.862102111 (71h26m21.901675231s) [noise=true , address=45.91.116.4:4939 , piece_id=D3ZWNOEEFM76GIK3GBXPZAPTKNMAUFZFEIIPSLVY6P6NBOBFEQDQ, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.862126126 (71h26m21.901699246s) [noise=true , address=45.91.116.12:4227 , piece_id=EKQXMW7B7K5BFPOW2Y5RT35LUVBWBIS5EZP3QU74WZCF3JWIYE3Q, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.862446549 (71h26m21.902019669s) [noise=true , address=45.91.116.10:4083 , piece_id=Q43W36TOXEZCOVUZL3AOY6GZANULT3VNNEVRDTT7N26IBVBDD2QQ, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.862516914 (71h26m21.902090034s) [noise=true , address=145.79.227.18:4005 , piece_id=SXQJVRK4JBZ4EBLCPS5EULPEK3KW2AQPHDYFTTREPEUBJ2UZU6YA, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.862857225 (71h26m21.902430345s) [noise=true , address=45.91.116.7:4009 , piece_id=RMM53FYXSXDKG6ZSIHIAMXBTLQ27TUSEMTQKZSGKGOABU5IF4S6Q, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.863002143 (71h26m21.902575283s) [noise=true , address=45.91.116.13:4153 , piece_id=Q3IVWHNJHOBBIWXZIFOC6BNAJFUGA67D2KAQLMHAC2PVZU3EVRFQ, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.863215671 (71h26m21.902788781s) [noise=true , address=45.91.116.5:4297 , piece_id=JPDIQKEWZZN2SRCK3OD7HBYPNWSS7KK3FLDB4GPZ43PG2MD4YNAA, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.863586441 (71h26m21.903159561s) [noise=true , address=45.91.116.9:4263 , piece_id=VG2PVXJD2Z4QGBY4FHMPXKXPUDSABZMVP5SOVCA7AF3DW7QTTGCA, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.863676172 (71h26m21.903249292s) [noise=true , address=45.91.116.11:4119 , piece_id=DFSH5QEMFLNOT4RFAULYJYCUTV7BDDDZSNDEN7TRBTT2GCE4XCMQ, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.864109311 (71h26m21.903682431s) [noise=true , address=77.90.31.19:4841 , piece_id=TIKC27S6UNPTUJLPC47PSYLT2DOBWKXV2FTYKWYONXNVGGYFFGIA, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.864462086 (71h26m21.904035206s) [noise=true , address=77.90.31.21:4879 , piece_id=XPLKFUZU7WVQL76TK5J4V6PR62KLT4ESFVSII5RBRWOZNPXJLARA, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.865168869 (71h26m21.904741989s) [noise=true , address=145.79.227.4:4187 , piece_id=V4XEUKSCCNLTWQ2FVLMUBYPED6REKNKHBOSZDRQMBCWLD4ES4NGA, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.865492809 (71h26m21.905065919s) [noise=true , address=45.91.116.14:4191 , piece_id=DPHEN4XWBF2CYGGS3AYCTYXKQQVU4BCXFSIL7WLHQNUEXGDX2VJQ, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.867918711 (71h26m21.907491831s) [noise=true , address=77.90.31.21:4877 , piece_id=Y6E6U3XJXSDNT6GFWTNYN3KHN4JJXI4CC4NZYEIJ4YTP4TBLTXVA, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:47.698898273 (71h26m23.738471383s) [upload=62870]: Next returned nil segment Sep 9 12:54:47.698920065 (71h26m23.738493185s) [upload=62870]: Waiting for error group managing segments... Sep 9 12:54:47.996322609 (71h26m24.035895719s) [noise=true , address=145.79.227.18:4005 , piece_id=SXQJVRK4JBZ4EBLCPS5EULPEK3KW2AQPHDYFTTREPEUBJ2UZU6YA, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.028352301 (71h26m24.067925421s) [noise=true , address=45.91.116.11:4119 , piece_id=DFSH5QEMFLNOT4RFAULYJYCUTV7BDDDZSNDEN7TRBTT2GCE4XCMQ, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.094974951 (71h26m24.134548072s) [noise=true , address=77.90.31.21:4879 , piece_id=XPLKFUZU7WVQL76TK5J4V6PR62KLT4ESFVSII5RBRWOZNPXJLARA, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.096813110 (71h26m24.13638622s) [noise=true , address=77.90.31.21:4877 , piece_id=Y6E6U3XJXSDNT6GFWTNYN3KHN4JJXI4CC4NZYEIJ4YTP4TBLTXVA, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.097220730 (71h26m24.13679385s) [noise=true , address=77.90.31.14:4662 , piece_id=6LVBXKQARG6RCRZKQ3TEAAXMVUXDESLLXFRQSS36ZOYK5CR56G2Q, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.128446042 (71h26m24.168019162s) [noise=true , address=145.79.227.4:4187 , piece_id=V4XEUKSCCNLTWQ2FVLMUBYPED6REKNKHBOSZDRQMBCWLD4ES4NGA, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.141392066 (71h26m24.180965176s) [noise=true , address=45.91.116.14:4191 , piece_id=DPHEN4XWBF2CYGGS3AYCTYXKQQVU4BCXFSIL7WLHQNUEXGDX2VJQ, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.148560975 (71h26m24.188134095s) [noise=true , address=45.91.116.8:4045 , piece_id=R5BJPE4Q5O2ZIY3U7JTDJPKZNCRIR33AOUO54SAPNYLVQ4XUV3UQ, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.150518240 (71h26m24.19009136s) [noise=true , address=45.91.116.12:4227 , piece_id=EKQXMW7B7K5BFPOW2Y5RT35LUVBWBIS5EZP3QU74WZCF3JWIYE3Q, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.153436375 (71h26m24.193009495s) [noise=true , address=77.90.31.19:4841 , piece_id=TIKC27S6UNPTUJLPC47PSYLT2DOBWKXV2FTYKWYONXNVGGYFFGIA, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.184113700 (71h26m24.22368682s) [noise=true , address=45.91.116.9:4263 , piece_id=VG2PVXJD2Z4QGBY4FHMPXKXPUDSABZMVP5SOVCA7AF3DW7QTTGCA, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.215045140 (71h26m24.25461826s) [noise=true , address=45.91.116.4:4939 , piece_id=D3ZWNOEEFM76GIK3GBXPZAPTKNMAUFZFEIIPSLVY6P6NBOBFEQDQ, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.247604766 (71h26m24.287177886s) [noise=true , address=45.91.116.13:4153 , piece_id=Q3IVWHNJHOBBIWXZIFOC6BNAJFUGA67D2KAQLMHAC2PVZU3EVRFQ, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.247625516 (71h26m24.287198636s) [seg_pos={0 0}, upload=62870]: Segment reached optimal threshold of 13 pieces. Sep 9 12:54:48.247738021 (71h26m24.287311141s) [noise=true , address=45.91.116.5:4297 , piece_id=JPDIQKEWZZN2SRCK3OD7HBYPNWSS7KK3FLDB4GPZ43PG2MD4YNAA, seg_pos={0 0}, upload=62870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Sep 9 12:54:48.247909579 (71h26m24.287482689s) [noise=true , address=45.91.116.10:4083 , piece_id=Q43W36TOXEZCOVUZL3AOY6GZANULT3VNNEVRDTT7N26IBVBDD2QQ, seg_pos={0 0}, upload=62870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: read tcp 188.166.225.170:49636->45.91.116.10:4083: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 9 12:54:48.247932804 (71h26m24.287505924s) [noise=true , address=45.91.116.7:4009 , piece_id=RMM53FYXSXDKG6ZSIHIAMXBTLQ27TUSEMTQKZSGKGOABU5IF4S6Q, seg_pos={0 0}, upload=62870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: write tcp 188.166.225.170:38196->45.91.116.7:4009: use of closed network connection; write tcp 188.166.225.170:38196->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38196->45.91.116.7:4009: use of closed network connection Sep 9 12:54:48.247983561 (71h26m24.287556681s) [seg_pos={0 0}, upload=62870]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 12:54:48.248073142 (71h26m24.287646262s) [upload=62870]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 12:54:48.248077821 (71h26m24.287650941s) [upload=62870]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 12:54:48.571633944 (71h26m24.611207064s) [upload=62870]: Done uploading segments... Sep 9 12:54:48.571653581 (71h26m24.611226701s) [upload=62870]: Upload finished. err: <nil> Duration: 14.879849066s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [......................................X................XXX..] duration: 23.243912412s FAIL (2025-09-09 12:56:39 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 12:54:45.380565865 (71h26m21.420138985s) [upload=62870]: Starting upload Sep 9 12:54:45.380622493 (71h26m21.420195613s) [upload=62870]: Done starting upload Sep 9 12:54:45.380740448 (71h26m21.420313568s) [upload=62870]: Uploading segments... Sep 9 12:54:45.380902939 (71h26m21.420476059s) [upload=62870]: Got next segment. Inline: false Sep 9 12:54:45.380948337 (71h26m21.420521447s) [upload=62870]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 12:54:45.381123361 (71h26m21.420696501s) [upload=62870]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 12:54:45.861358968 (71h26m21.900932088s) [seg_pos={0 0}, upload=62870]: Begin upload segment... Sep 9 12:54:45.861422110 (71h26m21.90099522s) [seg_pos={0 0}, upload=62870]: Done begin upload segment. Sep 9 12:54:45.861472715 (71h26m21.901045836s) [noise=true , address=45.91.116.8:4045 , piece_id=R5BJPE4Q5O2ZIY3U7JTDJPKZNCRIR33AOUO54SAPNYLVQ4XUV3UQ, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.861519054 (71h26m21.901092175s) [noise=true , address=77.90.31.14:4662 , piece_id=6LVBXKQARG6RCRZKQ3TEAAXMVUXDESLLXFRQSS36ZOYK5CR56G2Q, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.862102111 (71h26m21.901675231s) [noise=true , address=45.91.116.4:4939 , piece_id=D3ZWNOEEFM76GIK3GBXPZAPTKNMAUFZFEIIPSLVY6P6NBOBFEQDQ, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.862126126 (71h26m21.901699246s) [noise=true , address=45.91.116.12:4227 , piece_id=EKQXMW7B7K5BFPOW2Y5RT35LUVBWBIS5EZP3QU74WZCF3JWIYE3Q, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.862446549 (71h26m21.902019669s) [noise=true , address=45.91.116.10:4083 , piece_id=Q43W36TOXEZCOVUZL3AOY6GZANULT3VNNEVRDTT7N26IBVBDD2QQ, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.862516914 (71h26m21.902090034s) [noise=true , address=145.79.227.18:4005 , piece_id=SXQJVRK4JBZ4EBLCPS5EULPEK3KW2AQPHDYFTTREPEUBJ2UZU6YA, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.862857225 (71h26m21.902430345s) [noise=true , address=45.91.116.7:4009 , piece_id=RMM53FYXSXDKG6ZSIHIAMXBTLQ27TUSEMTQKZSGKGOABU5IF4S6Q, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.863002143 (71h26m21.902575283s) [noise=true , address=45.91.116.13:4153 , piece_id=Q3IVWHNJHOBBIWXZIFOC6BNAJFUGA67D2KAQLMHAC2PVZU3EVRFQ, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.863215671 (71h26m21.902788781s) [noise=true , address=45.91.116.5:4297 , piece_id=JPDIQKEWZZN2SRCK3OD7HBYPNWSS7KK3FLDB4GPZ43PG2MD4YNAA, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.863586441 (71h26m21.903159561s) [noise=true , address=45.91.116.9:4263 , piece_id=VG2PVXJD2Z4QGBY4FHMPXKXPUDSABZMVP5SOVCA7AF3DW7QTTGCA, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.863676172 (71h26m21.903249292s) [noise=true , address=45.91.116.11:4119 , piece_id=DFSH5QEMFLNOT4RFAULYJYCUTV7BDDDZSNDEN7TRBTT2GCE4XCMQ, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.864109311 (71h26m21.903682431s) [noise=true , address=77.90.31.19:4841 , piece_id=TIKC27S6UNPTUJLPC47PSYLT2DOBWKXV2FTYKWYONXNVGGYFFGIA, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.864462086 (71h26m21.904035206s) [noise=true , address=77.90.31.21:4879 , piece_id=XPLKFUZU7WVQL76TK5J4V6PR62KLT4ESFVSII5RBRWOZNPXJLARA, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.865168869 (71h26m21.904741989s) [noise=true , address=145.79.227.4:4187 , piece_id=V4XEUKSCCNLTWQ2FVLMUBYPED6REKNKHBOSZDRQMBCWLD4ES4NGA, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.865492809 (71h26m21.905065919s) [noise=true , address=45.91.116.14:4191 , piece_id=DPHEN4XWBF2CYGGS3AYCTYXKQQVU4BCXFSIL7WLHQNUEXGDX2VJQ, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.867918711 (71h26m21.907491831s) [noise=true , address=77.90.31.21:4877 , piece_id=Y6E6U3XJXSDNT6GFWTNYN3KHN4JJXI4CC4NZYEIJ4YTP4TBLTXVA, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:47.698898273 (71h26m23.738471383s) [upload=62870]: Next returned nil segment Sep 9 12:54:47.698920065 (71h26m23.738493185s) [upload=62870]: Waiting for error group managing segments... Sep 9 12:54:47.996322609 (71h26m24.035895719s) [noise=true , address=145.79.227.18:4005 , piece_id=SXQJVRK4JBZ4EBLCPS5EULPEK3KW2AQPHDYFTTREPEUBJ2UZU6YA, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.028352301 (71h26m24.067925421s) [noise=true , address=45.91.116.11:4119 , piece_id=DFSH5QEMFLNOT4RFAULYJYCUTV7BDDDZSNDEN7TRBTT2GCE4XCMQ, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.094974951 (71h26m24.134548072s) [noise=true , address=77.90.31.21:4879 , piece_id=XPLKFUZU7WVQL76TK5J4V6PR62KLT4ESFVSII5RBRWOZNPXJLARA, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.096813110 (71h26m24.13638622s) [noise=true , address=77.90.31.21:4877 , piece_id=Y6E6U3XJXSDNT6GFWTNYN3KHN4JJXI4CC4NZYEIJ4YTP4TBLTXVA, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.097220730 (71h26m24.13679385s) [noise=true , address=77.90.31.14:4662 , piece_id=6LVBXKQARG6RCRZKQ3TEAAXMVUXDESLLXFRQSS36ZOYK5CR56G2Q, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.128446042 (71h26m24.168019162s) [noise=true , address=145.79.227.4:4187 , piece_id=V4XEUKSCCNLTWQ2FVLMUBYPED6REKNKHBOSZDRQMBCWLD4ES4NGA, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.141392066 (71h26m24.180965176s) [noise=true , address=45.91.116.14:4191 , piece_id=DPHEN4XWBF2CYGGS3AYCTYXKQQVU4BCXFSIL7WLHQNUEXGDX2VJQ, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.148560975 (71h26m24.188134095s) [noise=true , address=45.91.116.8:4045 , piece_id=R5BJPE4Q5O2ZIY3U7JTDJPKZNCRIR33AOUO54SAPNYLVQ4XUV3UQ, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.150518240 (71h26m24.19009136s) [noise=true , address=45.91.116.12:4227 , piece_id=EKQXMW7B7K5BFPOW2Y5RT35LUVBWBIS5EZP3QU74WZCF3JWIYE3Q, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.153436375 (71h26m24.193009495s) [noise=true , address=77.90.31.19:4841 , piece_id=TIKC27S6UNPTUJLPC47PSYLT2DOBWKXV2FTYKWYONXNVGGYFFGIA, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.184113700 (71h26m24.22368682s) [noise=true , address=45.91.116.9:4263 , piece_id=VG2PVXJD2Z4QGBY4FHMPXKXPUDSABZMVP5SOVCA7AF3DW7QTTGCA, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.215045140 (71h26m24.25461826s) [noise=true , address=45.91.116.4:4939 , piece_id=D3ZWNOEEFM76GIK3GBXPZAPTKNMAUFZFEIIPSLVY6P6NBOBFEQDQ, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.247604766 (71h26m24.287177886s) [noise=true , address=45.91.116.13:4153 , piece_id=Q3IVWHNJHOBBIWXZIFOC6BNAJFUGA67D2KAQLMHAC2PVZU3EVRFQ, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.247625516 (71h26m24.287198636s) [seg_pos={0 0}, upload=62870]: Segment reached optimal threshold of 13 pieces. Sep 9 12:54:48.247738021 (71h26m24.287311141s) [noise=true , address=45.91.116.5:4297 , piece_id=JPDIQKEWZZN2SRCK3OD7HBYPNWSS7KK3FLDB4GPZ43PG2MD4YNAA, seg_pos={0 0}, upload=62870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Sep 9 12:54:48.247909579 (71h26m24.287482689s) [noise=true , address=45.91.116.10:4083 , piece_id=Q43W36TOXEZCOVUZL3AOY6GZANULT3VNNEVRDTT7N26IBVBDD2QQ, seg_pos={0 0}, upload=62870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: read tcp 188.166.225.170:49636->45.91.116.10:4083: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 9 12:54:48.247932804 (71h26m24.287505924s) [noise=true , address=45.91.116.7:4009 , piece_id=RMM53FYXSXDKG6ZSIHIAMXBTLQ27TUSEMTQKZSGKGOABU5IF4S6Q, seg_pos={0 0}, upload=62870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: write tcp 188.166.225.170:38196->45.91.116.7:4009: use of closed network connection; write tcp 188.166.225.170:38196->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38196->45.91.116.7:4009: use of closed network connection Sep 9 12:54:48.247983561 (71h26m24.287556681s) [seg_pos={0 0}, upload=62870]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 12:54:48.248073142 (71h26m24.287646262s) [upload=62870]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 12:54:48.248077821 (71h26m24.287650941s) [upload=62870]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 12:54:48.571633944 (71h26m24.611207064s) [upload=62870]: Done uploading segments... Sep 9 12:54:48.571653581 (71h26m24.611226701s) [upload=62870]: Upload finished. err: <nil> Duration: 23.24393245s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.......................................X................XXX.] duration: 26.008081127s FAIL (2025-09-09 12:56:15 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 12:54:45.380565865 (71h26m21.420138985s) [upload=62870]: Starting upload Sep 9 12:54:45.380622493 (71h26m21.420195613s) [upload=62870]: Done starting upload Sep 9 12:54:45.380740448 (71h26m21.420313568s) [upload=62870]: Uploading segments... Sep 9 12:54:45.380902939 (71h26m21.420476059s) [upload=62870]: Got next segment. Inline: false Sep 9 12:54:45.380948337 (71h26m21.420521447s) [upload=62870]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 12:54:45.381123361 (71h26m21.420696501s) [upload=62870]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 12:54:45.861358968 (71h26m21.900932088s) [seg_pos={0 0}, upload=62870]: Begin upload segment... Sep 9 12:54:45.861422110 (71h26m21.90099522s) [seg_pos={0 0}, upload=62870]: Done begin upload segment. Sep 9 12:54:45.861472715 (71h26m21.901045836s) [noise=true , address=45.91.116.8:4045 , piece_id=R5BJPE4Q5O2ZIY3U7JTDJPKZNCRIR33AOUO54SAPNYLVQ4XUV3UQ, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.861519054 (71h26m21.901092175s) [noise=true , address=77.90.31.14:4662 , piece_id=6LVBXKQARG6RCRZKQ3TEAAXMVUXDESLLXFRQSS36ZOYK5CR56G2Q, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.862102111 (71h26m21.901675231s) [noise=true , address=45.91.116.4:4939 , piece_id=D3ZWNOEEFM76GIK3GBXPZAPTKNMAUFZFEIIPSLVY6P6NBOBFEQDQ, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.862126126 (71h26m21.901699246s) [noise=true , address=45.91.116.12:4227 , piece_id=EKQXMW7B7K5BFPOW2Y5RT35LUVBWBIS5EZP3QU74WZCF3JWIYE3Q, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.862446549 (71h26m21.902019669s) [noise=true , address=45.91.116.10:4083 , piece_id=Q43W36TOXEZCOVUZL3AOY6GZANULT3VNNEVRDTT7N26IBVBDD2QQ, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.862516914 (71h26m21.902090034s) [noise=true , address=145.79.227.18:4005 , piece_id=SXQJVRK4JBZ4EBLCPS5EULPEK3KW2AQPHDYFTTREPEUBJ2UZU6YA, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.862857225 (71h26m21.902430345s) [noise=true , address=45.91.116.7:4009 , piece_id=RMM53FYXSXDKG6ZSIHIAMXBTLQ27TUSEMTQKZSGKGOABU5IF4S6Q, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.863002143 (71h26m21.902575283s) [noise=true , address=45.91.116.13:4153 , piece_id=Q3IVWHNJHOBBIWXZIFOC6BNAJFUGA67D2KAQLMHAC2PVZU3EVRFQ, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.863215671 (71h26m21.902788781s) [noise=true , address=45.91.116.5:4297 , piece_id=JPDIQKEWZZN2SRCK3OD7HBYPNWSS7KK3FLDB4GPZ43PG2MD4YNAA, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.863586441 (71h26m21.903159561s) [noise=true , address=45.91.116.9:4263 , piece_id=VG2PVXJD2Z4QGBY4FHMPXKXPUDSABZMVP5SOVCA7AF3DW7QTTGCA, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.863676172 (71h26m21.903249292s) [noise=true , address=45.91.116.11:4119 , piece_id=DFSH5QEMFLNOT4RFAULYJYCUTV7BDDDZSNDEN7TRBTT2GCE4XCMQ, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.864109311 (71h26m21.903682431s) [noise=true , address=77.90.31.19:4841 , piece_id=TIKC27S6UNPTUJLPC47PSYLT2DOBWKXV2FTYKWYONXNVGGYFFGIA, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.864462086 (71h26m21.904035206s) [noise=true , address=77.90.31.21:4879 , piece_id=XPLKFUZU7WVQL76TK5J4V6PR62KLT4ESFVSII5RBRWOZNPXJLARA, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.865168869 (71h26m21.904741989s) [noise=true , address=145.79.227.4:4187 , piece_id=V4XEUKSCCNLTWQ2FVLMUBYPED6REKNKHBOSZDRQMBCWLD4ES4NGA, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.865492809 (71h26m21.905065919s) [noise=true , address=45.91.116.14:4191 , piece_id=DPHEN4XWBF2CYGGS3AYCTYXKQQVU4BCXFSIL7WLHQNUEXGDX2VJQ, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.867918711 (71h26m21.907491831s) [noise=true , address=77.90.31.21:4877 , piece_id=Y6E6U3XJXSDNT6GFWTNYN3KHN4JJXI4CC4NZYEIJ4YTP4TBLTXVA, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:47.698898273 (71h26m23.738471383s) [upload=62870]: Next returned nil segment Sep 9 12:54:47.698920065 (71h26m23.738493185s) [upload=62870]: Waiting for error group managing segments... Sep 9 12:54:47.996322609 (71h26m24.035895719s) [noise=true , address=145.79.227.18:4005 , piece_id=SXQJVRK4JBZ4EBLCPS5EULPEK3KW2AQPHDYFTTREPEUBJ2UZU6YA, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.028352301 (71h26m24.067925421s) [noise=true , address=45.91.116.11:4119 , piece_id=DFSH5QEMFLNOT4RFAULYJYCUTV7BDDDZSNDEN7TRBTT2GCE4XCMQ, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.094974951 (71h26m24.134548072s) [noise=true , address=77.90.31.21:4879 , piece_id=XPLKFUZU7WVQL76TK5J4V6PR62KLT4ESFVSII5RBRWOZNPXJLARA, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.096813110 (71h26m24.13638622s) [noise=true , address=77.90.31.21:4877 , piece_id=Y6E6U3XJXSDNT6GFWTNYN3KHN4JJXI4CC4NZYEIJ4YTP4TBLTXVA, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.097220730 (71h26m24.13679385s) [noise=true , address=77.90.31.14:4662 , piece_id=6LVBXKQARG6RCRZKQ3TEAAXMVUXDESLLXFRQSS36ZOYK5CR56G2Q, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.128446042 (71h26m24.168019162s) [noise=true , address=145.79.227.4:4187 , piece_id=V4XEUKSCCNLTWQ2FVLMUBYPED6REKNKHBOSZDRQMBCWLD4ES4NGA, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.141392066 (71h26m24.180965176s) [noise=true , address=45.91.116.14:4191 , piece_id=DPHEN4XWBF2CYGGS3AYCTYXKQQVU4BCXFSIL7WLHQNUEXGDX2VJQ, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.148560975 (71h26m24.188134095s) [noise=true , address=45.91.116.8:4045 , piece_id=R5BJPE4Q5O2ZIY3U7JTDJPKZNCRIR33AOUO54SAPNYLVQ4XUV3UQ, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.150518240 (71h26m24.19009136s) [noise=true , address=45.91.116.12:4227 , piece_id=EKQXMW7B7K5BFPOW2Y5RT35LUVBWBIS5EZP3QU74WZCF3JWIYE3Q, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.153436375 (71h26m24.193009495s) [noise=true , address=77.90.31.19:4841 , piece_id=TIKC27S6UNPTUJLPC47PSYLT2DOBWKXV2FTYKWYONXNVGGYFFGIA, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.184113700 (71h26m24.22368682s) [noise=true , address=45.91.116.9:4263 , piece_id=VG2PVXJD2Z4QGBY4FHMPXKXPUDSABZMVP5SOVCA7AF3DW7QTTGCA, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.215045140 (71h26m24.25461826s) [noise=true , address=45.91.116.4:4939 , piece_id=D3ZWNOEEFM76GIK3GBXPZAPTKNMAUFZFEIIPSLVY6P6NBOBFEQDQ, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.247604766 (71h26m24.287177886s) [noise=true , address=45.91.116.13:4153 , piece_id=Q3IVWHNJHOBBIWXZIFOC6BNAJFUGA67D2KAQLMHAC2PVZU3EVRFQ, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.247625516 (71h26m24.287198636s) [seg_pos={0 0}, upload=62870]: Segment reached optimal threshold of 13 pieces. Sep 9 12:54:48.247738021 (71h26m24.287311141s) [noise=true , address=45.91.116.5:4297 , piece_id=JPDIQKEWZZN2SRCK3OD7HBYPNWSS7KK3FLDB4GPZ43PG2MD4YNAA, seg_pos={0 0}, upload=62870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Sep 9 12:54:48.247909579 (71h26m24.287482689s) [noise=true , address=45.91.116.10:4083 , piece_id=Q43W36TOXEZCOVUZL3AOY6GZANULT3VNNEVRDTT7N26IBVBDD2QQ, seg_pos={0 0}, upload=62870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: read tcp 188.166.225.170:49636->45.91.116.10:4083: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 9 12:54:48.247932804 (71h26m24.287505924s) [noise=true , address=45.91.116.7:4009 , piece_id=RMM53FYXSXDKG6ZSIHIAMXBTLQ27TUSEMTQKZSGKGOABU5IF4S6Q, seg_pos={0 0}, upload=62870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: write tcp 188.166.225.170:38196->45.91.116.7:4009: use of closed network connection; write tcp 188.166.225.170:38196->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38196->45.91.116.7:4009: use of closed network connection Sep 9 12:54:48.247983561 (71h26m24.287556681s) [seg_pos={0 0}, upload=62870]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 12:54:48.248073142 (71h26m24.287646262s) [upload=62870]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 12:54:48.248077821 (71h26m24.287650941s) [upload=62870]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 12:54:48.571633944 (71h26m24.611207064s) [upload=62870]: Done uploading segments... Sep 9 12:54:48.571653581 (71h26m24.611226701s) [upload=62870]: Upload finished. err: <nil> Duration: 26.008127016s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [........................................X................XXX] duration: 30.001457277s FAIL (2025-09-09 12:55:14 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 12:54:45.380565865 (71h26m21.420138985s) [upload=62870]: Starting upload Sep 9 12:54:45.380622493 (71h26m21.420195613s) [upload=62870]: Done starting upload Sep 9 12:54:45.380740448 (71h26m21.420313568s) [upload=62870]: Uploading segments... Sep 9 12:54:45.380902939 (71h26m21.420476059s) [upload=62870]: Got next segment. Inline: false Sep 9 12:54:45.380948337 (71h26m21.420521447s) [upload=62870]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 12:54:45.381123361 (71h26m21.420696501s) [upload=62870]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 12:54:45.861358968 (71h26m21.900932088s) [seg_pos={0 0}, upload=62870]: Begin upload segment... Sep 9 12:54:45.861422110 (71h26m21.90099522s) [seg_pos={0 0}, upload=62870]: Done begin upload segment. Sep 9 12:54:45.861472715 (71h26m21.901045836s) [noise=true , address=45.91.116.8:4045 , piece_id=R5BJPE4Q5O2ZIY3U7JTDJPKZNCRIR33AOUO54SAPNYLVQ4XUV3UQ, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.861519054 (71h26m21.901092175s) [noise=true , address=77.90.31.14:4662 , piece_id=6LVBXKQARG6RCRZKQ3TEAAXMVUXDESLLXFRQSS36ZOYK5CR56G2Q, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.862102111 (71h26m21.901675231s) [noise=true , address=45.91.116.4:4939 , piece_id=D3ZWNOEEFM76GIK3GBXPZAPTKNMAUFZFEIIPSLVY6P6NBOBFEQDQ, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.862126126 (71h26m21.901699246s) [noise=true , address=45.91.116.12:4227 , piece_id=EKQXMW7B7K5BFPOW2Y5RT35LUVBWBIS5EZP3QU74WZCF3JWIYE3Q, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.862446549 (71h26m21.902019669s) [noise=true , address=45.91.116.10:4083 , piece_id=Q43W36TOXEZCOVUZL3AOY6GZANULT3VNNEVRDTT7N26IBVBDD2QQ, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.862516914 (71h26m21.902090034s) [noise=true , address=145.79.227.18:4005 , piece_id=SXQJVRK4JBZ4EBLCPS5EULPEK3KW2AQPHDYFTTREPEUBJ2UZU6YA, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.862857225 (71h26m21.902430345s) [noise=true , address=45.91.116.7:4009 , piece_id=RMM53FYXSXDKG6ZSIHIAMXBTLQ27TUSEMTQKZSGKGOABU5IF4S6Q, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.863002143 (71h26m21.902575283s) [noise=true , address=45.91.116.13:4153 , piece_id=Q3IVWHNJHOBBIWXZIFOC6BNAJFUGA67D2KAQLMHAC2PVZU3EVRFQ, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.863215671 (71h26m21.902788781s) [noise=true , address=45.91.116.5:4297 , piece_id=JPDIQKEWZZN2SRCK3OD7HBYPNWSS7KK3FLDB4GPZ43PG2MD4YNAA, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.863586441 (71h26m21.903159561s) [noise=true , address=45.91.116.9:4263 , piece_id=VG2PVXJD2Z4QGBY4FHMPXKXPUDSABZMVP5SOVCA7AF3DW7QTTGCA, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.863676172 (71h26m21.903249292s) [noise=true , address=45.91.116.11:4119 , piece_id=DFSH5QEMFLNOT4RFAULYJYCUTV7BDDDZSNDEN7TRBTT2GCE4XCMQ, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.864109311 (71h26m21.903682431s) [noise=true , address=77.90.31.19:4841 , piece_id=TIKC27S6UNPTUJLPC47PSYLT2DOBWKXV2FTYKWYONXNVGGYFFGIA, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.864462086 (71h26m21.904035206s) [noise=true , address=77.90.31.21:4879 , piece_id=XPLKFUZU7WVQL76TK5J4V6PR62KLT4ESFVSII5RBRWOZNPXJLARA, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.865168869 (71h26m21.904741989s) [noise=true , address=145.79.227.4:4187 , piece_id=V4XEUKSCCNLTWQ2FVLMUBYPED6REKNKHBOSZDRQMBCWLD4ES4NGA, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.865492809 (71h26m21.905065919s) [noise=true , address=45.91.116.14:4191 , piece_id=DPHEN4XWBF2CYGGS3AYCTYXKQQVU4BCXFSIL7WLHQNUEXGDX2VJQ, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:45.867918711 (71h26m21.907491831s) [noise=true , address=77.90.31.21:4877 , piece_id=Y6E6U3XJXSDNT6GFWTNYN3KHN4JJXI4CC4NZYEIJ4YTP4TBLTXVA, seg_pos={0 0}, upload=62870]: Uploading piece... Sep 9 12:54:47.698898273 (71h26m23.738471383s) [upload=62870]: Next returned nil segment Sep 9 12:54:47.698920065 (71h26m23.738493185s) [upload=62870]: Waiting for error group managing segments... Sep 9 12:54:47.996322609 (71h26m24.035895719s) [noise=true , address=145.79.227.18:4005 , piece_id=SXQJVRK4JBZ4EBLCPS5EULPEK3KW2AQPHDYFTTREPEUBJ2UZU6YA, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.028352301 (71h26m24.067925421s) [noise=true , address=45.91.116.11:4119 , piece_id=DFSH5QEMFLNOT4RFAULYJYCUTV7BDDDZSNDEN7TRBTT2GCE4XCMQ, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.094974951 (71h26m24.134548072s) [noise=true , address=77.90.31.21:4879 , piece_id=XPLKFUZU7WVQL76TK5J4V6PR62KLT4ESFVSII5RBRWOZNPXJLARA, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.096813110 (71h26m24.13638622s) [noise=true , address=77.90.31.21:4877 , piece_id=Y6E6U3XJXSDNT6GFWTNYN3KHN4JJXI4CC4NZYEIJ4YTP4TBLTXVA, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.097220730 (71h26m24.13679385s) [noise=true , address=77.90.31.14:4662 , piece_id=6LVBXKQARG6RCRZKQ3TEAAXMVUXDESLLXFRQSS36ZOYK5CR56G2Q, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.128446042 (71h26m24.168019162s) [noise=true , address=145.79.227.4:4187 , piece_id=V4XEUKSCCNLTWQ2FVLMUBYPED6REKNKHBOSZDRQMBCWLD4ES4NGA, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.141392066 (71h26m24.180965176s) [noise=true , address=45.91.116.14:4191 , piece_id=DPHEN4XWBF2CYGGS3AYCTYXKQQVU4BCXFSIL7WLHQNUEXGDX2VJQ, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.148560975 (71h26m24.188134095s) [noise=true , address=45.91.116.8:4045 , piece_id=R5BJPE4Q5O2ZIY3U7JTDJPKZNCRIR33AOUO54SAPNYLVQ4XUV3UQ, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.150518240 (71h26m24.19009136s) [noise=true , address=45.91.116.12:4227 , piece_id=EKQXMW7B7K5BFPOW2Y5RT35LUVBWBIS5EZP3QU74WZCF3JWIYE3Q, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.153436375 (71h26m24.193009495s) [noise=true , address=77.90.31.19:4841 , piece_id=TIKC27S6UNPTUJLPC47PSYLT2DOBWKXV2FTYKWYONXNVGGYFFGIA, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.184113700 (71h26m24.22368682s) [noise=true , address=45.91.116.9:4263 , piece_id=VG2PVXJD2Z4QGBY4FHMPXKXPUDSABZMVP5SOVCA7AF3DW7QTTGCA, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.215045140 (71h26m24.25461826s) [noise=true , address=45.91.116.4:4939 , piece_id=D3ZWNOEEFM76GIK3GBXPZAPTKNMAUFZFEIIPSLVY6P6NBOBFEQDQ, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.247604766 (71h26m24.287177886s) [noise=true , address=45.91.116.13:4153 , piece_id=Q3IVWHNJHOBBIWXZIFOC6BNAJFUGA67D2KAQLMHAC2PVZU3EVRFQ, seg_pos={0 0}, upload=62870]: Done uploading piece. err: <nil> Sep 9 12:54:48.247625516 (71h26m24.287198636s) [seg_pos={0 0}, upload=62870]: Segment reached optimal threshold of 13 pieces. Sep 9 12:54:48.247738021 (71h26m24.287311141s) [noise=true , address=45.91.116.5:4297 , piece_id=JPDIQKEWZZN2SRCK3OD7HBYPNWSS7KK3FLDB4GPZ43PG2MD4YNAA, seg_pos={0 0}, upload=62870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Sep 9 12:54:48.247909579 (71h26m24.287482689s) [noise=true , address=45.91.116.10:4083 , piece_id=Q43W36TOXEZCOVUZL3AOY6GZANULT3VNNEVRDTT7N26IBVBDD2QQ, seg_pos={0 0}, upload=62870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: read tcp 188.166.225.170:49636->45.91.116.10:4083: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 9 12:54:48.247932804 (71h26m24.287505924s) [noise=true , address=45.91.116.7:4009 , piece_id=RMM53FYXSXDKG6ZSIHIAMXBTLQ27TUSEMTQKZSGKGOABU5IF4S6Q, seg_pos={0 0}, upload=62870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: write tcp 188.166.225.170:38196->45.91.116.7:4009: use of closed network connection; write tcp 188.166.225.170:38196->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38196->45.91.116.7:4009: use of closed network connection Sep 9 12:54:48.247983561 (71h26m24.287556681s) [seg_pos={0 0}, upload=62870]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 12:54:48.248073142 (71h26m24.287646262s) [upload=62870]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 12:54:48.248077821 (71h26m24.287650941s) [upload=62870]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 12:54:48.571633944 (71h26m24.611207064s) [upload=62870]: Done uploading segments... Sep 9 12:54:48.571653581 (71h26m24.611226701s) [upload=62870]: Upload finished. err: <nil> Duration: 30.001475903s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.........................................X................XX] duration: 30.002083866s FAIL (2025-09-09 12:54:23 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 12:53:54.064272499 (71h25m30.103845619s) [upload=62857]: Starting upload Sep 9 12:53:54.064347322 (71h25m30.103920442s) [upload=62857]: Done starting upload Sep 9 12:53:54.064402728 (71h25m30.103975848s) [upload=62857]: Uploading segments... Sep 9 12:53:54.064611258 (71h25m30.104184378s) [upload=62857]: Got next segment. Inline: false Sep 9 12:53:54.064698885 (71h25m30.104272005s) [upload=62857]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 12:53:54.064704466 (71h25m30.104277586s) [upload=62857]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 12:53:54.385557214 (71h25m30.425130344s) [seg_pos={0 0}, upload=62857]: Begin upload segment... Sep 9 12:53:54.385624473 (71h25m30.425197593s) [seg_pos={0 0}, upload=62857]: Done begin upload segment. Sep 9 12:53:54.385666082 (71h25m30.425239202s) [noise=true , address=77.90.31.10:4519 , piece_id=REMM2JL3NUF6LUNSEPFYGJE4FB5WTDNSVS7TQRTJNWQAEAAUHPZQ, seg_pos={0 0}, upload=62857]: Uploading piece... Sep 9 12:53:54.385686943 (71h25m30.425260063s) [noise=true , address=145.79.227.7:4295 , piece_id=K3AZBCOM7ZVLVILEKGTGE3PGWC6562UUGZO7M32H53GRG6S5KTFA, seg_pos={0 0}, upload=62857]: Uploading piece... Sep 9 12:53:54.386183983 (71h25m30.425757103s) [noise=true , address=45.91.116.10:4082 , piece_id=LG6ZJ6DUZ5W2OZQJIO7RKF6YOWF244ASPEOVIS2WL6EYYY6FU4LQ, seg_pos={0 0}, upload=62857]: Uploading piece... Sep 9 12:53:54.386467026 (71h25m30.426040146s) [noise=true , address=45.91.116.8:4045 , piece_id=OPWLZ3WYGPQQ6JZO3KUWR4JYZJHNTFALO76ZCK7T7KXKLFTKWJ5Q, seg_pos={0 0}, upload=62857]: Uploading piece... Sep 9 12:53:54.386482134 (71h25m30.426055254s) [noise=true , address=45.91.116.9:4262 , piece_id=NXBAS72332UGAB3SPLUQ3PA7JUQM4VZ2DCVUKLQAK3H5GBNNNE3Q, seg_pos={0 0}, upload=62857]: Uploading piece... Sep 9 12:53:54.386501111 (71h25m30.426074231s) [noise=true , address=145.79.227.5:4222 , piece_id=4Z5WVWBZDM3EO763OXJE3BR462ENVGFUTNROR5JWXS2IFCR5KSTA, seg_pos={0 0}, upload=62857]: Uploading piece... Sep 9 12:53:54.386867713 (71h25m30.426440833s) [noise=true , address=77.90.31.17:4772 , piece_id=MHGJX7BDCCSDQ33UALWTHIIUYZZ5WFVW6D5VY6KINCQMZS77ITFA, seg_pos={0 0}, upload=62857]: Uploading piece... Sep 9 12:53:54.387266545 (71h25m30.426839675s) [noise=true , address=77.90.31.19:4843 , piece_id=GLHWRP6WU3TOBVLXEAY4VKLXOL6QWZSFHVHDE77A7THCQPZ6GRDA, seg_pos={0 0}, upload=62857]: Uploading piece... Sep 9 12:53:54.387680417 (71h25m30.427253537s) [noise=true , address=45.91.116.6:4974 , piece_id=DFPZH5K4D2KSFW6TWOWKO5NSWT27QAQ2MTA4DPLDSMCRRL7KOCQA, seg_pos={0 0}, upload=62857]: Uploading piece... Sep 9 12:53:54.388030597 (71h25m30.427603717s) [noise=true , address=77.90.31.18:4805 , piece_id=OO5QXG2U7R43UGPAJL75LGNK4ZI5TBQ5DQJHIFMD2HARE7FMJQMQ, seg_pos={0 0}, upload=62857]: Uploading piece... Sep 9 12:53:54.388385426 (71h25m30.427958546s) [noise=true , address=45.91.116.12:4225 , piece_id=U26NDZ2HQ7KFMOJV5FF6WH67NGKMTMBNFU5PRBNNUZBEBDWWE2ZQ, seg_pos={0 0}, upload=62857]: Uploading piece... Sep 9 12:53:54.388709106 (71h25m30.428282226s) [noise=true , address=45.91.116.9:4263 , piece_id=XTPNJCENPZDAJRLFB6CDPIXIIMABZEDW6LVY5Z567CZOQ7NBVK2Q, seg_pos={0 0}, upload=62857]: Uploading piece... Sep 9 12:53:54.389014540 (71h25m30.42858766s) [noise=true , address=45.91.116.11:4119 , piece_id=AZQVL32R57ABVNBLZPY2GB2KVT3GVGPLOLKZXNRFIZC4EXGQ7UYQ, seg_pos={0 0}, upload=62857]: Uploading piece... Sep 9 12:53:54.389309795 (71h25m30.428882915s) [noise=true , address=77.90.31.13:4626 , piece_id=BWA6HTB4JTUEZXZWOJL36BKF2HZWVKTRNGVB4SV6P3IJQ3YXNYLQ, seg_pos={0 0}, upload=62857]: Uploading piece... Sep 9 12:53:54.389644146 (71h25m30.429217266s) [noise=true , address=45.91.116.6:4975 , piece_id=3OAXI3TPQKFF24QU24YQK5X3WOBDFFPC7HAKBBAO3AHZPXBOVJRQ, seg_pos={0 0}, upload=62857]: Uploading piece... Sep 9 12:53:54.390003373 (71h25m30.429576493s) [noise=true , address=45.91.116.5:4298 , piece_id=2RDHMJSF56EHMOPR4B7R6ZB73KDV7Q3NJL3MOX2TA3APJW5BXAUQ, seg_pos={0 0}, upload=62857]: Uploading piece... Sep 9 12:53:56.228053084 (71h25m32.267626214s) [upload=62857]: Next returned nil segment Sep 9 12:53:56.228107949 (71h25m32.267681069s) [upload=62857]: Waiting for error group managing segments... Sep 9 12:53:56.535902670 (71h25m32.575475791s) [noise=true , address=145.79.227.7:4295 , piece_id=K3AZBCOM7ZVLVILEKGTGE3PGWC6562UUGZO7M32H53GRG6S5KTFA, seg_pos={0 0}, upload=62857]: Done uploading piece. err: <nil> Sep 9 12:53:56.600056476 (71h25m32.639629596s) [noise=true , address=45.91.116.12:4225 , piece_id=U26NDZ2HQ7KFMOJV5FF6WH67NGKMTMBNFU5PRBNNUZBEBDWWE2ZQ, seg_pos={0 0}, upload=62857]: Done uploading piece. err: <nil> Sep 9 12:53:56.604825702 (71h25m32.644398822s) [noise=true , address=45.91.116.10:4082 , piece_id=LG6ZJ6DUZ5W2OZQJIO7RKF6YOWF244ASPEOVIS2WL6EYYY6FU4LQ, seg_pos={0 0}, upload=62857]: Done uploading piece. err: <nil> Sep 9 12:53:56.632377246 (71h25m32.671950356s) [noise=true , address=77.90.31.13:4626 , piece_id=BWA6HTB4JTUEZXZWOJL36BKF2HZWVKTRNGVB4SV6P3IJQ3YXNYLQ, seg_pos={0 0}, upload=62857]: Done uploading piece. err: <nil> Sep 9 12:53:56.651696325 (71h25m32.691269445s) [noise=true , address=45.91.116.5:4298 , piece_id=2RDHMJSF56EHMOPR4B7R6ZB73KDV7Q3NJL3MOX2TA3APJW5BXAUQ, seg_pos={0 0}, upload=62857]: Done uploading piece. err: <nil> Sep 9 12:53:56.660014312 (71h25m32.699587433s) [noise=true , address=45.91.116.6:4974 , piece_id=DFPZH5K4D2KSFW6TWOWKO5NSWT27QAQ2MTA4DPLDSMCRRL7KOCQA, seg_pos={0 0}, upload=62857]: Done uploading piece. err: <nil> Sep 9 12:53:56.666477701 (71h25m32.706050821s) [noise=true , address=45.91.116.9:4262 , piece_id=NXBAS72332UGAB3SPLUQ3PA7JUQM4VZ2DCVUKLQAK3H5GBNNNE3Q, seg_pos={0 0}, upload=62857]: Done uploading piece. err: <nil> Sep 9 12:53:56.684976800 (71h25m32.72454992s) [noise=true , address=45.91.116.9:4263 , piece_id=XTPNJCENPZDAJRLFB6CDPIXIIMABZEDW6LVY5Z567CZOQ7NBVK2Q, seg_pos={0 0}, upload=62857]: Done uploading piece. err: <nil> Sep 9 12:53:56.695898821 (71h25m32.735471941s) [noise=true , address=77.90.31.17:4772 , piece_id=MHGJX7BDCCSDQ33UALWTHIIUYZZ5WFVW6D5VY6KINCQMZS77ITFA, seg_pos={0 0}, upload=62857]: Done uploading piece. err: <nil> Sep 9 12:53:56.701636802 (71h25m32.741209922s) [noise=true , address=45.91.116.8:4045 , piece_id=OPWLZ3WYGPQQ6JZO3KUWR4JYZJHNTFALO76ZCK7T7KXKLFTKWJ5Q, seg_pos={0 0}, upload=62857]: Done uploading piece. err: <nil> Sep 9 12:53:56.707110857 (71h25m32.746683977s) [noise=true , address=77.90.31.10:4519 , piece_id=REMM2JL3NUF6LUNSEPFYGJE4FB5WTDNSVS7TQRTJNWQAEAAUHPZQ, seg_pos={0 0}, upload=62857]: Done uploading piece. err: <nil> Sep 9 12:53:56.732783604 (71h25m32.772356724s) [noise=true , address=45.91.116.11:4119 , piece_id=AZQVL32R57ABVNBLZPY2GB2KVT3GVGPLOLKZXNRFIZC4EXGQ7UYQ, seg_pos={0 0}, upload=62857]: Done uploading piece. err: <nil> Sep 9 12:53:56.745161110 (71h25m32.78473423s) [noise=true , address=77.90.31.19:4843 , piece_id=GLHWRP6WU3TOBVLXEAY4VKLXOL6QWZSFHVHDE77A7THCQPZ6GRDA, seg_pos={0 0}, upload=62857]: Done uploading piece. err: <nil> Sep 9 12:53:56.745178654 (71h25m32.784751774s) [seg_pos={0 0}, upload=62857]: Segment reached optimal threshold of 13 pieces. Sep 9 12:53:56.745284096 (71h25m32.784857216s) [noise=true , address=145.79.227.5:4222 , piece_id=4Z5WVWBZDM3EO763OXJE3BR462ENVGFUTNROR5JWXS2IFCR5KSTA, seg_pos={0 0}, upload=62857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1): protocol: expected piece hash; context canceled; EOF Sep 9 12:53:56.745362184 (71h25m32.784935295s) [noise=true , address=77.90.31.18:4805 , piece_id=OO5QXG2U7R43UGPAJL75LGNK4ZI5TBQ5DQJHIFMD2HARE7FMJQMQ, seg_pos={0 0}, upload=62857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF Sep 9 12:53:56.745500119 (71h25m32.78507329s) [noise=true , address=45.91.116.6:4975 , piece_id=3OAXI3TPQKFF24QU24YQK5X3WOBDFFPC7HAKBBAO3AHZPXBOVJRQ, seg_pos={0 0}, upload=62857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Sep 9 12:53:56.745546978 (71h25m32.785120128s) [seg_pos={0 0}, upload=62857]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 12:53:56.745654534 (71h25m32.785227684s) [upload=62857]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 12:53:56.745662339 (71h25m32.785235499s) [upload=62857]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 12:53:57.426723830 (71h25m33.46629695s) [upload=62857]: Done uploading segments... Sep 9 12:53:57.426747355 (71h25m33.466320475s) [upload=62857]: Upload finished. err: <nil> Duration: 30.002130545s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........................................X................X] duration: 30.002255097s FAIL (2025-09-09 12:53:46 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 12:53:16.702358818 (71h24m52.741931938s) [upload=62846]: Starting upload Sep 9 12:53:16.702416889 (71h24m52.741990009s) [upload=62846]: Done starting upload Sep 9 12:53:16.702500980 (71h24m52.7420741s) [upload=62846]: Uploading segments... Sep 9 12:53:16.702579380 (71h24m52.7421525s) [upload=62846]: Got next segment. Inline: false Sep 9 12:53:16.702603577 (71h24m52.742176697s) [upload=62846]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 12:53:16.702607845 (71h24m52.742180965s) [upload=62846]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 12:53:17.039967413 (71h24m53.079540533s) [seg_pos={0 0}, upload=62846]: Begin upload segment... Sep 9 12:53:17.040010265 (71h24m53.079583385s) [seg_pos={0 0}, upload=62846]: Done begin upload segment. Sep 9 12:53:17.040031095 (71h24m53.079604215s) [noise=true , address=45.91.116.10:4081 , piece_id=GI5WHKKARH6FDZ727EDOWUYVCX6R7YSKEHG37IEP3KABTCVQNZUA, seg_pos={0 0}, upload=62846]: Uploading piece... Sep 9 12:53:17.040065410 (71h24m53.07963853s) [noise=true , address=45.91.116.14:4189 , piece_id=5J42G4Z7ZV7UYE4HPUZD4GH5D5LLLIOER3UH2CV5RJLVCSOEAEAQ, seg_pos={0 0}, upload=62846]: Uploading piece... Sep 9 12:53:17.040388779 (71h24m53.079961899s) [noise=true , address=77.90.31.19:4841 , piece_id=D7Y5BISHYSCJ5J6JFVFGNVTDVTETHINHNNTSRGSLJ4STKY6AJGLA, seg_pos={0 0}, upload=62846]: Uploading piece... Sep 9 12:53:17.040583822 (71h24m53.080157052s) [noise=true , address=77.90.31.10:4520 , piece_id=GNXQNBLIWBFG57FHM6BBGBYB35CQDTERBE7UTF3EOOGIFPV5WJJQ, seg_pos={0 0}, upload=62846]: Uploading piece... Sep 9 12:53:17.040665919 (71h24m53.080239039s) [noise=true , address=45.91.116.9:4262 , piece_id=UAYDBGYZYBURFJFEMDMZIZ23XCBGARJ563YTVM4SXVGLAQBC6HDQ, seg_pos={0 0}, upload=62846]: Uploading piece... Sep 9 12:53:17.040886461 (71h24m53.080459581s) [noise=true , address=45.91.116.13:4153 , piece_id=IB7K2NS2WLJO73NQXTWZRMLTGMEQVPQOCXV6QZRXZYZMVQCIJN2A, seg_pos={0 0}, upload=62846]: Uploading piece... Sep 9 12:53:17.040938721 (71h24m53.080511831s) [noise=true , address=77.90.31.15:4697 , piece_id=ESJNRGP27OUFEZS3ZX4AFMNPGQVM6DYIUOSNEJOOYUVKXWVNTO6A, seg_pos={0 0}, upload=62846]: Uploading piece... Sep 9 12:53:17.041203308 (71h24m53.080776428s) [noise=true , address=45.91.116.11:4118 , piece_id=HB2VWZAWE3ZDSNRVOUG2SYSZBXD64ICOQTX2W7AEYTXW4DEQ6PBA, seg_pos={0 0}, upload=62846]: Uploading piece... Sep 9 12:53:17.041279704 (71h24m53.080852824s) [noise=true , address=45.91.116.6:4973 , piece_id=XWCEXRYZJR2N6LFDOT37FL4GEEKQWZ2Q4NZ5XYUBNPQO5XLFPYZQ, seg_pos={0 0}, upload=62846]: Uploading piece... Sep 9 12:53:17.041462994 (71h24m53.081036124s) [noise=true , address=77.90.31.16:4733 , piece_id=MGV3WQHGFAN24DXTUU5VOBCMTBDECLACXNH67L6TOIOGXYAOVSHQ, seg_pos={0 0}, upload=62846]: Uploading piece... Sep 9 12:53:17.041585309 (71h24m53.081158429s) [noise=true , address=77.90.31.13:4628 , piece_id=TD5P3LRNQD6OXPNIXFH4CQ2MPTWXZEV3N3VGCBB6TGTEMXZP3ZTQ, seg_pos={0 0}, upload=62846]: Uploading piece... Sep 9 12:53:17.041899119 (71h24m53.081472239s) [noise=true , address=145.79.227.6:4258 , piece_id=VIZZFWKTDIYWTEJBQQQPOHPP75DT65PAMJXZKSOAH2KVL7QMTYQQ, seg_pos={0 0}, upload=62846]: Uploading piece... Sep 9 12:53:17.041915931 (71h24m53.081489051s) [noise=true , address=145.79.227.4:4187 , piece_id=2N4AM6MCHW3I7CVY5F3OYFRTUNPKSJCMSFL7CCTB3PDJOHZBKXRA, seg_pos={0 0}, upload=62846]: Uploading piece... Sep 9 12:53:17.042149087 (71h24m53.081722207s) [noise=true , address=77.90.31.12:4590 , piece_id=AGKNUTJBAQMMHQBYLXD5ASAFEE32QVMUYPO3XTYKBMH6SR3C756Q, seg_pos={0 0}, upload=62846]: Uploading piece... Sep 9 12:53:17.042153055 (71h24m53.081726175s) [noise=true , address=45.91.116.13:4154 , piece_id=4TEJSGEIHUZZYBXNTBGCS2UTALFOM33IB6GBCYA3A5HVJ2OD24TQ, seg_pos={0 0}, upload=62846]: Uploading piece... Sep 9 12:53:17.042379949 (71h24m53.081953069s) [noise=true , address=45.91.116.12:4226 , piece_id=B2CFACVEFCF5WNR56J5SWDZCBGWEQFCPXHFRMX2AOD4Z7UTLZTYA, seg_pos={0 0}, upload=62846]: Uploading piece... Sep 9 12:53:18.896694455 (71h24m54.936267615s) [upload=62846]: Next returned nil segment Sep 9 12:53:18.896931569 (71h24m54.936504689s) [upload=62846]: Waiting for error group managing segments... Sep 9 12:53:19.220199961 (71h24m55.259773081s) [noise=true , address=77.90.31.13:4628 , piece_id=TD5P3LRNQD6OXPNIXFH4CQ2MPTWXZEV3N3VGCBB6TGTEMXZP3ZTQ, seg_pos={0 0}, upload=62846]: Done uploading piece. err: <nil> Sep 9 12:53:19.247381847 (71h24m55.286954967s) [noise=true , address=45.91.116.13:4153 , piece_id=IB7K2NS2WLJO73NQXTWZRMLTGMEQVPQOCXV6QZRXZYZMVQCIJN2A, seg_pos={0 0}, upload=62846]: Done uploading piece. err: <nil> Sep 9 12:53:19.249349031 (71h24m55.288922161s) [noise=true , address=45.91.116.12:4226 , piece_id=B2CFACVEFCF5WNR56J5SWDZCBGWEQFCPXHFRMX2AOD4Z7UTLZTYA, seg_pos={0 0}, upload=62846]: Done uploading piece. err: <nil> Sep 9 12:53:19.252378879 (71h24m55.291951999s) [noise=true , address=77.90.31.15:4697 , piece_id=ESJNRGP27OUFEZS3ZX4AFMNPGQVM6DYIUOSNEJOOYUVKXWVNTO6A, seg_pos={0 0}, upload=62846]: Done uploading piece. err: <nil> Sep 9 12:53:19.259819608 (71h24m55.299392728s) [noise=true , address=77.90.31.12:4590 , piece_id=AGKNUTJBAQMMHQBYLXD5ASAFEE32QVMUYPO3XTYKBMH6SR3C756Q, seg_pos={0 0}, upload=62846]: Done uploading piece. err: <nil> Sep 9 12:53:19.279522011 (71h24m55.319095151s) [noise=true , address=145.79.227.4:4187 , piece_id=2N4AM6MCHW3I7CVY5F3OYFRTUNPKSJCMSFL7CCTB3PDJOHZBKXRA, seg_pos={0 0}, upload=62846]: Done uploading piece. err: <nil> Sep 9 12:53:19.282690744 (71h24m55.322263854s) [noise=true , address=45.91.116.10:4081 , piece_id=GI5WHKKARH6FDZ727EDOWUYVCX6R7YSKEHG37IEP3KABTCVQNZUA, seg_pos={0 0}, upload=62846]: Done uploading piece. err: <nil> Sep 9 12:53:19.288601035 (71h24m55.328174145s) [noise=true , address=77.90.31.10:4520 , piece_id=GNXQNBLIWBFG57FHM6BBGBYB35CQDTERBE7UTF3EOOGIFPV5WJJQ, seg_pos={0 0}, upload=62846]: Done uploading piece. err: <nil> Sep 9 12:53:19.320215091 (71h24m55.359788271s) [noise=true , address=45.91.116.9:4262 , piece_id=UAYDBGYZYBURFJFEMDMZIZ23XCBGARJ563YTVM4SXVGLAQBC6HDQ, seg_pos={0 0}, upload=62846]: Done uploading piece. err: <nil> Sep 9 12:53:19.351342136 (71h24m55.390915276s) [noise=true , address=45.91.116.6:4973 , piece_id=XWCEXRYZJR2N6LFDOT37FL4GEEKQWZ2Q4NZ5XYUBNPQO5XLFPYZQ, seg_pos={0 0}, upload=62846]: Done uploading piece. err: <nil> Sep 9 12:53:19.375561954 (71h24m55.415135074s) [noise=true , address=45.91.116.11:4118 , piece_id=HB2VWZAWE3ZDSNRVOUG2SYSZBXD64ICOQTX2W7AEYTXW4DEQ6PBA, seg_pos={0 0}, upload=62846]: Done uploading piece. err: <nil> Sep 9 12:53:19.409675083 (71h24m55.449248203s) [noise=true , address=77.90.31.19:4841 , piece_id=D7Y5BISHYSCJ5J6JFVFGNVTDVTETHINHNNTSRGSLJ4STKY6AJGLA, seg_pos={0 0}, upload=62846]: Done uploading piece. err: <nil> Sep 9 12:53:19.965001155 (71h24m56.004574275s) [noise=true , address=45.91.116.14:4189 , piece_id=5J42G4Z7ZV7UYE4HPUZD4GH5D5LLLIOER3UH2CV5RJLVCSOEAEAQ, seg_pos={0 0}, upload=62846]: Done uploading piece. err: <nil> Sep 9 12:53:19.965034849 (71h24m56.004607969s) [seg_pos={0 0}, upload=62846]: Segment reached optimal threshold of 13 pieces. Sep 9 12:53:19.965208912 (71h24m56.004782022s) [noise=true , address=45.91.116.13:4154 , piece_id=4TEJSGEIHUZZYBXNTBGCS2UTALFOM33IB6GBCYA3A5HVJ2OD24TQ, seg_pos={0 0}, upload=62846]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF Sep 9 12:53:19.965407592 (71h24m56.004980712s) [noise=true , address=145.79.227.6:4258 , piece_id=VIZZFWKTDIYWTEJBQQQPOHPP75DT65PAMJXZKSOAH2KVL7QMTYQQ, seg_pos={0 0}, upload=62846]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: write tcp 188.166.225.170:49610->145.79.227.6:4258: use of closed network connection; write tcp 188.166.225.170:49610->145.79.227.6:4258: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49610->145.79.227.6:4258: use of closed network connection Sep 9 12:53:19.965464842 (71h24m56.005037962s) [noise=true , address=77.90.31.16:4733 , piece_id=MGV3WQHGFAN24DXTUU5VOBCMTBDECLACXNH67L6TOIOGXYAOVSHQ, seg_pos={0 0}, upload=62846]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: expected piece hash; context canceled; EOF Sep 9 12:53:19.965474220 (71h24m56.00504734s) [seg_pos={0 0}, upload=62846]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 12:53:19.965554073 (71h24m56.005127183s) [upload=62846]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 12:53:19.965558060 (71h24m56.00513118s) [upload=62846]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 12:53:20.430185589 (71h24m56.469758709s) [upload=62846]: Done uploading segments... Sep 9 12:53:20.430202191 (71h24m56.469775311s) [upload=62846]: Upload finished. err: <nil> Duration: 30.002282028s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 26.012906354s FAIL (2025-09-09 12:52:33 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 12:39:03.275681631 (71h10m39.315254751s) [upload=62633]: Starting upload Sep 9 12:39:03.275744833 (71h10m39.315317953s) [upload=62633]: Done starting upload Sep 9 12:39:03.275813914 (71h10m39.315387034s) [upload=62633]: Uploading segments... Sep 9 12:39:03.276020751 (71h10m39.315593881s) [upload=62633]: Got next segment. Inline: false Sep 9 12:39:03.276059825 (71h10m39.315632945s) [upload=62633]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 12:39:03.276064905 (71h10m39.315638025s) [upload=62633]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 12:39:03.574977477 (71h10m39.614550597s) [seg_pos={0 0}, upload=62633]: Begin upload segment... Sep 9 12:39:03.575036299 (71h10m39.614609429s) [seg_pos={0 0}, upload=62633]: Done begin upload segment. Sep 9 12:39:03.575063682 (71h10m39.614636812s) [noise=true , address=45.91.116.9:4261 , piece_id=WF4VYUZGDPD4GUHX5BT3DZSROWO2MPVAFGFZIE2E2ERALA6JHFIA, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575076576 (71h10m39.614649706s) [noise=true , address=77.90.31.14:4662 , piece_id=ARN32V426TEKN2GM2ZS66PO4JBQ4Q5DWQTYVDGZCPEVTP46QNSSQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575131351 (71h10m39.614704481s) [noise=true , address=77.90.31.17:4772 , piece_id=DAHPPZUZ6N3QO5Y2EDNV4LIEUNBOC77ZCU5MPSTR6AVHH55HBFAA, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575469408 (71h10m39.615042528s) [noise=true , address=45.91.116.6:4975 , piece_id=5EFFI476IRLIQY3OHOXOFUQNEY243GW2O3B7JNW7MORNM6NSMM7A, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575492583 (71h10m39.615065703s) [noise=true , address=145.79.227.3:4149 , piece_id=TPKUKECXPPZVGYSZGKZZA2EY76NFBR3AXCX7CN43ZLD3CRU3NPKQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575758671 (71h10m39.615331791s) [noise=true , address=45.91.116.8:4045 , piece_id=FZMOZ7ZZPONGUGI253XFKFWKVMCJ5DMH6NX2URRG7FTY77VMDIEA, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575834486 (71h10m39.615407606s) [noise=true , address=45.91.116.12:4226 , piece_id=D7IJNR4YK7DKPAOVMQXLQUUW37VEC44G5636GCPBCPWG3NILPEKQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.576036233 (71h10m39.615609353s) [noise=true , address=45.91.116.10:4082 , piece_id=XDE7HUJLJOTT2TM3PCCLFGNRNL54QMMAILBYGYQ43C2PJLTKCN2Q, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.576177162 (71h10m39.615750282s) [noise=true , address=145.79.227.15:4874 , piece_id=DXSLDJ3PO3EVSAAQHDXCMD6XX2JVR4UFFGC2O67TFM6HNAW7YKIA, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.576517223 (71h10m39.616090353s) [noise=true , address=145.79.227.19:4079 , piece_id=KHEYABXNGLKUJF6LMWCZPC2W5WVKHG4MO5TENST2YYRP5PK2K7XQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.577449077 (71h10m39.617022197s) [noise=true , address=45.91.116.13:4154 , piece_id=RVLGTPGQHZ7ZRVBFXFTTISCT5BC6GUG64IFM436LWFJOI4UG3Z2A, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.577556121 (71h10m39.617129241s) [noise=true , address=77.90.31.12:4592 , piece_id=HXE45P4FBCHOP3Q343YIEWTYWD4XKRF2NCLW4K3U33MYOGPXHDLQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.577841046 (71h10m39.617414177s) [noise=true , address=45.91.116.11:4119 , piece_id=D7SMP6SA7YE7MR2MM7ALKDPKX3KRRC37766S4CN4O7GCSGS5EAUQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.578169214 (71h10m39.617742334s) [noise=true , address=45.91.116.7:4009 , piece_id=3JVZNWDLPKF7VKTOEMYCVJYET67UE22PUJ3W3T3OM55SPZIVTWOQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.578915151 (71h10m39.618488272s) [noise=true , address=77.90.31.10:4518 , piece_id=TCZGT4LQQN4BVJRLOU2BFA336AOY5WIYBFSUBGCT3HZKM4K42IIQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.579242989 (71h10m39.618816109s) [noise=true , address=77.90.31.18:4806 , piece_id=NOZDTBYPWYRMX6RBZKXBOAA4FSIWCYIMYRYTF32DEVKJD5534CGA, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:05.343785443 (71h10m41.383358563s) [upload=62633]: Next returned nil segment Sep 9 12:39:05.343803998 (71h10m41.383377118s) [upload=62633]: Waiting for error group managing segments... Sep 9 12:39:05.634702784 (71h10m41.674275905s) [noise=true , address=145.79.227.3:4149 , piece_id=TPKUKECXPPZVGYSZGKZZA2EY76NFBR3AXCX7CN43ZLD3CRU3NPKQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.753617109 (71h10m41.793190229s) [noise=true , address=45.91.116.12:4226 , piece_id=D7IJNR4YK7DKPAOVMQXLQUUW37VEC44G5636GCPBCPWG3NILPEKQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.773525196 (71h10m41.813098316s) [noise=true , address=45.91.116.7:4009 , piece_id=3JVZNWDLPKF7VKTOEMYCVJYET67UE22PUJ3W3T3OM55SPZIVTWOQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.774693902 (71h10m41.814267032s) [noise=true , address=45.91.116.11:4119 , piece_id=D7SMP6SA7YE7MR2MM7ALKDPKX3KRRC37766S4CN4O7GCSGS5EAUQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.782522974 (71h10m41.822096094s) [noise=true , address=77.90.31.10:4518 , piece_id=TCZGT4LQQN4BVJRLOU2BFA336AOY5WIYBFSUBGCT3HZKM4K42IIQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.788013982 (71h10m41.827587102s) [noise=true , address=45.91.116.10:4082 , piece_id=XDE7HUJLJOTT2TM3PCCLFGNRNL54QMMAILBYGYQ43C2PJLTKCN2Q, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.796754077 (71h10m41.836327197s) [noise=true , address=45.91.116.6:4975 , piece_id=5EFFI476IRLIQY3OHOXOFUQNEY243GW2O3B7JNW7MORNM6NSMM7A, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.798665846 (71h10m41.838238966s) [noise=true , address=145.79.227.19:4079 , piece_id=KHEYABXNGLKUJF6LMWCZPC2W5WVKHG4MO5TENST2YYRP5PK2K7XQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.800799498 (71h10m41.840372629s) [noise=true , address=77.90.31.18:4806 , piece_id=NOZDTBYPWYRMX6RBZKXBOAA4FSIWCYIMYRYTF32DEVKJD5534CGA, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.807325617 (71h10m41.846898737s) [noise=true , address=45.91.116.9:4261 , piece_id=WF4VYUZGDPD4GUHX5BT3DZSROWO2MPVAFGFZIE2E2ERALA6JHFIA, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.837434272 (71h10m41.877007392s) [noise=true , address=45.91.116.13:4154 , piece_id=RVLGTPGQHZ7ZRVBFXFTTISCT5BC6GUG64IFM436LWFJOI4UG3Z2A, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.839825218 (71h10m41.879398338s) [noise=true , address=45.91.116.8:4045 , piece_id=FZMOZ7ZZPONGUGI253XFKFWKVMCJ5DMH6NX2URRG7FTY77VMDIEA, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.844431272 (71h10m41.884004392s) [noise=true , address=77.90.31.14:4662 , piece_id=ARN32V426TEKN2GM2ZS66PO4JBQ4Q5DWQTYVDGZCPEVTP46QNSSQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.844465007 (71h10m41.884038127s) [seg_pos={0 0}, upload=62633]: Segment reached optimal threshold of 13 pieces. Sep 9 12:39:05.844600095 (71h10m41.884173225s) [noise=true , address=77.90.31.12:4592 , piece_id=HXE45P4FBCHOP3Q343YIEWTYWD4XKRF2NCLW4K3U33MYOGPXHDLQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Sep 9 12:39:05.844613632 (71h10m41.884186752s) [noise=true , address=77.90.31.17:4772 , piece_id=DAHPPZUZ6N3QO5Y2EDNV4LIEUNBOC77ZCU5MPSTR6AVHH55HBFAA, seg_pos={0 0}, upload=62633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: expected piece hash; context canceled; EOF Sep 9 12:39:05.844719895 (71h10m41.884293025s) [noise=true , address=145.79.227.15:4874 , piece_id=DXSLDJ3PO3EVSAAQHDXCMD6XX2JVR4UFFGC2O67TFM6HNAW7YKIA, seg_pos={0 0}, upload=62633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 9 12:39:05.844747638 (71h10m41.884320768s) [seg_pos={0 0}, upload=62633]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 12:39:05.844823833 (71h10m41.884396953s) [upload=62633]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 12:39:05.844830386 (71h10m41.884403506s) [upload=62633]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 12:39:06.236723527 (71h10m42.276296647s) [upload=62633]: Done uploading segments... Sep 9 12:39:06.236742012 (71h10m42.276315132s) [upload=62633]: Upload finished. err: <nil> Duration: 26.012938306s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 24.2876483s FAIL (2025-09-09 12:51:56 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 12:39:03.275681631 (71h10m39.315254751s) [upload=62633]: Starting upload Sep 9 12:39:03.275744833 (71h10m39.315317953s) [upload=62633]: Done starting upload Sep 9 12:39:03.275813914 (71h10m39.315387034s) [upload=62633]: Uploading segments... Sep 9 12:39:03.276020751 (71h10m39.315593881s) [upload=62633]: Got next segment. Inline: false Sep 9 12:39:03.276059825 (71h10m39.315632945s) [upload=62633]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 12:39:03.276064905 (71h10m39.315638025s) [upload=62633]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 12:39:03.574977477 (71h10m39.614550597s) [seg_pos={0 0}, upload=62633]: Begin upload segment... Sep 9 12:39:03.575036299 (71h10m39.614609429s) [seg_pos={0 0}, upload=62633]: Done begin upload segment. Sep 9 12:39:03.575063682 (71h10m39.614636812s) [noise=true , address=45.91.116.9:4261 , piece_id=WF4VYUZGDPD4GUHX5BT3DZSROWO2MPVAFGFZIE2E2ERALA6JHFIA, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575076576 (71h10m39.614649706s) [noise=true , address=77.90.31.14:4662 , piece_id=ARN32V426TEKN2GM2ZS66PO4JBQ4Q5DWQTYVDGZCPEVTP46QNSSQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575131351 (71h10m39.614704481s) [noise=true , address=77.90.31.17:4772 , piece_id=DAHPPZUZ6N3QO5Y2EDNV4LIEUNBOC77ZCU5MPSTR6AVHH55HBFAA, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575469408 (71h10m39.615042528s) [noise=true , address=45.91.116.6:4975 , piece_id=5EFFI476IRLIQY3OHOXOFUQNEY243GW2O3B7JNW7MORNM6NSMM7A, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575492583 (71h10m39.615065703s) [noise=true , address=145.79.227.3:4149 , piece_id=TPKUKECXPPZVGYSZGKZZA2EY76NFBR3AXCX7CN43ZLD3CRU3NPKQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575758671 (71h10m39.615331791s) [noise=true , address=45.91.116.8:4045 , piece_id=FZMOZ7ZZPONGUGI253XFKFWKVMCJ5DMH6NX2URRG7FTY77VMDIEA, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575834486 (71h10m39.615407606s) [noise=true , address=45.91.116.12:4226 , piece_id=D7IJNR4YK7DKPAOVMQXLQUUW37VEC44G5636GCPBCPWG3NILPEKQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.576036233 (71h10m39.615609353s) [noise=true , address=45.91.116.10:4082 , piece_id=XDE7HUJLJOTT2TM3PCCLFGNRNL54QMMAILBYGYQ43C2PJLTKCN2Q, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.576177162 (71h10m39.615750282s) [noise=true , address=145.79.227.15:4874 , piece_id=DXSLDJ3PO3EVSAAQHDXCMD6XX2JVR4UFFGC2O67TFM6HNAW7YKIA, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.576517223 (71h10m39.616090353s) [noise=true , address=145.79.227.19:4079 , piece_id=KHEYABXNGLKUJF6LMWCZPC2W5WVKHG4MO5TENST2YYRP5PK2K7XQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.577449077 (71h10m39.617022197s) [noise=true , address=45.91.116.13:4154 , piece_id=RVLGTPGQHZ7ZRVBFXFTTISCT5BC6GUG64IFM436LWFJOI4UG3Z2A, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.577556121 (71h10m39.617129241s) [noise=true , address=77.90.31.12:4592 , piece_id=HXE45P4FBCHOP3Q343YIEWTYWD4XKRF2NCLW4K3U33MYOGPXHDLQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.577841046 (71h10m39.617414177s) [noise=true , address=45.91.116.11:4119 , piece_id=D7SMP6SA7YE7MR2MM7ALKDPKX3KRRC37766S4CN4O7GCSGS5EAUQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.578169214 (71h10m39.617742334s) [noise=true , address=45.91.116.7:4009 , piece_id=3JVZNWDLPKF7VKTOEMYCVJYET67UE22PUJ3W3T3OM55SPZIVTWOQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.578915151 (71h10m39.618488272s) [noise=true , address=77.90.31.10:4518 , piece_id=TCZGT4LQQN4BVJRLOU2BFA336AOY5WIYBFSUBGCT3HZKM4K42IIQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.579242989 (71h10m39.618816109s) [noise=true , address=77.90.31.18:4806 , piece_id=NOZDTBYPWYRMX6RBZKXBOAA4FSIWCYIMYRYTF32DEVKJD5534CGA, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:05.343785443 (71h10m41.383358563s) [upload=62633]: Next returned nil segment Sep 9 12:39:05.343803998 (71h10m41.383377118s) [upload=62633]: Waiting for error group managing segments... Sep 9 12:39:05.634702784 (71h10m41.674275905s) [noise=true , address=145.79.227.3:4149 , piece_id=TPKUKECXPPZVGYSZGKZZA2EY76NFBR3AXCX7CN43ZLD3CRU3NPKQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.753617109 (71h10m41.793190229s) [noise=true , address=45.91.116.12:4226 , piece_id=D7IJNR4YK7DKPAOVMQXLQUUW37VEC44G5636GCPBCPWG3NILPEKQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.773525196 (71h10m41.813098316s) [noise=true , address=45.91.116.7:4009 , piece_id=3JVZNWDLPKF7VKTOEMYCVJYET67UE22PUJ3W3T3OM55SPZIVTWOQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.774693902 (71h10m41.814267032s) [noise=true , address=45.91.116.11:4119 , piece_id=D7SMP6SA7YE7MR2MM7ALKDPKX3KRRC37766S4CN4O7GCSGS5EAUQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.782522974 (71h10m41.822096094s) [noise=true , address=77.90.31.10:4518 , piece_id=TCZGT4LQQN4BVJRLOU2BFA336AOY5WIYBFSUBGCT3HZKM4K42IIQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.788013982 (71h10m41.827587102s) [noise=true , address=45.91.116.10:4082 , piece_id=XDE7HUJLJOTT2TM3PCCLFGNRNL54QMMAILBYGYQ43C2PJLTKCN2Q, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.796754077 (71h10m41.836327197s) [noise=true , address=45.91.116.6:4975 , piece_id=5EFFI476IRLIQY3OHOXOFUQNEY243GW2O3B7JNW7MORNM6NSMM7A, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.798665846 (71h10m41.838238966s) [noise=true , address=145.79.227.19:4079 , piece_id=KHEYABXNGLKUJF6LMWCZPC2W5WVKHG4MO5TENST2YYRP5PK2K7XQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.800799498 (71h10m41.840372629s) [noise=true , address=77.90.31.18:4806 , piece_id=NOZDTBYPWYRMX6RBZKXBOAA4FSIWCYIMYRYTF32DEVKJD5534CGA, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.807325617 (71h10m41.846898737s) [noise=true , address=45.91.116.9:4261 , piece_id=WF4VYUZGDPD4GUHX5BT3DZSROWO2MPVAFGFZIE2E2ERALA6JHFIA, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.837434272 (71h10m41.877007392s) [noise=true , address=45.91.116.13:4154 , piece_id=RVLGTPGQHZ7ZRVBFXFTTISCT5BC6GUG64IFM436LWFJOI4UG3Z2A, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.839825218 (71h10m41.879398338s) [noise=true , address=45.91.116.8:4045 , piece_id=FZMOZ7ZZPONGUGI253XFKFWKVMCJ5DMH6NX2URRG7FTY77VMDIEA, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.844431272 (71h10m41.884004392s) [noise=true , address=77.90.31.14:4662 , piece_id=ARN32V426TEKN2GM2ZS66PO4JBQ4Q5DWQTYVDGZCPEVTP46QNSSQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.844465007 (71h10m41.884038127s) [seg_pos={0 0}, upload=62633]: Segment reached optimal threshold of 13 pieces. Sep 9 12:39:05.844600095 (71h10m41.884173225s) [noise=true , address=77.90.31.12:4592 , piece_id=HXE45P4FBCHOP3Q343YIEWTYWD4XKRF2NCLW4K3U33MYOGPXHDLQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Sep 9 12:39:05.844613632 (71h10m41.884186752s) [noise=true , address=77.90.31.17:4772 , piece_id=DAHPPZUZ6N3QO5Y2EDNV4LIEUNBOC77ZCU5MPSTR6AVHH55HBFAA, seg_pos={0 0}, upload=62633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: expected piece hash; context canceled; EOF Sep 9 12:39:05.844719895 (71h10m41.884293025s) [noise=true , address=145.79.227.15:4874 , piece_id=DXSLDJ3PO3EVSAAQHDXCMD6XX2JVR4UFFGC2O67TFM6HNAW7YKIA, seg_pos={0 0}, upload=62633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 9 12:39:05.844747638 (71h10m41.884320768s) [seg_pos={0 0}, upload=62633]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 12:39:05.844823833 (71h10m41.884396953s) [upload=62633]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 12:39:05.844830386 (71h10m41.884403506s) [upload=62633]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 12:39:06.236723527 (71h10m42.276296647s) [upload=62633]: Done uploading segments... Sep 9 12:39:06.236742012 (71h10m42.276315132s) [upload=62633]: Upload finished. err: <nil> Duration: 24.287683849s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 27.546506027s FAIL (2025-09-09 12:51:24 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 12:39:03.275681631 (71h10m39.315254751s) [upload=62633]: Starting upload Sep 9 12:39:03.275744833 (71h10m39.315317953s) [upload=62633]: Done starting upload Sep 9 12:39:03.275813914 (71h10m39.315387034s) [upload=62633]: Uploading segments... Sep 9 12:39:03.276020751 (71h10m39.315593881s) [upload=62633]: Got next segment. Inline: false Sep 9 12:39:03.276059825 (71h10m39.315632945s) [upload=62633]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 12:39:03.276064905 (71h10m39.315638025s) [upload=62633]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 12:39:03.574977477 (71h10m39.614550597s) [seg_pos={0 0}, upload=62633]: Begin upload segment... Sep 9 12:39:03.575036299 (71h10m39.614609429s) [seg_pos={0 0}, upload=62633]: Done begin upload segment. Sep 9 12:39:03.575063682 (71h10m39.614636812s) [noise=true , address=45.91.116.9:4261 , piece_id=WF4VYUZGDPD4GUHX5BT3DZSROWO2MPVAFGFZIE2E2ERALA6JHFIA, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575076576 (71h10m39.614649706s) [noise=true , address=77.90.31.14:4662 , piece_id=ARN32V426TEKN2GM2ZS66PO4JBQ4Q5DWQTYVDGZCPEVTP46QNSSQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575131351 (71h10m39.614704481s) [noise=true , address=77.90.31.17:4772 , piece_id=DAHPPZUZ6N3QO5Y2EDNV4LIEUNBOC77ZCU5MPSTR6AVHH55HBFAA, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575469408 (71h10m39.615042528s) [noise=true , address=45.91.116.6:4975 , piece_id=5EFFI476IRLIQY3OHOXOFUQNEY243GW2O3B7JNW7MORNM6NSMM7A, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575492583 (71h10m39.615065703s) [noise=true , address=145.79.227.3:4149 , piece_id=TPKUKECXPPZVGYSZGKZZA2EY76NFBR3AXCX7CN43ZLD3CRU3NPKQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575758671 (71h10m39.615331791s) [noise=true , address=45.91.116.8:4045 , piece_id=FZMOZ7ZZPONGUGI253XFKFWKVMCJ5DMH6NX2URRG7FTY77VMDIEA, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575834486 (71h10m39.615407606s) [noise=true , address=45.91.116.12:4226 , piece_id=D7IJNR4YK7DKPAOVMQXLQUUW37VEC44G5636GCPBCPWG3NILPEKQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.576036233 (71h10m39.615609353s) [noise=true , address=45.91.116.10:4082 , piece_id=XDE7HUJLJOTT2TM3PCCLFGNRNL54QMMAILBYGYQ43C2PJLTKCN2Q, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.576177162 (71h10m39.615750282s) [noise=true , address=145.79.227.15:4874 , piece_id=DXSLDJ3PO3EVSAAQHDXCMD6XX2JVR4UFFGC2O67TFM6HNAW7YKIA, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.576517223 (71h10m39.616090353s) [noise=true , address=145.79.227.19:4079 , piece_id=KHEYABXNGLKUJF6LMWCZPC2W5WVKHG4MO5TENST2YYRP5PK2K7XQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.577449077 (71h10m39.617022197s) [noise=true , address=45.91.116.13:4154 , piece_id=RVLGTPGQHZ7ZRVBFXFTTISCT5BC6GUG64IFM436LWFJOI4UG3Z2A, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.577556121 (71h10m39.617129241s) [noise=true , address=77.90.31.12:4592 , piece_id=HXE45P4FBCHOP3Q343YIEWTYWD4XKRF2NCLW4K3U33MYOGPXHDLQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.577841046 (71h10m39.617414177s) [noise=true , address=45.91.116.11:4119 , piece_id=D7SMP6SA7YE7MR2MM7ALKDPKX3KRRC37766S4CN4O7GCSGS5EAUQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.578169214 (71h10m39.617742334s) [noise=true , address=45.91.116.7:4009 , piece_id=3JVZNWDLPKF7VKTOEMYCVJYET67UE22PUJ3W3T3OM55SPZIVTWOQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.578915151 (71h10m39.618488272s) [noise=true , address=77.90.31.10:4518 , piece_id=TCZGT4LQQN4BVJRLOU2BFA336AOY5WIYBFSUBGCT3HZKM4K42IIQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.579242989 (71h10m39.618816109s) [noise=true , address=77.90.31.18:4806 , piece_id=NOZDTBYPWYRMX6RBZKXBOAA4FSIWCYIMYRYTF32DEVKJD5534CGA, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:05.343785443 (71h10m41.383358563s) [upload=62633]: Next returned nil segment Sep 9 12:39:05.343803998 (71h10m41.383377118s) [upload=62633]: Waiting for error group managing segments... Sep 9 12:39:05.634702784 (71h10m41.674275905s) [noise=true , address=145.79.227.3:4149 , piece_id=TPKUKECXPPZVGYSZGKZZA2EY76NFBR3AXCX7CN43ZLD3CRU3NPKQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.753617109 (71h10m41.793190229s) [noise=true , address=45.91.116.12:4226 , piece_id=D7IJNR4YK7DKPAOVMQXLQUUW37VEC44G5636GCPBCPWG3NILPEKQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.773525196 (71h10m41.813098316s) [noise=true , address=45.91.116.7:4009 , piece_id=3JVZNWDLPKF7VKTOEMYCVJYET67UE22PUJ3W3T3OM55SPZIVTWOQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.774693902 (71h10m41.814267032s) [noise=true , address=45.91.116.11:4119 , piece_id=D7SMP6SA7YE7MR2MM7ALKDPKX3KRRC37766S4CN4O7GCSGS5EAUQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.782522974 (71h10m41.822096094s) [noise=true , address=77.90.31.10:4518 , piece_id=TCZGT4LQQN4BVJRLOU2BFA336AOY5WIYBFSUBGCT3HZKM4K42IIQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.788013982 (71h10m41.827587102s) [noise=true , address=45.91.116.10:4082 , piece_id=XDE7HUJLJOTT2TM3PCCLFGNRNL54QMMAILBYGYQ43C2PJLTKCN2Q, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.796754077 (71h10m41.836327197s) [noise=true , address=45.91.116.6:4975 , piece_id=5EFFI476IRLIQY3OHOXOFUQNEY243GW2O3B7JNW7MORNM6NSMM7A, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.798665846 (71h10m41.838238966s) [noise=true , address=145.79.227.19:4079 , piece_id=KHEYABXNGLKUJF6LMWCZPC2W5WVKHG4MO5TENST2YYRP5PK2K7XQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.800799498 (71h10m41.840372629s) [noise=true , address=77.90.31.18:4806 , piece_id=NOZDTBYPWYRMX6RBZKXBOAA4FSIWCYIMYRYTF32DEVKJD5534CGA, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.807325617 (71h10m41.846898737s) [noise=true , address=45.91.116.9:4261 , piece_id=WF4VYUZGDPD4GUHX5BT3DZSROWO2MPVAFGFZIE2E2ERALA6JHFIA, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.837434272 (71h10m41.877007392s) [noise=true , address=45.91.116.13:4154 , piece_id=RVLGTPGQHZ7ZRVBFXFTTISCT5BC6GUG64IFM436LWFJOI4UG3Z2A, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.839825218 (71h10m41.879398338s) [noise=true , address=45.91.116.8:4045 , piece_id=FZMOZ7ZZPONGUGI253XFKFWKVMCJ5DMH6NX2URRG7FTY77VMDIEA, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.844431272 (71h10m41.884004392s) [noise=true , address=77.90.31.14:4662 , piece_id=ARN32V426TEKN2GM2ZS66PO4JBQ4Q5DWQTYVDGZCPEVTP46QNSSQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.844465007 (71h10m41.884038127s) [seg_pos={0 0}, upload=62633]: Segment reached optimal threshold of 13 pieces. Sep 9 12:39:05.844600095 (71h10m41.884173225s) [noise=true , address=77.90.31.12:4592 , piece_id=HXE45P4FBCHOP3Q343YIEWTYWD4XKRF2NCLW4K3U33MYOGPXHDLQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Sep 9 12:39:05.844613632 (71h10m41.884186752s) [noise=true , address=77.90.31.17:4772 , piece_id=DAHPPZUZ6N3QO5Y2EDNV4LIEUNBOC77ZCU5MPSTR6AVHH55HBFAA, seg_pos={0 0}, upload=62633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: expected piece hash; context canceled; EOF Sep 9 12:39:05.844719895 (71h10m41.884293025s) [noise=true , address=145.79.227.15:4874 , piece_id=DXSLDJ3PO3EVSAAQHDXCMD6XX2JVR4UFFGC2O67TFM6HNAW7YKIA, seg_pos={0 0}, upload=62633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 9 12:39:05.844747638 (71h10m41.884320768s) [seg_pos={0 0}, upload=62633]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 12:39:05.844823833 (71h10m41.884396953s) [upload=62633]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 12:39:05.844830386 (71h10m41.884403506s) [upload=62633]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 12:39:06.236723527 (71h10m42.276296647s) [upload=62633]: Done uploading segments... Sep 9 12:39:06.236742012 (71h10m42.276315132s) [upload=62633]: Upload finished. err: <nil> Duration: 27.546532257s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 21.570134767s FAIL (2025-09-09 12:50:05 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 12:39:03.275681631 (71h10m39.315254751s) [upload=62633]: Starting upload Sep 9 12:39:03.275744833 (71h10m39.315317953s) [upload=62633]: Done starting upload Sep 9 12:39:03.275813914 (71h10m39.315387034s) [upload=62633]: Uploading segments... Sep 9 12:39:03.276020751 (71h10m39.315593881s) [upload=62633]: Got next segment. Inline: false Sep 9 12:39:03.276059825 (71h10m39.315632945s) [upload=62633]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 12:39:03.276064905 (71h10m39.315638025s) [upload=62633]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 12:39:03.574977477 (71h10m39.614550597s) [seg_pos={0 0}, upload=62633]: Begin upload segment... Sep 9 12:39:03.575036299 (71h10m39.614609429s) [seg_pos={0 0}, upload=62633]: Done begin upload segment. Sep 9 12:39:03.575063682 (71h10m39.614636812s) [noise=true , address=45.91.116.9:4261 , piece_id=WF4VYUZGDPD4GUHX5BT3DZSROWO2MPVAFGFZIE2E2ERALA6JHFIA, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575076576 (71h10m39.614649706s) [noise=true , address=77.90.31.14:4662 , piece_id=ARN32V426TEKN2GM2ZS66PO4JBQ4Q5DWQTYVDGZCPEVTP46QNSSQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575131351 (71h10m39.614704481s) [noise=true , address=77.90.31.17:4772 , piece_id=DAHPPZUZ6N3QO5Y2EDNV4LIEUNBOC77ZCU5MPSTR6AVHH55HBFAA, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575469408 (71h10m39.615042528s) [noise=true , address=45.91.116.6:4975 , piece_id=5EFFI476IRLIQY3OHOXOFUQNEY243GW2O3B7JNW7MORNM6NSMM7A, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575492583 (71h10m39.615065703s) [noise=true , address=145.79.227.3:4149 , piece_id=TPKUKECXPPZVGYSZGKZZA2EY76NFBR3AXCX7CN43ZLD3CRU3NPKQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575758671 (71h10m39.615331791s) [noise=true , address=45.91.116.8:4045 , piece_id=FZMOZ7ZZPONGUGI253XFKFWKVMCJ5DMH6NX2URRG7FTY77VMDIEA, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575834486 (71h10m39.615407606s) [noise=true , address=45.91.116.12:4226 , piece_id=D7IJNR4YK7DKPAOVMQXLQUUW37VEC44G5636GCPBCPWG3NILPEKQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.576036233 (71h10m39.615609353s) [noise=true , address=45.91.116.10:4082 , piece_id=XDE7HUJLJOTT2TM3PCCLFGNRNL54QMMAILBYGYQ43C2PJLTKCN2Q, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.576177162 (71h10m39.615750282s) [noise=true , address=145.79.227.15:4874 , piece_id=DXSLDJ3PO3EVSAAQHDXCMD6XX2JVR4UFFGC2O67TFM6HNAW7YKIA, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.576517223 (71h10m39.616090353s) [noise=true , address=145.79.227.19:4079 , piece_id=KHEYABXNGLKUJF6LMWCZPC2W5WVKHG4MO5TENST2YYRP5PK2K7XQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.577449077 (71h10m39.617022197s) [noise=true , address=45.91.116.13:4154 , piece_id=RVLGTPGQHZ7ZRVBFXFTTISCT5BC6GUG64IFM436LWFJOI4UG3Z2A, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.577556121 (71h10m39.617129241s) [noise=true , address=77.90.31.12:4592 , piece_id=HXE45P4FBCHOP3Q343YIEWTYWD4XKRF2NCLW4K3U33MYOGPXHDLQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.577841046 (71h10m39.617414177s) [noise=true , address=45.91.116.11:4119 , piece_id=D7SMP6SA7YE7MR2MM7ALKDPKX3KRRC37766S4CN4O7GCSGS5EAUQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.578169214 (71h10m39.617742334s) [noise=true , address=45.91.116.7:4009 , piece_id=3JVZNWDLPKF7VKTOEMYCVJYET67UE22PUJ3W3T3OM55SPZIVTWOQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.578915151 (71h10m39.618488272s) [noise=true , address=77.90.31.10:4518 , piece_id=TCZGT4LQQN4BVJRLOU2BFA336AOY5WIYBFSUBGCT3HZKM4K42IIQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.579242989 (71h10m39.618816109s) [noise=true , address=77.90.31.18:4806 , piece_id=NOZDTBYPWYRMX6RBZKXBOAA4FSIWCYIMYRYTF32DEVKJD5534CGA, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:05.343785443 (71h10m41.383358563s) [upload=62633]: Next returned nil segment Sep 9 12:39:05.343803998 (71h10m41.383377118s) [upload=62633]: Waiting for error group managing segments... Sep 9 12:39:05.634702784 (71h10m41.674275905s) [noise=true , address=145.79.227.3:4149 , piece_id=TPKUKECXPPZVGYSZGKZZA2EY76NFBR3AXCX7CN43ZLD3CRU3NPKQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.753617109 (71h10m41.793190229s) [noise=true , address=45.91.116.12:4226 , piece_id=D7IJNR4YK7DKPAOVMQXLQUUW37VEC44G5636GCPBCPWG3NILPEKQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.773525196 (71h10m41.813098316s) [noise=true , address=45.91.116.7:4009 , piece_id=3JVZNWDLPKF7VKTOEMYCVJYET67UE22PUJ3W3T3OM55SPZIVTWOQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.774693902 (71h10m41.814267032s) [noise=true , address=45.91.116.11:4119 , piece_id=D7SMP6SA7YE7MR2MM7ALKDPKX3KRRC37766S4CN4O7GCSGS5EAUQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.782522974 (71h10m41.822096094s) [noise=true , address=77.90.31.10:4518 , piece_id=TCZGT4LQQN4BVJRLOU2BFA336AOY5WIYBFSUBGCT3HZKM4K42IIQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.788013982 (71h10m41.827587102s) [noise=true , address=45.91.116.10:4082 , piece_id=XDE7HUJLJOTT2TM3PCCLFGNRNL54QMMAILBYGYQ43C2PJLTKCN2Q, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.796754077 (71h10m41.836327197s) [noise=true , address=45.91.116.6:4975 , piece_id=5EFFI476IRLIQY3OHOXOFUQNEY243GW2O3B7JNW7MORNM6NSMM7A, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.798665846 (71h10m41.838238966s) [noise=true , address=145.79.227.19:4079 , piece_id=KHEYABXNGLKUJF6LMWCZPC2W5WVKHG4MO5TENST2YYRP5PK2K7XQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.800799498 (71h10m41.840372629s) [noise=true , address=77.90.31.18:4806 , piece_id=NOZDTBYPWYRMX6RBZKXBOAA4FSIWCYIMYRYTF32DEVKJD5534CGA, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.807325617 (71h10m41.846898737s) [noise=true , address=45.91.116.9:4261 , piece_id=WF4VYUZGDPD4GUHX5BT3DZSROWO2MPVAFGFZIE2E2ERALA6JHFIA, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.837434272 (71h10m41.877007392s) [noise=true , address=45.91.116.13:4154 , piece_id=RVLGTPGQHZ7ZRVBFXFTTISCT5BC6GUG64IFM436LWFJOI4UG3Z2A, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.839825218 (71h10m41.879398338s) [noise=true , address=45.91.116.8:4045 , piece_id=FZMOZ7ZZPONGUGI253XFKFWKVMCJ5DMH6NX2URRG7FTY77VMDIEA, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.844431272 (71h10m41.884004392s) [noise=true , address=77.90.31.14:4662 , piece_id=ARN32V426TEKN2GM2ZS66PO4JBQ4Q5DWQTYVDGZCPEVTP46QNSSQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.844465007 (71h10m41.884038127s) [seg_pos={0 0}, upload=62633]: Segment reached optimal threshold of 13 pieces. Sep 9 12:39:05.844600095 (71h10m41.884173225s) [noise=true , address=77.90.31.12:4592 , piece_id=HXE45P4FBCHOP3Q343YIEWTYWD4XKRF2NCLW4K3U33MYOGPXHDLQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Sep 9 12:39:05.844613632 (71h10m41.884186752s) [noise=true , address=77.90.31.17:4772 , piece_id=DAHPPZUZ6N3QO5Y2EDNV4LIEUNBOC77ZCU5MPSTR6AVHH55HBFAA, seg_pos={0 0}, upload=62633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: expected piece hash; context canceled; EOF Sep 9 12:39:05.844719895 (71h10m41.884293025s) [noise=true , address=145.79.227.15:4874 , piece_id=DXSLDJ3PO3EVSAAQHDXCMD6XX2JVR4UFFGC2O67TFM6HNAW7YKIA, seg_pos={0 0}, upload=62633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 9 12:39:05.844747638 (71h10m41.884320768s) [seg_pos={0 0}, upload=62633]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 12:39:05.844823833 (71h10m41.884396953s) [upload=62633]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 12:39:05.844830386 (71h10m41.884403506s) [upload=62633]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 12:39:06.236723527 (71h10m42.276296647s) [upload=62633]: Done uploading segments... Sep 9 12:39:06.236742012 (71h10m42.276315132s) [upload=62633]: Upload finished. err: <nil> Duration: 21.570166256s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 21.463870265s FAIL (2025-09-09 12:48:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 12:39:03.275681631 (71h10m39.315254751s) [upload=62633]: Starting upload Sep 9 12:39:03.275744833 (71h10m39.315317953s) [upload=62633]: Done starting upload Sep 9 12:39:03.275813914 (71h10m39.315387034s) [upload=62633]: Uploading segments... Sep 9 12:39:03.276020751 (71h10m39.315593881s) [upload=62633]: Got next segment. Inline: false Sep 9 12:39:03.276059825 (71h10m39.315632945s) [upload=62633]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 12:39:03.276064905 (71h10m39.315638025s) [upload=62633]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 12:39:03.574977477 (71h10m39.614550597s) [seg_pos={0 0}, upload=62633]: Begin upload segment... Sep 9 12:39:03.575036299 (71h10m39.614609429s) [seg_pos={0 0}, upload=62633]: Done begin upload segment. Sep 9 12:39:03.575063682 (71h10m39.614636812s) [noise=true , address=45.91.116.9:4261 , piece_id=WF4VYUZGDPD4GUHX5BT3DZSROWO2MPVAFGFZIE2E2ERALA6JHFIA, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575076576 (71h10m39.614649706s) [noise=true , address=77.90.31.14:4662 , piece_id=ARN32V426TEKN2GM2ZS66PO4JBQ4Q5DWQTYVDGZCPEVTP46QNSSQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575131351 (71h10m39.614704481s) [noise=true , address=77.90.31.17:4772 , piece_id=DAHPPZUZ6N3QO5Y2EDNV4LIEUNBOC77ZCU5MPSTR6AVHH55HBFAA, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575469408 (71h10m39.615042528s) [noise=true , address=45.91.116.6:4975 , piece_id=5EFFI476IRLIQY3OHOXOFUQNEY243GW2O3B7JNW7MORNM6NSMM7A, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575492583 (71h10m39.615065703s) [noise=true , address=145.79.227.3:4149 , piece_id=TPKUKECXPPZVGYSZGKZZA2EY76NFBR3AXCX7CN43ZLD3CRU3NPKQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575758671 (71h10m39.615331791s) [noise=true , address=45.91.116.8:4045 , piece_id=FZMOZ7ZZPONGUGI253XFKFWKVMCJ5DMH6NX2URRG7FTY77VMDIEA, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575834486 (71h10m39.615407606s) [noise=true , address=45.91.116.12:4226 , piece_id=D7IJNR4YK7DKPAOVMQXLQUUW37VEC44G5636GCPBCPWG3NILPEKQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.576036233 (71h10m39.615609353s) [noise=true , address=45.91.116.10:4082 , piece_id=XDE7HUJLJOTT2TM3PCCLFGNRNL54QMMAILBYGYQ43C2PJLTKCN2Q, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.576177162 (71h10m39.615750282s) [noise=true , address=145.79.227.15:4874 , piece_id=DXSLDJ3PO3EVSAAQHDXCMD6XX2JVR4UFFGC2O67TFM6HNAW7YKIA, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.576517223 (71h10m39.616090353s) [noise=true , address=145.79.227.19:4079 , piece_id=KHEYABXNGLKUJF6LMWCZPC2W5WVKHG4MO5TENST2YYRP5PK2K7XQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.577449077 (71h10m39.617022197s) [noise=true , address=45.91.116.13:4154 , piece_id=RVLGTPGQHZ7ZRVBFXFTTISCT5BC6GUG64IFM436LWFJOI4UG3Z2A, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.577556121 (71h10m39.617129241s) [noise=true , address=77.90.31.12:4592 , piece_id=HXE45P4FBCHOP3Q343YIEWTYWD4XKRF2NCLW4K3U33MYOGPXHDLQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.577841046 (71h10m39.617414177s) [noise=true , address=45.91.116.11:4119 , piece_id=D7SMP6SA7YE7MR2MM7ALKDPKX3KRRC37766S4CN4O7GCSGS5EAUQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.578169214 (71h10m39.617742334s) [noise=true , address=45.91.116.7:4009 , piece_id=3JVZNWDLPKF7VKTOEMYCVJYET67UE22PUJ3W3T3OM55SPZIVTWOQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.578915151 (71h10m39.618488272s) [noise=true , address=77.90.31.10:4518 , piece_id=TCZGT4LQQN4BVJRLOU2BFA336AOY5WIYBFSUBGCT3HZKM4K42IIQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.579242989 (71h10m39.618816109s) [noise=true , address=77.90.31.18:4806 , piece_id=NOZDTBYPWYRMX6RBZKXBOAA4FSIWCYIMYRYTF32DEVKJD5534CGA, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:05.343785443 (71h10m41.383358563s) [upload=62633]: Next returned nil segment Sep 9 12:39:05.343803998 (71h10m41.383377118s) [upload=62633]: Waiting for error group managing segments... Sep 9 12:39:05.634702784 (71h10m41.674275905s) [noise=true , address=145.79.227.3:4149 , piece_id=TPKUKECXPPZVGYSZGKZZA2EY76NFBR3AXCX7CN43ZLD3CRU3NPKQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.753617109 (71h10m41.793190229s) [noise=true , address=45.91.116.12:4226 , piece_id=D7IJNR4YK7DKPAOVMQXLQUUW37VEC44G5636GCPBCPWG3NILPEKQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.773525196 (71h10m41.813098316s) [noise=true , address=45.91.116.7:4009 , piece_id=3JVZNWDLPKF7VKTOEMYCVJYET67UE22PUJ3W3T3OM55SPZIVTWOQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.774693902 (71h10m41.814267032s) [noise=true , address=45.91.116.11:4119 , piece_id=D7SMP6SA7YE7MR2MM7ALKDPKX3KRRC37766S4CN4O7GCSGS5EAUQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.782522974 (71h10m41.822096094s) [noise=true , address=77.90.31.10:4518 , piece_id=TCZGT4LQQN4BVJRLOU2BFA336AOY5WIYBFSUBGCT3HZKM4K42IIQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.788013982 (71h10m41.827587102s) [noise=true , address=45.91.116.10:4082 , piece_id=XDE7HUJLJOTT2TM3PCCLFGNRNL54QMMAILBYGYQ43C2PJLTKCN2Q, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.796754077 (71h10m41.836327197s) [noise=true , address=45.91.116.6:4975 , piece_id=5EFFI476IRLIQY3OHOXOFUQNEY243GW2O3B7JNW7MORNM6NSMM7A, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.798665846 (71h10m41.838238966s) [noise=true , address=145.79.227.19:4079 , piece_id=KHEYABXNGLKUJF6LMWCZPC2W5WVKHG4MO5TENST2YYRP5PK2K7XQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.800799498 (71h10m41.840372629s) [noise=true , address=77.90.31.18:4806 , piece_id=NOZDTBYPWYRMX6RBZKXBOAA4FSIWCYIMYRYTF32DEVKJD5534CGA, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.807325617 (71h10m41.846898737s) [noise=true , address=45.91.116.9:4261 , piece_id=WF4VYUZGDPD4GUHX5BT3DZSROWO2MPVAFGFZIE2E2ERALA6JHFIA, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.837434272 (71h10m41.877007392s) [noise=true , address=45.91.116.13:4154 , piece_id=RVLGTPGQHZ7ZRVBFXFTTISCT5BC6GUG64IFM436LWFJOI4UG3Z2A, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.839825218 (71h10m41.879398338s) [noise=true , address=45.91.116.8:4045 , piece_id=FZMOZ7ZZPONGUGI253XFKFWKVMCJ5DMH6NX2URRG7FTY77VMDIEA, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.844431272 (71h10m41.884004392s) [noise=true , address=77.90.31.14:4662 , piece_id=ARN32V426TEKN2GM2ZS66PO4JBQ4Q5DWQTYVDGZCPEVTP46QNSSQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.844465007 (71h10m41.884038127s) [seg_pos={0 0}, upload=62633]: Segment reached optimal threshold of 13 pieces. Sep 9 12:39:05.844600095 (71h10m41.884173225s) [noise=true , address=77.90.31.12:4592 , piece_id=HXE45P4FBCHOP3Q343YIEWTYWD4XKRF2NCLW4K3U33MYOGPXHDLQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Sep 9 12:39:05.844613632 (71h10m41.884186752s) [noise=true , address=77.90.31.17:4772 , piece_id=DAHPPZUZ6N3QO5Y2EDNV4LIEUNBOC77ZCU5MPSTR6AVHH55HBFAA, seg_pos={0 0}, upload=62633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: expected piece hash; context canceled; EOF Sep 9 12:39:05.844719895 (71h10m41.884293025s) [noise=true , address=145.79.227.15:4874 , piece_id=DXSLDJ3PO3EVSAAQHDXCMD6XX2JVR4UFFGC2O67TFM6HNAW7YKIA, seg_pos={0 0}, upload=62633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 9 12:39:05.844747638 (71h10m41.884320768s) [seg_pos={0 0}, upload=62633]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 12:39:05.844823833 (71h10m41.884396953s) [upload=62633]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 12:39:05.844830386 (71h10m41.884403506s) [upload=62633]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 12:39:06.236723527 (71h10m42.276296647s) [upload=62633]: Done uploading segments... Sep 9 12:39:06.236742012 (71h10m42.276315132s) [upload=62633]: Upload finished. err: <nil> Duration: 21.463950067s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 24.807621935s FAIL (2025-09-09 12:47:55 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 12:39:03.275681631 (71h10m39.315254751s) [upload=62633]: Starting upload Sep 9 12:39:03.275744833 (71h10m39.315317953s) [upload=62633]: Done starting upload Sep 9 12:39:03.275813914 (71h10m39.315387034s) [upload=62633]: Uploading segments... Sep 9 12:39:03.276020751 (71h10m39.315593881s) [upload=62633]: Got next segment. Inline: false Sep 9 12:39:03.276059825 (71h10m39.315632945s) [upload=62633]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 12:39:03.276064905 (71h10m39.315638025s) [upload=62633]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 12:39:03.574977477 (71h10m39.614550597s) [seg_pos={0 0}, upload=62633]: Begin upload segment... Sep 9 12:39:03.575036299 (71h10m39.614609429s) [seg_pos={0 0}, upload=62633]: Done begin upload segment. Sep 9 12:39:03.575063682 (71h10m39.614636812s) [noise=true , address=45.91.116.9:4261 , piece_id=WF4VYUZGDPD4GUHX5BT3DZSROWO2MPVAFGFZIE2E2ERALA6JHFIA, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575076576 (71h10m39.614649706s) [noise=true , address=77.90.31.14:4662 , piece_id=ARN32V426TEKN2GM2ZS66PO4JBQ4Q5DWQTYVDGZCPEVTP46QNSSQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575131351 (71h10m39.614704481s) [noise=true , address=77.90.31.17:4772 , piece_id=DAHPPZUZ6N3QO5Y2EDNV4LIEUNBOC77ZCU5MPSTR6AVHH55HBFAA, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575469408 (71h10m39.615042528s) [noise=true , address=45.91.116.6:4975 , piece_id=5EFFI476IRLIQY3OHOXOFUQNEY243GW2O3B7JNW7MORNM6NSMM7A, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575492583 (71h10m39.615065703s) [noise=true , address=145.79.227.3:4149 , piece_id=TPKUKECXPPZVGYSZGKZZA2EY76NFBR3AXCX7CN43ZLD3CRU3NPKQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575758671 (71h10m39.615331791s) [noise=true , address=45.91.116.8:4045 , piece_id=FZMOZ7ZZPONGUGI253XFKFWKVMCJ5DMH6NX2URRG7FTY77VMDIEA, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575834486 (71h10m39.615407606s) [noise=true , address=45.91.116.12:4226 , piece_id=D7IJNR4YK7DKPAOVMQXLQUUW37VEC44G5636GCPBCPWG3NILPEKQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.576036233 (71h10m39.615609353s) [noise=true , address=45.91.116.10:4082 , piece_id=XDE7HUJLJOTT2TM3PCCLFGNRNL54QMMAILBYGYQ43C2PJLTKCN2Q, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.576177162 (71h10m39.615750282s) [noise=true , address=145.79.227.15:4874 , piece_id=DXSLDJ3PO3EVSAAQHDXCMD6XX2JVR4UFFGC2O67TFM6HNAW7YKIA, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.576517223 (71h10m39.616090353s) [noise=true , address=145.79.227.19:4079 , piece_id=KHEYABXNGLKUJF6LMWCZPC2W5WVKHG4MO5TENST2YYRP5PK2K7XQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.577449077 (71h10m39.617022197s) [noise=true , address=45.91.116.13:4154 , piece_id=RVLGTPGQHZ7ZRVBFXFTTISCT5BC6GUG64IFM436LWFJOI4UG3Z2A, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.577556121 (71h10m39.617129241s) [noise=true , address=77.90.31.12:4592 , piece_id=HXE45P4FBCHOP3Q343YIEWTYWD4XKRF2NCLW4K3U33MYOGPXHDLQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.577841046 (71h10m39.617414177s) [noise=true , address=45.91.116.11:4119 , piece_id=D7SMP6SA7YE7MR2MM7ALKDPKX3KRRC37766S4CN4O7GCSGS5EAUQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.578169214 (71h10m39.617742334s) [noise=true , address=45.91.116.7:4009 , piece_id=3JVZNWDLPKF7VKTOEMYCVJYET67UE22PUJ3W3T3OM55SPZIVTWOQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.578915151 (71h10m39.618488272s) [noise=true , address=77.90.31.10:4518 , piece_id=TCZGT4LQQN4BVJRLOU2BFA336AOY5WIYBFSUBGCT3HZKM4K42IIQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.579242989 (71h10m39.618816109s) [noise=true , address=77.90.31.18:4806 , piece_id=NOZDTBYPWYRMX6RBZKXBOAA4FSIWCYIMYRYTF32DEVKJD5534CGA, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:05.343785443 (71h10m41.383358563s) [upload=62633]: Next returned nil segment Sep 9 12:39:05.343803998 (71h10m41.383377118s) [upload=62633]: Waiting for error group managing segments... Sep 9 12:39:05.634702784 (71h10m41.674275905s) [noise=true , address=145.79.227.3:4149 , piece_id=TPKUKECXPPZVGYSZGKZZA2EY76NFBR3AXCX7CN43ZLD3CRU3NPKQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.753617109 (71h10m41.793190229s) [noise=true , address=45.91.116.12:4226 , piece_id=D7IJNR4YK7DKPAOVMQXLQUUW37VEC44G5636GCPBCPWG3NILPEKQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.773525196 (71h10m41.813098316s) [noise=true , address=45.91.116.7:4009 , piece_id=3JVZNWDLPKF7VKTOEMYCVJYET67UE22PUJ3W3T3OM55SPZIVTWOQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.774693902 (71h10m41.814267032s) [noise=true , address=45.91.116.11:4119 , piece_id=D7SMP6SA7YE7MR2MM7ALKDPKX3KRRC37766S4CN4O7GCSGS5EAUQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.782522974 (71h10m41.822096094s) [noise=true , address=77.90.31.10:4518 , piece_id=TCZGT4LQQN4BVJRLOU2BFA336AOY5WIYBFSUBGCT3HZKM4K42IIQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.788013982 (71h10m41.827587102s) [noise=true , address=45.91.116.10:4082 , piece_id=XDE7HUJLJOTT2TM3PCCLFGNRNL54QMMAILBYGYQ43C2PJLTKCN2Q, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.796754077 (71h10m41.836327197s) [noise=true , address=45.91.116.6:4975 , piece_id=5EFFI476IRLIQY3OHOXOFUQNEY243GW2O3B7JNW7MORNM6NSMM7A, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.798665846 (71h10m41.838238966s) [noise=true , address=145.79.227.19:4079 , piece_id=KHEYABXNGLKUJF6LMWCZPC2W5WVKHG4MO5TENST2YYRP5PK2K7XQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.800799498 (71h10m41.840372629s) [noise=true , address=77.90.31.18:4806 , piece_id=NOZDTBYPWYRMX6RBZKXBOAA4FSIWCYIMYRYTF32DEVKJD5534CGA, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.807325617 (71h10m41.846898737s) [noise=true , address=45.91.116.9:4261 , piece_id=WF4VYUZGDPD4GUHX5BT3DZSROWO2MPVAFGFZIE2E2ERALA6JHFIA, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.837434272 (71h10m41.877007392s) [noise=true , address=45.91.116.13:4154 , piece_id=RVLGTPGQHZ7ZRVBFXFTTISCT5BC6GUG64IFM436LWFJOI4UG3Z2A, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.839825218 (71h10m41.879398338s) [noise=true , address=45.91.116.8:4045 , piece_id=FZMOZ7ZZPONGUGI253XFKFWKVMCJ5DMH6NX2URRG7FTY77VMDIEA, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.844431272 (71h10m41.884004392s) [noise=true , address=77.90.31.14:4662 , piece_id=ARN32V426TEKN2GM2ZS66PO4JBQ4Q5DWQTYVDGZCPEVTP46QNSSQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.844465007 (71h10m41.884038127s) [seg_pos={0 0}, upload=62633]: Segment reached optimal threshold of 13 pieces. Sep 9 12:39:05.844600095 (71h10m41.884173225s) [noise=true , address=77.90.31.12:4592 , piece_id=HXE45P4FBCHOP3Q343YIEWTYWD4XKRF2NCLW4K3U33MYOGPXHDLQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Sep 9 12:39:05.844613632 (71h10m41.884186752s) [noise=true , address=77.90.31.17:4772 , piece_id=DAHPPZUZ6N3QO5Y2EDNV4LIEUNBOC77ZCU5MPSTR6AVHH55HBFAA, seg_pos={0 0}, upload=62633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: expected piece hash; context canceled; EOF Sep 9 12:39:05.844719895 (71h10m41.884293025s) [noise=true , address=145.79.227.15:4874 , piece_id=DXSLDJ3PO3EVSAAQHDXCMD6XX2JVR4UFFGC2O67TFM6HNAW7YKIA, seg_pos={0 0}, upload=62633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 9 12:39:05.844747638 (71h10m41.884320768s) [seg_pos={0 0}, upload=62633]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 12:39:05.844823833 (71h10m41.884396953s) [upload=62633]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 12:39:05.844830386 (71h10m41.884403506s) [upload=62633]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 12:39:06.236723527 (71h10m42.276296647s) [upload=62633]: Done uploading segments... Sep 9 12:39:06.236742012 (71h10m42.276315132s) [upload=62633]: Upload finished. err: <nil> Duration: 24.807649627s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 21.261516735s FAIL (2025-09-09 12:47:03 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 12:39:03.275681631 (71h10m39.315254751s) [upload=62633]: Starting upload Sep 9 12:39:03.275744833 (71h10m39.315317953s) [upload=62633]: Done starting upload Sep 9 12:39:03.275813914 (71h10m39.315387034s) [upload=62633]: Uploading segments... Sep 9 12:39:03.276020751 (71h10m39.315593881s) [upload=62633]: Got next segment. Inline: false Sep 9 12:39:03.276059825 (71h10m39.315632945s) [upload=62633]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 12:39:03.276064905 (71h10m39.315638025s) [upload=62633]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 12:39:03.574977477 (71h10m39.614550597s) [seg_pos={0 0}, upload=62633]: Begin upload segment... Sep 9 12:39:03.575036299 (71h10m39.614609429s) [seg_pos={0 0}, upload=62633]: Done begin upload segment. Sep 9 12:39:03.575063682 (71h10m39.614636812s) [noise=true , address=45.91.116.9:4261 , piece_id=WF4VYUZGDPD4GUHX5BT3DZSROWO2MPVAFGFZIE2E2ERALA6JHFIA, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575076576 (71h10m39.614649706s) [noise=true , address=77.90.31.14:4662 , piece_id=ARN32V426TEKN2GM2ZS66PO4JBQ4Q5DWQTYVDGZCPEVTP46QNSSQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575131351 (71h10m39.614704481s) [noise=true , address=77.90.31.17:4772 , piece_id=DAHPPZUZ6N3QO5Y2EDNV4LIEUNBOC77ZCU5MPSTR6AVHH55HBFAA, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575469408 (71h10m39.615042528s) [noise=true , address=45.91.116.6:4975 , piece_id=5EFFI476IRLIQY3OHOXOFUQNEY243GW2O3B7JNW7MORNM6NSMM7A, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575492583 (71h10m39.615065703s) [noise=true , address=145.79.227.3:4149 , piece_id=TPKUKECXPPZVGYSZGKZZA2EY76NFBR3AXCX7CN43ZLD3CRU3NPKQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575758671 (71h10m39.615331791s) [noise=true , address=45.91.116.8:4045 , piece_id=FZMOZ7ZZPONGUGI253XFKFWKVMCJ5DMH6NX2URRG7FTY77VMDIEA, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575834486 (71h10m39.615407606s) [noise=true , address=45.91.116.12:4226 , piece_id=D7IJNR4YK7DKPAOVMQXLQUUW37VEC44G5636GCPBCPWG3NILPEKQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.576036233 (71h10m39.615609353s) [noise=true , address=45.91.116.10:4082 , piece_id=XDE7HUJLJOTT2TM3PCCLFGNRNL54QMMAILBYGYQ43C2PJLTKCN2Q, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.576177162 (71h10m39.615750282s) [noise=true , address=145.79.227.15:4874 , piece_id=DXSLDJ3PO3EVSAAQHDXCMD6XX2JVR4UFFGC2O67TFM6HNAW7YKIA, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.576517223 (71h10m39.616090353s) [noise=true , address=145.79.227.19:4079 , piece_id=KHEYABXNGLKUJF6LMWCZPC2W5WVKHG4MO5TENST2YYRP5PK2K7XQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.577449077 (71h10m39.617022197s) [noise=true , address=45.91.116.13:4154 , piece_id=RVLGTPGQHZ7ZRVBFXFTTISCT5BC6GUG64IFM436LWFJOI4UG3Z2A, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.577556121 (71h10m39.617129241s) [noise=true , address=77.90.31.12:4592 , piece_id=HXE45P4FBCHOP3Q343YIEWTYWD4XKRF2NCLW4K3U33MYOGPXHDLQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.577841046 (71h10m39.617414177s) [noise=true , address=45.91.116.11:4119 , piece_id=D7SMP6SA7YE7MR2MM7ALKDPKX3KRRC37766S4CN4O7GCSGS5EAUQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.578169214 (71h10m39.617742334s) [noise=true , address=45.91.116.7:4009 , piece_id=3JVZNWDLPKF7VKTOEMYCVJYET67UE22PUJ3W3T3OM55SPZIVTWOQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.578915151 (71h10m39.618488272s) [noise=true , address=77.90.31.10:4518 , piece_id=TCZGT4LQQN4BVJRLOU2BFA336AOY5WIYBFSUBGCT3HZKM4K42IIQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.579242989 (71h10m39.618816109s) [noise=true , address=77.90.31.18:4806 , piece_id=NOZDTBYPWYRMX6RBZKXBOAA4FSIWCYIMYRYTF32DEVKJD5534CGA, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:05.343785443 (71h10m41.383358563s) [upload=62633]: Next returned nil segment Sep 9 12:39:05.343803998 (71h10m41.383377118s) [upload=62633]: Waiting for error group managing segments... Sep 9 12:39:05.634702784 (71h10m41.674275905s) [noise=true , address=145.79.227.3:4149 , piece_id=TPKUKECXPPZVGYSZGKZZA2EY76NFBR3AXCX7CN43ZLD3CRU3NPKQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.753617109 (71h10m41.793190229s) [noise=true , address=45.91.116.12:4226 , piece_id=D7IJNR4YK7DKPAOVMQXLQUUW37VEC44G5636GCPBCPWG3NILPEKQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.773525196 (71h10m41.813098316s) [noise=true , address=45.91.116.7:4009 , piece_id=3JVZNWDLPKF7VKTOEMYCVJYET67UE22PUJ3W3T3OM55SPZIVTWOQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.774693902 (71h10m41.814267032s) [noise=true , address=45.91.116.11:4119 , piece_id=D7SMP6SA7YE7MR2MM7ALKDPKX3KRRC37766S4CN4O7GCSGS5EAUQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.782522974 (71h10m41.822096094s) [noise=true , address=77.90.31.10:4518 , piece_id=TCZGT4LQQN4BVJRLOU2BFA336AOY5WIYBFSUBGCT3HZKM4K42IIQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.788013982 (71h10m41.827587102s) [noise=true , address=45.91.116.10:4082 , piece_id=XDE7HUJLJOTT2TM3PCCLFGNRNL54QMMAILBYGYQ43C2PJLTKCN2Q, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.796754077 (71h10m41.836327197s) [noise=true , address=45.91.116.6:4975 , piece_id=5EFFI476IRLIQY3OHOXOFUQNEY243GW2O3B7JNW7MORNM6NSMM7A, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.798665846 (71h10m41.838238966s) [noise=true , address=145.79.227.19:4079 , piece_id=KHEYABXNGLKUJF6LMWCZPC2W5WVKHG4MO5TENST2YYRP5PK2K7XQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.800799498 (71h10m41.840372629s) [noise=true , address=77.90.31.18:4806 , piece_id=NOZDTBYPWYRMX6RBZKXBOAA4FSIWCYIMYRYTF32DEVKJD5534CGA, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.807325617 (71h10m41.846898737s) [noise=true , address=45.91.116.9:4261 , piece_id=WF4VYUZGDPD4GUHX5BT3DZSROWO2MPVAFGFZIE2E2ERALA6JHFIA, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.837434272 (71h10m41.877007392s) [noise=true , address=45.91.116.13:4154 , piece_id=RVLGTPGQHZ7ZRVBFXFTTISCT5BC6GUG64IFM436LWFJOI4UG3Z2A, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.839825218 (71h10m41.879398338s) [noise=true , address=45.91.116.8:4045 , piece_id=FZMOZ7ZZPONGUGI253XFKFWKVMCJ5DMH6NX2URRG7FTY77VMDIEA, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.844431272 (71h10m41.884004392s) [noise=true , address=77.90.31.14:4662 , piece_id=ARN32V426TEKN2GM2ZS66PO4JBQ4Q5DWQTYVDGZCPEVTP46QNSSQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.844465007 (71h10m41.884038127s) [seg_pos={0 0}, upload=62633]: Segment reached optimal threshold of 13 pieces. Sep 9 12:39:05.844600095 (71h10m41.884173225s) [noise=true , address=77.90.31.12:4592 , piece_id=HXE45P4FBCHOP3Q343YIEWTYWD4XKRF2NCLW4K3U33MYOGPXHDLQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Sep 9 12:39:05.844613632 (71h10m41.884186752s) [noise=true , address=77.90.31.17:4772 , piece_id=DAHPPZUZ6N3QO5Y2EDNV4LIEUNBOC77ZCU5MPSTR6AVHH55HBFAA, seg_pos={0 0}, upload=62633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: expected piece hash; context canceled; EOF Sep 9 12:39:05.844719895 (71h10m41.884293025s) [noise=true , address=145.79.227.15:4874 , piece_id=DXSLDJ3PO3EVSAAQHDXCMD6XX2JVR4UFFGC2O67TFM6HNAW7YKIA, seg_pos={0 0}, upload=62633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 9 12:39:05.844747638 (71h10m41.884320768s) [seg_pos={0 0}, upload=62633]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 12:39:05.844823833 (71h10m41.884396953s) [upload=62633]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 12:39:05.844830386 (71h10m41.884403506s) [upload=62633]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 12:39:06.236723527 (71h10m42.276296647s) [upload=62633]: Done uploading segments... Sep 9 12:39:06.236742012 (71h10m42.276315132s) [upload=62633]: Upload finished. err: <nil> Duration: 21.261593302s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 12.586480723s FAIL (2025-09-09 12:46:32 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 12:39:03.275681631 (71h10m39.315254751s) [upload=62633]: Starting upload Sep 9 12:39:03.275744833 (71h10m39.315317953s) [upload=62633]: Done starting upload Sep 9 12:39:03.275813914 (71h10m39.315387034s) [upload=62633]: Uploading segments... Sep 9 12:39:03.276020751 (71h10m39.315593881s) [upload=62633]: Got next segment. Inline: false Sep 9 12:39:03.276059825 (71h10m39.315632945s) [upload=62633]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 12:39:03.276064905 (71h10m39.315638025s) [upload=62633]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 12:39:03.574977477 (71h10m39.614550597s) [seg_pos={0 0}, upload=62633]: Begin upload segment... Sep 9 12:39:03.575036299 (71h10m39.614609429s) [seg_pos={0 0}, upload=62633]: Done begin upload segment. Sep 9 12:39:03.575063682 (71h10m39.614636812s) [noise=true , address=45.91.116.9:4261 , piece_id=WF4VYUZGDPD4GUHX5BT3DZSROWO2MPVAFGFZIE2E2ERALA6JHFIA, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575076576 (71h10m39.614649706s) [noise=true , address=77.90.31.14:4662 , piece_id=ARN32V426TEKN2GM2ZS66PO4JBQ4Q5DWQTYVDGZCPEVTP46QNSSQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575131351 (71h10m39.614704481s) [noise=true , address=77.90.31.17:4772 , piece_id=DAHPPZUZ6N3QO5Y2EDNV4LIEUNBOC77ZCU5MPSTR6AVHH55HBFAA, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575469408 (71h10m39.615042528s) [noise=true , address=45.91.116.6:4975 , piece_id=5EFFI476IRLIQY3OHOXOFUQNEY243GW2O3B7JNW7MORNM6NSMM7A, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575492583 (71h10m39.615065703s) [noise=true , address=145.79.227.3:4149 , piece_id=TPKUKECXPPZVGYSZGKZZA2EY76NFBR3AXCX7CN43ZLD3CRU3NPKQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575758671 (71h10m39.615331791s) [noise=true , address=45.91.116.8:4045 , piece_id=FZMOZ7ZZPONGUGI253XFKFWKVMCJ5DMH6NX2URRG7FTY77VMDIEA, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575834486 (71h10m39.615407606s) [noise=true , address=45.91.116.12:4226 , piece_id=D7IJNR4YK7DKPAOVMQXLQUUW37VEC44G5636GCPBCPWG3NILPEKQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.576036233 (71h10m39.615609353s) [noise=true , address=45.91.116.10:4082 , piece_id=XDE7HUJLJOTT2TM3PCCLFGNRNL54QMMAILBYGYQ43C2PJLTKCN2Q, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.576177162 (71h10m39.615750282s) [noise=true , address=145.79.227.15:4874 , piece_id=DXSLDJ3PO3EVSAAQHDXCMD6XX2JVR4UFFGC2O67TFM6HNAW7YKIA, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.576517223 (71h10m39.616090353s) [noise=true , address=145.79.227.19:4079 , piece_id=KHEYABXNGLKUJF6LMWCZPC2W5WVKHG4MO5TENST2YYRP5PK2K7XQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.577449077 (71h10m39.617022197s) [noise=true , address=45.91.116.13:4154 , piece_id=RVLGTPGQHZ7ZRVBFXFTTISCT5BC6GUG64IFM436LWFJOI4UG3Z2A, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.577556121 (71h10m39.617129241s) [noise=true , address=77.90.31.12:4592 , piece_id=HXE45P4FBCHOP3Q343YIEWTYWD4XKRF2NCLW4K3U33MYOGPXHDLQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.577841046 (71h10m39.617414177s) [noise=true , address=45.91.116.11:4119 , piece_id=D7SMP6SA7YE7MR2MM7ALKDPKX3KRRC37766S4CN4O7GCSGS5EAUQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.578169214 (71h10m39.617742334s) [noise=true , address=45.91.116.7:4009 , piece_id=3JVZNWDLPKF7VKTOEMYCVJYET67UE22PUJ3W3T3OM55SPZIVTWOQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.578915151 (71h10m39.618488272s) [noise=true , address=77.90.31.10:4518 , piece_id=TCZGT4LQQN4BVJRLOU2BFA336AOY5WIYBFSUBGCT3HZKM4K42IIQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.579242989 (71h10m39.618816109s) [noise=true , address=77.90.31.18:4806 , piece_id=NOZDTBYPWYRMX6RBZKXBOAA4FSIWCYIMYRYTF32DEVKJD5534CGA, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:05.343785443 (71h10m41.383358563s) [upload=62633]: Next returned nil segment Sep 9 12:39:05.343803998 (71h10m41.383377118s) [upload=62633]: Waiting for error group managing segments... Sep 9 12:39:05.634702784 (71h10m41.674275905s) [noise=true , address=145.79.227.3:4149 , piece_id=TPKUKECXPPZVGYSZGKZZA2EY76NFBR3AXCX7CN43ZLD3CRU3NPKQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.753617109 (71h10m41.793190229s) [noise=true , address=45.91.116.12:4226 , piece_id=D7IJNR4YK7DKPAOVMQXLQUUW37VEC44G5636GCPBCPWG3NILPEKQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.773525196 (71h10m41.813098316s) [noise=true , address=45.91.116.7:4009 , piece_id=3JVZNWDLPKF7VKTOEMYCVJYET67UE22PUJ3W3T3OM55SPZIVTWOQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.774693902 (71h10m41.814267032s) [noise=true , address=45.91.116.11:4119 , piece_id=D7SMP6SA7YE7MR2MM7ALKDPKX3KRRC37766S4CN4O7GCSGS5EAUQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.782522974 (71h10m41.822096094s) [noise=true , address=77.90.31.10:4518 , piece_id=TCZGT4LQQN4BVJRLOU2BFA336AOY5WIYBFSUBGCT3HZKM4K42IIQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.788013982 (71h10m41.827587102s) [noise=true , address=45.91.116.10:4082 , piece_id=XDE7HUJLJOTT2TM3PCCLFGNRNL54QMMAILBYGYQ43C2PJLTKCN2Q, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.796754077 (71h10m41.836327197s) [noise=true , address=45.91.116.6:4975 , piece_id=5EFFI476IRLIQY3OHOXOFUQNEY243GW2O3B7JNW7MORNM6NSMM7A, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.798665846 (71h10m41.838238966s) [noise=true , address=145.79.227.19:4079 , piece_id=KHEYABXNGLKUJF6LMWCZPC2W5WVKHG4MO5TENST2YYRP5PK2K7XQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.800799498 (71h10m41.840372629s) [noise=true , address=77.90.31.18:4806 , piece_id=NOZDTBYPWYRMX6RBZKXBOAA4FSIWCYIMYRYTF32DEVKJD5534CGA, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.807325617 (71h10m41.846898737s) [noise=true , address=45.91.116.9:4261 , piece_id=WF4VYUZGDPD4GUHX5BT3DZSROWO2MPVAFGFZIE2E2ERALA6JHFIA, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.837434272 (71h10m41.877007392s) [noise=true , address=45.91.116.13:4154 , piece_id=RVLGTPGQHZ7ZRVBFXFTTISCT5BC6GUG64IFM436LWFJOI4UG3Z2A, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.839825218 (71h10m41.879398338s) [noise=true , address=45.91.116.8:4045 , piece_id=FZMOZ7ZZPONGUGI253XFKFWKVMCJ5DMH6NX2URRG7FTY77VMDIEA, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.844431272 (71h10m41.884004392s) [noise=true , address=77.90.31.14:4662 , piece_id=ARN32V426TEKN2GM2ZS66PO4JBQ4Q5DWQTYVDGZCPEVTP46QNSSQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.844465007 (71h10m41.884038127s) [seg_pos={0 0}, upload=62633]: Segment reached optimal threshold of 13 pieces. Sep 9 12:39:05.844600095 (71h10m41.884173225s) [noise=true , address=77.90.31.12:4592 , piece_id=HXE45P4FBCHOP3Q343YIEWTYWD4XKRF2NCLW4K3U33MYOGPXHDLQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Sep 9 12:39:05.844613632 (71h10m41.884186752s) [noise=true , address=77.90.31.17:4772 , piece_id=DAHPPZUZ6N3QO5Y2EDNV4LIEUNBOC77ZCU5MPSTR6AVHH55HBFAA, seg_pos={0 0}, upload=62633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: expected piece hash; context canceled; EOF Sep 9 12:39:05.844719895 (71h10m41.884293025s) [noise=true , address=145.79.227.15:4874 , piece_id=DXSLDJ3PO3EVSAAQHDXCMD6XX2JVR4UFFGC2O67TFM6HNAW7YKIA, seg_pos={0 0}, upload=62633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 9 12:39:05.844747638 (71h10m41.884320768s) [seg_pos={0 0}, upload=62633]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 12:39:05.844823833 (71h10m41.884396953s) [upload=62633]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 12:39:05.844830386 (71h10m41.884403506s) [upload=62633]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 12:39:06.236723527 (71h10m42.276296647s) [upload=62633]: Done uploading segments... Sep 9 12:39:06.236742012 (71h10m42.276315132s) [upload=62633]: Upload finished. err: <nil> Duration: 12.586511642s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 12.235735448s FAIL (2025-09-09 12:46:04 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 12:39:03.275681631 (71h10m39.315254751s) [upload=62633]: Starting upload Sep 9 12:39:03.275744833 (71h10m39.315317953s) [upload=62633]: Done starting upload Sep 9 12:39:03.275813914 (71h10m39.315387034s) [upload=62633]: Uploading segments... Sep 9 12:39:03.276020751 (71h10m39.315593881s) [upload=62633]: Got next segment. Inline: false Sep 9 12:39:03.276059825 (71h10m39.315632945s) [upload=62633]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 12:39:03.276064905 (71h10m39.315638025s) [upload=62633]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 12:39:03.574977477 (71h10m39.614550597s) [seg_pos={0 0}, upload=62633]: Begin upload segment... Sep 9 12:39:03.575036299 (71h10m39.614609429s) [seg_pos={0 0}, upload=62633]: Done begin upload segment. Sep 9 12:39:03.575063682 (71h10m39.614636812s) [noise=true , address=45.91.116.9:4261 , piece_id=WF4VYUZGDPD4GUHX5BT3DZSROWO2MPVAFGFZIE2E2ERALA6JHFIA, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575076576 (71h10m39.614649706s) [noise=true , address=77.90.31.14:4662 , piece_id=ARN32V426TEKN2GM2ZS66PO4JBQ4Q5DWQTYVDGZCPEVTP46QNSSQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575131351 (71h10m39.614704481s) [noise=true , address=77.90.31.17:4772 , piece_id=DAHPPZUZ6N3QO5Y2EDNV4LIEUNBOC77ZCU5MPSTR6AVHH55HBFAA, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575469408 (71h10m39.615042528s) [noise=true , address=45.91.116.6:4975 , piece_id=5EFFI476IRLIQY3OHOXOFUQNEY243GW2O3B7JNW7MORNM6NSMM7A, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575492583 (71h10m39.615065703s) [noise=true , address=145.79.227.3:4149 , piece_id=TPKUKECXPPZVGYSZGKZZA2EY76NFBR3AXCX7CN43ZLD3CRU3NPKQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575758671 (71h10m39.615331791s) [noise=true , address=45.91.116.8:4045 , piece_id=FZMOZ7ZZPONGUGI253XFKFWKVMCJ5DMH6NX2URRG7FTY77VMDIEA, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575834486 (71h10m39.615407606s) [noise=true , address=45.91.116.12:4226 , piece_id=D7IJNR4YK7DKPAOVMQXLQUUW37VEC44G5636GCPBCPWG3NILPEKQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.576036233 (71h10m39.615609353s) [noise=true , address=45.91.116.10:4082 , piece_id=XDE7HUJLJOTT2TM3PCCLFGNRNL54QMMAILBYGYQ43C2PJLTKCN2Q, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.576177162 (71h10m39.615750282s) [noise=true , address=145.79.227.15:4874 , piece_id=DXSLDJ3PO3EVSAAQHDXCMD6XX2JVR4UFFGC2O67TFM6HNAW7YKIA, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.576517223 (71h10m39.616090353s) [noise=true , address=145.79.227.19:4079 , piece_id=KHEYABXNGLKUJF6LMWCZPC2W5WVKHG4MO5TENST2YYRP5PK2K7XQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.577449077 (71h10m39.617022197s) [noise=true , address=45.91.116.13:4154 , piece_id=RVLGTPGQHZ7ZRVBFXFTTISCT5BC6GUG64IFM436LWFJOI4UG3Z2A, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.577556121 (71h10m39.617129241s) [noise=true , address=77.90.31.12:4592 , piece_id=HXE45P4FBCHOP3Q343YIEWTYWD4XKRF2NCLW4K3U33MYOGPXHDLQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.577841046 (71h10m39.617414177s) [noise=true , address=45.91.116.11:4119 , piece_id=D7SMP6SA7YE7MR2MM7ALKDPKX3KRRC37766S4CN4O7GCSGS5EAUQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.578169214 (71h10m39.617742334s) [noise=true , address=45.91.116.7:4009 , piece_id=3JVZNWDLPKF7VKTOEMYCVJYET67UE22PUJ3W3T3OM55SPZIVTWOQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.578915151 (71h10m39.618488272s) [noise=true , address=77.90.31.10:4518 , piece_id=TCZGT4LQQN4BVJRLOU2BFA336AOY5WIYBFSUBGCT3HZKM4K42IIQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.579242989 (71h10m39.618816109s) [noise=true , address=77.90.31.18:4806 , piece_id=NOZDTBYPWYRMX6RBZKXBOAA4FSIWCYIMYRYTF32DEVKJD5534CGA, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:05.343785443 (71h10m41.383358563s) [upload=62633]: Next returned nil segment Sep 9 12:39:05.343803998 (71h10m41.383377118s) [upload=62633]: Waiting for error group managing segments... Sep 9 12:39:05.634702784 (71h10m41.674275905s) [noise=true , address=145.79.227.3:4149 , piece_id=TPKUKECXPPZVGYSZGKZZA2EY76NFBR3AXCX7CN43ZLD3CRU3NPKQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.753617109 (71h10m41.793190229s) [noise=true , address=45.91.116.12:4226 , piece_id=D7IJNR4YK7DKPAOVMQXLQUUW37VEC44G5636GCPBCPWG3NILPEKQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.773525196 (71h10m41.813098316s) [noise=true , address=45.91.116.7:4009 , piece_id=3JVZNWDLPKF7VKTOEMYCVJYET67UE22PUJ3W3T3OM55SPZIVTWOQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.774693902 (71h10m41.814267032s) [noise=true , address=45.91.116.11:4119 , piece_id=D7SMP6SA7YE7MR2MM7ALKDPKX3KRRC37766S4CN4O7GCSGS5EAUQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.782522974 (71h10m41.822096094s) [noise=true , address=77.90.31.10:4518 , piece_id=TCZGT4LQQN4BVJRLOU2BFA336AOY5WIYBFSUBGCT3HZKM4K42IIQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.788013982 (71h10m41.827587102s) [noise=true , address=45.91.116.10:4082 , piece_id=XDE7HUJLJOTT2TM3PCCLFGNRNL54QMMAILBYGYQ43C2PJLTKCN2Q, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.796754077 (71h10m41.836327197s) [noise=true , address=45.91.116.6:4975 , piece_id=5EFFI476IRLIQY3OHOXOFUQNEY243GW2O3B7JNW7MORNM6NSMM7A, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.798665846 (71h10m41.838238966s) [noise=true , address=145.79.227.19:4079 , piece_id=KHEYABXNGLKUJF6LMWCZPC2W5WVKHG4MO5TENST2YYRP5PK2K7XQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.800799498 (71h10m41.840372629s) [noise=true , address=77.90.31.18:4806 , piece_id=NOZDTBYPWYRMX6RBZKXBOAA4FSIWCYIMYRYTF32DEVKJD5534CGA, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.807325617 (71h10m41.846898737s) [noise=true , address=45.91.116.9:4261 , piece_id=WF4VYUZGDPD4GUHX5BT3DZSROWO2MPVAFGFZIE2E2ERALA6JHFIA, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.837434272 (71h10m41.877007392s) [noise=true , address=45.91.116.13:4154 , piece_id=RVLGTPGQHZ7ZRVBFXFTTISCT5BC6GUG64IFM436LWFJOI4UG3Z2A, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.839825218 (71h10m41.879398338s) [noise=true , address=45.91.116.8:4045 , piece_id=FZMOZ7ZZPONGUGI253XFKFWKVMCJ5DMH6NX2URRG7FTY77VMDIEA, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.844431272 (71h10m41.884004392s) [noise=true , address=77.90.31.14:4662 , piece_id=ARN32V426TEKN2GM2ZS66PO4JBQ4Q5DWQTYVDGZCPEVTP46QNSSQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.844465007 (71h10m41.884038127s) [seg_pos={0 0}, upload=62633]: Segment reached optimal threshold of 13 pieces. Sep 9 12:39:05.844600095 (71h10m41.884173225s) [noise=true , address=77.90.31.12:4592 , piece_id=HXE45P4FBCHOP3Q343YIEWTYWD4XKRF2NCLW4K3U33MYOGPXHDLQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Sep 9 12:39:05.844613632 (71h10m41.884186752s) [noise=true , address=77.90.31.17:4772 , piece_id=DAHPPZUZ6N3QO5Y2EDNV4LIEUNBOC77ZCU5MPSTR6AVHH55HBFAA, seg_pos={0 0}, upload=62633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: expected piece hash; context canceled; EOF Sep 9 12:39:05.844719895 (71h10m41.884293025s) [noise=true , address=145.79.227.15:4874 , piece_id=DXSLDJ3PO3EVSAAQHDXCMD6XX2JVR4UFFGC2O67TFM6HNAW7YKIA, seg_pos={0 0}, upload=62633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 9 12:39:05.844747638 (71h10m41.884320768s) [seg_pos={0 0}, upload=62633]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 12:39:05.844823833 (71h10m41.884396953s) [upload=62633]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 12:39:05.844830386 (71h10m41.884403506s) [upload=62633]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 12:39:06.236723527 (71h10m42.276296647s) [upload=62633]: Done uploading segments... Sep 9 12:39:06.236742012 (71h10m42.276315132s) [upload=62633]: Upload finished. err: <nil> Duration: 12.235756729s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 25.376722727s FAIL (2025-09-09 12:45:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 12:39:03.275681631 (71h10m39.315254751s) [upload=62633]: Starting upload Sep 9 12:39:03.275744833 (71h10m39.315317953s) [upload=62633]: Done starting upload Sep 9 12:39:03.275813914 (71h10m39.315387034s) [upload=62633]: Uploading segments... Sep 9 12:39:03.276020751 (71h10m39.315593881s) [upload=62633]: Got next segment. Inline: false Sep 9 12:39:03.276059825 (71h10m39.315632945s) [upload=62633]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 12:39:03.276064905 (71h10m39.315638025s) [upload=62633]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 12:39:03.574977477 (71h10m39.614550597s) [seg_pos={0 0}, upload=62633]: Begin upload segment... Sep 9 12:39:03.575036299 (71h10m39.614609429s) [seg_pos={0 0}, upload=62633]: Done begin upload segment. Sep 9 12:39:03.575063682 (71h10m39.614636812s) [noise=true , address=45.91.116.9:4261 , piece_id=WF4VYUZGDPD4GUHX5BT3DZSROWO2MPVAFGFZIE2E2ERALA6JHFIA, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575076576 (71h10m39.614649706s) [noise=true , address=77.90.31.14:4662 , piece_id=ARN32V426TEKN2GM2ZS66PO4JBQ4Q5DWQTYVDGZCPEVTP46QNSSQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575131351 (71h10m39.614704481s) [noise=true , address=77.90.31.17:4772 , piece_id=DAHPPZUZ6N3QO5Y2EDNV4LIEUNBOC77ZCU5MPSTR6AVHH55HBFAA, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575469408 (71h10m39.615042528s) [noise=true , address=45.91.116.6:4975 , piece_id=5EFFI476IRLIQY3OHOXOFUQNEY243GW2O3B7JNW7MORNM6NSMM7A, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575492583 (71h10m39.615065703s) [noise=true , address=145.79.227.3:4149 , piece_id=TPKUKECXPPZVGYSZGKZZA2EY76NFBR3AXCX7CN43ZLD3CRU3NPKQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575758671 (71h10m39.615331791s) [noise=true , address=45.91.116.8:4045 , piece_id=FZMOZ7ZZPONGUGI253XFKFWKVMCJ5DMH6NX2URRG7FTY77VMDIEA, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575834486 (71h10m39.615407606s) [noise=true , address=45.91.116.12:4226 , piece_id=D7IJNR4YK7DKPAOVMQXLQUUW37VEC44G5636GCPBCPWG3NILPEKQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.576036233 (71h10m39.615609353s) [noise=true , address=45.91.116.10:4082 , piece_id=XDE7HUJLJOTT2TM3PCCLFGNRNL54QMMAILBYGYQ43C2PJLTKCN2Q, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.576177162 (71h10m39.615750282s) [noise=true , address=145.79.227.15:4874 , piece_id=DXSLDJ3PO3EVSAAQHDXCMD6XX2JVR4UFFGC2O67TFM6HNAW7YKIA, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.576517223 (71h10m39.616090353s) [noise=true , address=145.79.227.19:4079 , piece_id=KHEYABXNGLKUJF6LMWCZPC2W5WVKHG4MO5TENST2YYRP5PK2K7XQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.577449077 (71h10m39.617022197s) [noise=true , address=45.91.116.13:4154 , piece_id=RVLGTPGQHZ7ZRVBFXFTTISCT5BC6GUG64IFM436LWFJOI4UG3Z2A, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.577556121 (71h10m39.617129241s) [noise=true , address=77.90.31.12:4592 , piece_id=HXE45P4FBCHOP3Q343YIEWTYWD4XKRF2NCLW4K3U33MYOGPXHDLQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.577841046 (71h10m39.617414177s) [noise=true , address=45.91.116.11:4119 , piece_id=D7SMP6SA7YE7MR2MM7ALKDPKX3KRRC37766S4CN4O7GCSGS5EAUQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.578169214 (71h10m39.617742334s) [noise=true , address=45.91.116.7:4009 , piece_id=3JVZNWDLPKF7VKTOEMYCVJYET67UE22PUJ3W3T3OM55SPZIVTWOQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.578915151 (71h10m39.618488272s) [noise=true , address=77.90.31.10:4518 , piece_id=TCZGT4LQQN4BVJRLOU2BFA336AOY5WIYBFSUBGCT3HZKM4K42IIQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.579242989 (71h10m39.618816109s) [noise=true , address=77.90.31.18:4806 , piece_id=NOZDTBYPWYRMX6RBZKXBOAA4FSIWCYIMYRYTF32DEVKJD5534CGA, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:05.343785443 (71h10m41.383358563s) [upload=62633]: Next returned nil segment Sep 9 12:39:05.343803998 (71h10m41.383377118s) [upload=62633]: Waiting for error group managing segments... Sep 9 12:39:05.634702784 (71h10m41.674275905s) [noise=true , address=145.79.227.3:4149 , piece_id=TPKUKECXPPZVGYSZGKZZA2EY76NFBR3AXCX7CN43ZLD3CRU3NPKQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.753617109 (71h10m41.793190229s) [noise=true , address=45.91.116.12:4226 , piece_id=D7IJNR4YK7DKPAOVMQXLQUUW37VEC44G5636GCPBCPWG3NILPEKQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.773525196 (71h10m41.813098316s) [noise=true , address=45.91.116.7:4009 , piece_id=3JVZNWDLPKF7VKTOEMYCVJYET67UE22PUJ3W3T3OM55SPZIVTWOQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.774693902 (71h10m41.814267032s) [noise=true , address=45.91.116.11:4119 , piece_id=D7SMP6SA7YE7MR2MM7ALKDPKX3KRRC37766S4CN4O7GCSGS5EAUQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.782522974 (71h10m41.822096094s) [noise=true , address=77.90.31.10:4518 , piece_id=TCZGT4LQQN4BVJRLOU2BFA336AOY5WIYBFSUBGCT3HZKM4K42IIQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.788013982 (71h10m41.827587102s) [noise=true , address=45.91.116.10:4082 , piece_id=XDE7HUJLJOTT2TM3PCCLFGNRNL54QMMAILBYGYQ43C2PJLTKCN2Q, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.796754077 (71h10m41.836327197s) [noise=true , address=45.91.116.6:4975 , piece_id=5EFFI476IRLIQY3OHOXOFUQNEY243GW2O3B7JNW7MORNM6NSMM7A, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.798665846 (71h10m41.838238966s) [noise=true , address=145.79.227.19:4079 , piece_id=KHEYABXNGLKUJF6LMWCZPC2W5WVKHG4MO5TENST2YYRP5PK2K7XQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.800799498 (71h10m41.840372629s) [noise=true , address=77.90.31.18:4806 , piece_id=NOZDTBYPWYRMX6RBZKXBOAA4FSIWCYIMYRYTF32DEVKJD5534CGA, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.807325617 (71h10m41.846898737s) [noise=true , address=45.91.116.9:4261 , piece_id=WF4VYUZGDPD4GUHX5BT3DZSROWO2MPVAFGFZIE2E2ERALA6JHFIA, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.837434272 (71h10m41.877007392s) [noise=true , address=45.91.116.13:4154 , piece_id=RVLGTPGQHZ7ZRVBFXFTTISCT5BC6GUG64IFM436LWFJOI4UG3Z2A, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.839825218 (71h10m41.879398338s) [noise=true , address=45.91.116.8:4045 , piece_id=FZMOZ7ZZPONGUGI253XFKFWKVMCJ5DMH6NX2URRG7FTY77VMDIEA, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.844431272 (71h10m41.884004392s) [noise=true , address=77.90.31.14:4662 , piece_id=ARN32V426TEKN2GM2ZS66PO4JBQ4Q5DWQTYVDGZCPEVTP46QNSSQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.844465007 (71h10m41.884038127s) [seg_pos={0 0}, upload=62633]: Segment reached optimal threshold of 13 pieces. Sep 9 12:39:05.844600095 (71h10m41.884173225s) [noise=true , address=77.90.31.12:4592 , piece_id=HXE45P4FBCHOP3Q343YIEWTYWD4XKRF2NCLW4K3U33MYOGPXHDLQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Sep 9 12:39:05.844613632 (71h10m41.884186752s) [noise=true , address=77.90.31.17:4772 , piece_id=DAHPPZUZ6N3QO5Y2EDNV4LIEUNBOC77ZCU5MPSTR6AVHH55HBFAA, seg_pos={0 0}, upload=62633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: expected piece hash; context canceled; EOF Sep 9 12:39:05.844719895 (71h10m41.884293025s) [noise=true , address=145.79.227.15:4874 , piece_id=DXSLDJ3PO3EVSAAQHDXCMD6XX2JVR4UFFGC2O67TFM6HNAW7YKIA, seg_pos={0 0}, upload=62633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 9 12:39:05.844747638 (71h10m41.884320768s) [seg_pos={0 0}, upload=62633]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 12:39:05.844823833 (71h10m41.884396953s) [upload=62633]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 12:39:05.844830386 (71h10m41.884403506s) [upload=62633]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 12:39:06.236723527 (71h10m42.276296647s) [upload=62633]: Done uploading segments... Sep 9 12:39:06.236742012 (71h10m42.276315132s) [upload=62633]: Upload finished. err: <nil> Duration: 25.376752293s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 18.32894259s FAIL (2025-09-09 12:44:36 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 12:39:03.275681631 (71h10m39.315254751s) [upload=62633]: Starting upload Sep 9 12:39:03.275744833 (71h10m39.315317953s) [upload=62633]: Done starting upload Sep 9 12:39:03.275813914 (71h10m39.315387034s) [upload=62633]: Uploading segments... Sep 9 12:39:03.276020751 (71h10m39.315593881s) [upload=62633]: Got next segment. Inline: false Sep 9 12:39:03.276059825 (71h10m39.315632945s) [upload=62633]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 12:39:03.276064905 (71h10m39.315638025s) [upload=62633]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 12:39:03.574977477 (71h10m39.614550597s) [seg_pos={0 0}, upload=62633]: Begin upload segment... Sep 9 12:39:03.575036299 (71h10m39.614609429s) [seg_pos={0 0}, upload=62633]: Done begin upload segment. Sep 9 12:39:03.575063682 (71h10m39.614636812s) [noise=true , address=45.91.116.9:4261 , piece_id=WF4VYUZGDPD4GUHX5BT3DZSROWO2MPVAFGFZIE2E2ERALA6JHFIA, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575076576 (71h10m39.614649706s) [noise=true , address=77.90.31.14:4662 , piece_id=ARN32V426TEKN2GM2ZS66PO4JBQ4Q5DWQTYVDGZCPEVTP46QNSSQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575131351 (71h10m39.614704481s) [noise=true , address=77.90.31.17:4772 , piece_id=DAHPPZUZ6N3QO5Y2EDNV4LIEUNBOC77ZCU5MPSTR6AVHH55HBFAA, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575469408 (71h10m39.615042528s) [noise=true , address=45.91.116.6:4975 , piece_id=5EFFI476IRLIQY3OHOXOFUQNEY243GW2O3B7JNW7MORNM6NSMM7A, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575492583 (71h10m39.615065703s) [noise=true , address=145.79.227.3:4149 , piece_id=TPKUKECXPPZVGYSZGKZZA2EY76NFBR3AXCX7CN43ZLD3CRU3NPKQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575758671 (71h10m39.615331791s) [noise=true , address=45.91.116.8:4045 , piece_id=FZMOZ7ZZPONGUGI253XFKFWKVMCJ5DMH6NX2URRG7FTY77VMDIEA, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575834486 (71h10m39.615407606s) [noise=true , address=45.91.116.12:4226 , piece_id=D7IJNR4YK7DKPAOVMQXLQUUW37VEC44G5636GCPBCPWG3NILPEKQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.576036233 (71h10m39.615609353s) [noise=true , address=45.91.116.10:4082 , piece_id=XDE7HUJLJOTT2TM3PCCLFGNRNL54QMMAILBYGYQ43C2PJLTKCN2Q, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.576177162 (71h10m39.615750282s) [noise=true , address=145.79.227.15:4874 , piece_id=DXSLDJ3PO3EVSAAQHDXCMD6XX2JVR4UFFGC2O67TFM6HNAW7YKIA, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.576517223 (71h10m39.616090353s) [noise=true , address=145.79.227.19:4079 , piece_id=KHEYABXNGLKUJF6LMWCZPC2W5WVKHG4MO5TENST2YYRP5PK2K7XQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.577449077 (71h10m39.617022197s) [noise=true , address=45.91.116.13:4154 , piece_id=RVLGTPGQHZ7ZRVBFXFTTISCT5BC6GUG64IFM436LWFJOI4UG3Z2A, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.577556121 (71h10m39.617129241s) [noise=true , address=77.90.31.12:4592 , piece_id=HXE45P4FBCHOP3Q343YIEWTYWD4XKRF2NCLW4K3U33MYOGPXHDLQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.577841046 (71h10m39.617414177s) [noise=true , address=45.91.116.11:4119 , piece_id=D7SMP6SA7YE7MR2MM7ALKDPKX3KRRC37766S4CN4O7GCSGS5EAUQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.578169214 (71h10m39.617742334s) [noise=true , address=45.91.116.7:4009 , piece_id=3JVZNWDLPKF7VKTOEMYCVJYET67UE22PUJ3W3T3OM55SPZIVTWOQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.578915151 (71h10m39.618488272s) [noise=true , address=77.90.31.10:4518 , piece_id=TCZGT4LQQN4BVJRLOU2BFA336AOY5WIYBFSUBGCT3HZKM4K42IIQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.579242989 (71h10m39.618816109s) [noise=true , address=77.90.31.18:4806 , piece_id=NOZDTBYPWYRMX6RBZKXBOAA4FSIWCYIMYRYTF32DEVKJD5534CGA, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:05.343785443 (71h10m41.383358563s) [upload=62633]: Next returned nil segment Sep 9 12:39:05.343803998 (71h10m41.383377118s) [upload=62633]: Waiting for error group managing segments... Sep 9 12:39:05.634702784 (71h10m41.674275905s) [noise=true , address=145.79.227.3:4149 , piece_id=TPKUKECXPPZVGYSZGKZZA2EY76NFBR3AXCX7CN43ZLD3CRU3NPKQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.753617109 (71h10m41.793190229s) [noise=true , address=45.91.116.12:4226 , piece_id=D7IJNR4YK7DKPAOVMQXLQUUW37VEC44G5636GCPBCPWG3NILPEKQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.773525196 (71h10m41.813098316s) [noise=true , address=45.91.116.7:4009 , piece_id=3JVZNWDLPKF7VKTOEMYCVJYET67UE22PUJ3W3T3OM55SPZIVTWOQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.774693902 (71h10m41.814267032s) [noise=true , address=45.91.116.11:4119 , piece_id=D7SMP6SA7YE7MR2MM7ALKDPKX3KRRC37766S4CN4O7GCSGS5EAUQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.782522974 (71h10m41.822096094s) [noise=true , address=77.90.31.10:4518 , piece_id=TCZGT4LQQN4BVJRLOU2BFA336AOY5WIYBFSUBGCT3HZKM4K42IIQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.788013982 (71h10m41.827587102s) [noise=true , address=45.91.116.10:4082 , piece_id=XDE7HUJLJOTT2TM3PCCLFGNRNL54QMMAILBYGYQ43C2PJLTKCN2Q, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.796754077 (71h10m41.836327197s) [noise=true , address=45.91.116.6:4975 , piece_id=5EFFI476IRLIQY3OHOXOFUQNEY243GW2O3B7JNW7MORNM6NSMM7A, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.798665846 (71h10m41.838238966s) [noise=true , address=145.79.227.19:4079 , piece_id=KHEYABXNGLKUJF6LMWCZPC2W5WVKHG4MO5TENST2YYRP5PK2K7XQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.800799498 (71h10m41.840372629s) [noise=true , address=77.90.31.18:4806 , piece_id=NOZDTBYPWYRMX6RBZKXBOAA4FSIWCYIMYRYTF32DEVKJD5534CGA, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.807325617 (71h10m41.846898737s) [noise=true , address=45.91.116.9:4261 , piece_id=WF4VYUZGDPD4GUHX5BT3DZSROWO2MPVAFGFZIE2E2ERALA6JHFIA, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.837434272 (71h10m41.877007392s) [noise=true , address=45.91.116.13:4154 , piece_id=RVLGTPGQHZ7ZRVBFXFTTISCT5BC6GUG64IFM436LWFJOI4UG3Z2A, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.839825218 (71h10m41.879398338s) [noise=true , address=45.91.116.8:4045 , piece_id=FZMOZ7ZZPONGUGI253XFKFWKVMCJ5DMH6NX2URRG7FTY77VMDIEA, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.844431272 (71h10m41.884004392s) [noise=true , address=77.90.31.14:4662 , piece_id=ARN32V426TEKN2GM2ZS66PO4JBQ4Q5DWQTYVDGZCPEVTP46QNSSQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.844465007 (71h10m41.884038127s) [seg_pos={0 0}, upload=62633]: Segment reached optimal threshold of 13 pieces. Sep 9 12:39:05.844600095 (71h10m41.884173225s) [noise=true , address=77.90.31.12:4592 , piece_id=HXE45P4FBCHOP3Q343YIEWTYWD4XKRF2NCLW4K3U33MYOGPXHDLQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Sep 9 12:39:05.844613632 (71h10m41.884186752s) [noise=true , address=77.90.31.17:4772 , piece_id=DAHPPZUZ6N3QO5Y2EDNV4LIEUNBOC77ZCU5MPSTR6AVHH55HBFAA, seg_pos={0 0}, upload=62633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: expected piece hash; context canceled; EOF Sep 9 12:39:05.844719895 (71h10m41.884293025s) [noise=true , address=145.79.227.15:4874 , piece_id=DXSLDJ3PO3EVSAAQHDXCMD6XX2JVR4UFFGC2O67TFM6HNAW7YKIA, seg_pos={0 0}, upload=62633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 9 12:39:05.844747638 (71h10m41.884320768s) [seg_pos={0 0}, upload=62633]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 12:39:05.844823833 (71h10m41.884396953s) [upload=62633]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 12:39:05.844830386 (71h10m41.884403506s) [upload=62633]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 12:39:06.236723527 (71h10m42.276296647s) [upload=62633]: Done uploading segments... Sep 9 12:39:06.236742012 (71h10m42.276315132s) [upload=62633]: Upload finished. err: <nil> Duration: 18.328964582s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 10.578561934s FAIL (2025-09-09 12:43:50 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 12:39:03.275681631 (71h10m39.315254751s) [upload=62633]: Starting upload Sep 9 12:39:03.275744833 (71h10m39.315317953s) [upload=62633]: Done starting upload Sep 9 12:39:03.275813914 (71h10m39.315387034s) [upload=62633]: Uploading segments... Sep 9 12:39:03.276020751 (71h10m39.315593881s) [upload=62633]: Got next segment. Inline: false Sep 9 12:39:03.276059825 (71h10m39.315632945s) [upload=62633]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 12:39:03.276064905 (71h10m39.315638025s) [upload=62633]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 12:39:03.574977477 (71h10m39.614550597s) [seg_pos={0 0}, upload=62633]: Begin upload segment... Sep 9 12:39:03.575036299 (71h10m39.614609429s) [seg_pos={0 0}, upload=62633]: Done begin upload segment. Sep 9 12:39:03.575063682 (71h10m39.614636812s) [noise=true , address=45.91.116.9:4261 , piece_id=WF4VYUZGDPD4GUHX5BT3DZSROWO2MPVAFGFZIE2E2ERALA6JHFIA, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575076576 (71h10m39.614649706s) [noise=true , address=77.90.31.14:4662 , piece_id=ARN32V426TEKN2GM2ZS66PO4JBQ4Q5DWQTYVDGZCPEVTP46QNSSQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575131351 (71h10m39.614704481s) [noise=true , address=77.90.31.17:4772 , piece_id=DAHPPZUZ6N3QO5Y2EDNV4LIEUNBOC77ZCU5MPSTR6AVHH55HBFAA, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575469408 (71h10m39.615042528s) [noise=true , address=45.91.116.6:4975 , piece_id=5EFFI476IRLIQY3OHOXOFUQNEY243GW2O3B7JNW7MORNM6NSMM7A, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575492583 (71h10m39.615065703s) [noise=true , address=145.79.227.3:4149 , piece_id=TPKUKECXPPZVGYSZGKZZA2EY76NFBR3AXCX7CN43ZLD3CRU3NPKQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575758671 (71h10m39.615331791s) [noise=true , address=45.91.116.8:4045 , piece_id=FZMOZ7ZZPONGUGI253XFKFWKVMCJ5DMH6NX2URRG7FTY77VMDIEA, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575834486 (71h10m39.615407606s) [noise=true , address=45.91.116.12:4226 , piece_id=D7IJNR4YK7DKPAOVMQXLQUUW37VEC44G5636GCPBCPWG3NILPEKQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.576036233 (71h10m39.615609353s) [noise=true , address=45.91.116.10:4082 , piece_id=XDE7HUJLJOTT2TM3PCCLFGNRNL54QMMAILBYGYQ43C2PJLTKCN2Q, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.576177162 (71h10m39.615750282s) [noise=true , address=145.79.227.15:4874 , piece_id=DXSLDJ3PO3EVSAAQHDXCMD6XX2JVR4UFFGC2O67TFM6HNAW7YKIA, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.576517223 (71h10m39.616090353s) [noise=true , address=145.79.227.19:4079 , piece_id=KHEYABXNGLKUJF6LMWCZPC2W5WVKHG4MO5TENST2YYRP5PK2K7XQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.577449077 (71h10m39.617022197s) [noise=true , address=45.91.116.13:4154 , piece_id=RVLGTPGQHZ7ZRVBFXFTTISCT5BC6GUG64IFM436LWFJOI4UG3Z2A, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.577556121 (71h10m39.617129241s) [noise=true , address=77.90.31.12:4592 , piece_id=HXE45P4FBCHOP3Q343YIEWTYWD4XKRF2NCLW4K3U33MYOGPXHDLQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.577841046 (71h10m39.617414177s) [noise=true , address=45.91.116.11:4119 , piece_id=D7SMP6SA7YE7MR2MM7ALKDPKX3KRRC37766S4CN4O7GCSGS5EAUQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.578169214 (71h10m39.617742334s) [noise=true , address=45.91.116.7:4009 , piece_id=3JVZNWDLPKF7VKTOEMYCVJYET67UE22PUJ3W3T3OM55SPZIVTWOQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.578915151 (71h10m39.618488272s) [noise=true , address=77.90.31.10:4518 , piece_id=TCZGT4LQQN4BVJRLOU2BFA336AOY5WIYBFSUBGCT3HZKM4K42IIQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.579242989 (71h10m39.618816109s) [noise=true , address=77.90.31.18:4806 , piece_id=NOZDTBYPWYRMX6RBZKXBOAA4FSIWCYIMYRYTF32DEVKJD5534CGA, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:05.343785443 (71h10m41.383358563s) [upload=62633]: Next returned nil segment Sep 9 12:39:05.343803998 (71h10m41.383377118s) [upload=62633]: Waiting for error group managing segments... Sep 9 12:39:05.634702784 (71h10m41.674275905s) [noise=true , address=145.79.227.3:4149 , piece_id=TPKUKECXPPZVGYSZGKZZA2EY76NFBR3AXCX7CN43ZLD3CRU3NPKQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.753617109 (71h10m41.793190229s) [noise=true , address=45.91.116.12:4226 , piece_id=D7IJNR4YK7DKPAOVMQXLQUUW37VEC44G5636GCPBCPWG3NILPEKQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.773525196 (71h10m41.813098316s) [noise=true , address=45.91.116.7:4009 , piece_id=3JVZNWDLPKF7VKTOEMYCVJYET67UE22PUJ3W3T3OM55SPZIVTWOQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.774693902 (71h10m41.814267032s) [noise=true , address=45.91.116.11:4119 , piece_id=D7SMP6SA7YE7MR2MM7ALKDPKX3KRRC37766S4CN4O7GCSGS5EAUQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.782522974 (71h10m41.822096094s) [noise=true , address=77.90.31.10:4518 , piece_id=TCZGT4LQQN4BVJRLOU2BFA336AOY5WIYBFSUBGCT3HZKM4K42IIQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.788013982 (71h10m41.827587102s) [noise=true , address=45.91.116.10:4082 , piece_id=XDE7HUJLJOTT2TM3PCCLFGNRNL54QMMAILBYGYQ43C2PJLTKCN2Q, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.796754077 (71h10m41.836327197s) [noise=true , address=45.91.116.6:4975 , piece_id=5EFFI476IRLIQY3OHOXOFUQNEY243GW2O3B7JNW7MORNM6NSMM7A, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.798665846 (71h10m41.838238966s) [noise=true , address=145.79.227.19:4079 , piece_id=KHEYABXNGLKUJF6LMWCZPC2W5WVKHG4MO5TENST2YYRP5PK2K7XQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.800799498 (71h10m41.840372629s) [noise=true , address=77.90.31.18:4806 , piece_id=NOZDTBYPWYRMX6RBZKXBOAA4FSIWCYIMYRYTF32DEVKJD5534CGA, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.807325617 (71h10m41.846898737s) [noise=true , address=45.91.116.9:4261 , piece_id=WF4VYUZGDPD4GUHX5BT3DZSROWO2MPVAFGFZIE2E2ERALA6JHFIA, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.837434272 (71h10m41.877007392s) [noise=true , address=45.91.116.13:4154 , piece_id=RVLGTPGQHZ7ZRVBFXFTTISCT5BC6GUG64IFM436LWFJOI4UG3Z2A, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.839825218 (71h10m41.879398338s) [noise=true , address=45.91.116.8:4045 , piece_id=FZMOZ7ZZPONGUGI253XFKFWKVMCJ5DMH6NX2URRG7FTY77VMDIEA, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.844431272 (71h10m41.884004392s) [noise=true , address=77.90.31.14:4662 , piece_id=ARN32V426TEKN2GM2ZS66PO4JBQ4Q5DWQTYVDGZCPEVTP46QNSSQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.844465007 (71h10m41.884038127s) [seg_pos={0 0}, upload=62633]: Segment reached optimal threshold of 13 pieces. Sep 9 12:39:05.844600095 (71h10m41.884173225s) [noise=true , address=77.90.31.12:4592 , piece_id=HXE45P4FBCHOP3Q343YIEWTYWD4XKRF2NCLW4K3U33MYOGPXHDLQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Sep 9 12:39:05.844613632 (71h10m41.884186752s) [noise=true , address=77.90.31.17:4772 , piece_id=DAHPPZUZ6N3QO5Y2EDNV4LIEUNBOC77ZCU5MPSTR6AVHH55HBFAA, seg_pos={0 0}, upload=62633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: expected piece hash; context canceled; EOF Sep 9 12:39:05.844719895 (71h10m41.884293025s) [noise=true , address=145.79.227.15:4874 , piece_id=DXSLDJ3PO3EVSAAQHDXCMD6XX2JVR4UFFGC2O67TFM6HNAW7YKIA, seg_pos={0 0}, upload=62633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 9 12:39:05.844747638 (71h10m41.884320768s) [seg_pos={0 0}, upload=62633]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 12:39:05.844823833 (71h10m41.884396953s) [upload=62633]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 12:39:05.844830386 (71h10m41.884403506s) [upload=62633]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 12:39:06.236723527 (71h10m42.276296647s) [upload=62633]: Done uploading segments... Sep 9 12:39:06.236742012 (71h10m42.276315132s) [upload=62633]: Upload finished. err: <nil> Duration: 10.578595749s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 23.290800142s FAIL (2025-09-09 12:43:20 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 12:39:03.275681631 (71h10m39.315254751s) [upload=62633]: Starting upload Sep 9 12:39:03.275744833 (71h10m39.315317953s) [upload=62633]: Done starting upload Sep 9 12:39:03.275813914 (71h10m39.315387034s) [upload=62633]: Uploading segments... Sep 9 12:39:03.276020751 (71h10m39.315593881s) [upload=62633]: Got next segment. Inline: false Sep 9 12:39:03.276059825 (71h10m39.315632945s) [upload=62633]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 12:39:03.276064905 (71h10m39.315638025s) [upload=62633]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 12:39:03.574977477 (71h10m39.614550597s) [seg_pos={0 0}, upload=62633]: Begin upload segment... Sep 9 12:39:03.575036299 (71h10m39.614609429s) [seg_pos={0 0}, upload=62633]: Done begin upload segment. Sep 9 12:39:03.575063682 (71h10m39.614636812s) [noise=true , address=45.91.116.9:4261 , piece_id=WF4VYUZGDPD4GUHX5BT3DZSROWO2MPVAFGFZIE2E2ERALA6JHFIA, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575076576 (71h10m39.614649706s) [noise=true , address=77.90.31.14:4662 , piece_id=ARN32V426TEKN2GM2ZS66PO4JBQ4Q5DWQTYVDGZCPEVTP46QNSSQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575131351 (71h10m39.614704481s) [noise=true , address=77.90.31.17:4772 , piece_id=DAHPPZUZ6N3QO5Y2EDNV4LIEUNBOC77ZCU5MPSTR6AVHH55HBFAA, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575469408 (71h10m39.615042528s) [noise=true , address=45.91.116.6:4975 , piece_id=5EFFI476IRLIQY3OHOXOFUQNEY243GW2O3B7JNW7MORNM6NSMM7A, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575492583 (71h10m39.615065703s) [noise=true , address=145.79.227.3:4149 , piece_id=TPKUKECXPPZVGYSZGKZZA2EY76NFBR3AXCX7CN43ZLD3CRU3NPKQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575758671 (71h10m39.615331791s) [noise=true , address=45.91.116.8:4045 , piece_id=FZMOZ7ZZPONGUGI253XFKFWKVMCJ5DMH6NX2URRG7FTY77VMDIEA, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.575834486 (71h10m39.615407606s) [noise=true , address=45.91.116.12:4226 , piece_id=D7IJNR4YK7DKPAOVMQXLQUUW37VEC44G5636GCPBCPWG3NILPEKQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.576036233 (71h10m39.615609353s) [noise=true , address=45.91.116.10:4082 , piece_id=XDE7HUJLJOTT2TM3PCCLFGNRNL54QMMAILBYGYQ43C2PJLTKCN2Q, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.576177162 (71h10m39.615750282s) [noise=true , address=145.79.227.15:4874 , piece_id=DXSLDJ3PO3EVSAAQHDXCMD6XX2JVR4UFFGC2O67TFM6HNAW7YKIA, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.576517223 (71h10m39.616090353s) [noise=true , address=145.79.227.19:4079 , piece_id=KHEYABXNGLKUJF6LMWCZPC2W5WVKHG4MO5TENST2YYRP5PK2K7XQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.577449077 (71h10m39.617022197s) [noise=true , address=45.91.116.13:4154 , piece_id=RVLGTPGQHZ7ZRVBFXFTTISCT5BC6GUG64IFM436LWFJOI4UG3Z2A, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.577556121 (71h10m39.617129241s) [noise=true , address=77.90.31.12:4592 , piece_id=HXE45P4FBCHOP3Q343YIEWTYWD4XKRF2NCLW4K3U33MYOGPXHDLQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.577841046 (71h10m39.617414177s) [noise=true , address=45.91.116.11:4119 , piece_id=D7SMP6SA7YE7MR2MM7ALKDPKX3KRRC37766S4CN4O7GCSGS5EAUQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.578169214 (71h10m39.617742334s) [noise=true , address=45.91.116.7:4009 , piece_id=3JVZNWDLPKF7VKTOEMYCVJYET67UE22PUJ3W3T3OM55SPZIVTWOQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.578915151 (71h10m39.618488272s) [noise=true , address=77.90.31.10:4518 , piece_id=TCZGT4LQQN4BVJRLOU2BFA336AOY5WIYBFSUBGCT3HZKM4K42IIQ, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:03.579242989 (71h10m39.618816109s) [noise=true , address=77.90.31.18:4806 , piece_id=NOZDTBYPWYRMX6RBZKXBOAA4FSIWCYIMYRYTF32DEVKJD5534CGA, seg_pos={0 0}, upload=62633]: Uploading piece... Sep 9 12:39:05.343785443 (71h10m41.383358563s) [upload=62633]: Next returned nil segment Sep 9 12:39:05.343803998 (71h10m41.383377118s) [upload=62633]: Waiting for error group managing segments... Sep 9 12:39:05.634702784 (71h10m41.674275905s) [noise=true , address=145.79.227.3:4149 , piece_id=TPKUKECXPPZVGYSZGKZZA2EY76NFBR3AXCX7CN43ZLD3CRU3NPKQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.753617109 (71h10m41.793190229s) [noise=true , address=45.91.116.12:4226 , piece_id=D7IJNR4YK7DKPAOVMQXLQUUW37VEC44G5636GCPBCPWG3NILPEKQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.773525196 (71h10m41.813098316s) [noise=true , address=45.91.116.7:4009 , piece_id=3JVZNWDLPKF7VKTOEMYCVJYET67UE22PUJ3W3T3OM55SPZIVTWOQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.774693902 (71h10m41.814267032s) [noise=true , address=45.91.116.11:4119 , piece_id=D7SMP6SA7YE7MR2MM7ALKDPKX3KRRC37766S4CN4O7GCSGS5EAUQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.782522974 (71h10m41.822096094s) [noise=true , address=77.90.31.10:4518 , piece_id=TCZGT4LQQN4BVJRLOU2BFA336AOY5WIYBFSUBGCT3HZKM4K42IIQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.788013982 (71h10m41.827587102s) [noise=true , address=45.91.116.10:4082 , piece_id=XDE7HUJLJOTT2TM3PCCLFGNRNL54QMMAILBYGYQ43C2PJLTKCN2Q, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.796754077 (71h10m41.836327197s) [noise=true , address=45.91.116.6:4975 , piece_id=5EFFI476IRLIQY3OHOXOFUQNEY243GW2O3B7JNW7MORNM6NSMM7A, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.798665846 (71h10m41.838238966s) [noise=true , address=145.79.227.19:4079 , piece_id=KHEYABXNGLKUJF6LMWCZPC2W5WVKHG4MO5TENST2YYRP5PK2K7XQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.800799498 (71h10m41.840372629s) [noise=true , address=77.90.31.18:4806 , piece_id=NOZDTBYPWYRMX6RBZKXBOAA4FSIWCYIMYRYTF32DEVKJD5534CGA, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.807325617 (71h10m41.846898737s) [noise=true , address=45.91.116.9:4261 , piece_id=WF4VYUZGDPD4GUHX5BT3DZSROWO2MPVAFGFZIE2E2ERALA6JHFIA, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.837434272 (71h10m41.877007392s) [noise=true , address=45.91.116.13:4154 , piece_id=RVLGTPGQHZ7ZRVBFXFTTISCT5BC6GUG64IFM436LWFJOI4UG3Z2A, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.839825218 (71h10m41.879398338s) [noise=true , address=45.91.116.8:4045 , piece_id=FZMOZ7ZZPONGUGI253XFKFWKVMCJ5DMH6NX2URRG7FTY77VMDIEA, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.844431272 (71h10m41.884004392s) [noise=true , address=77.90.31.14:4662 , piece_id=ARN32V426TEKN2GM2ZS66PO4JBQ4Q5DWQTYVDGZCPEVTP46QNSSQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: <nil> Sep 9 12:39:05.844465007 (71h10m41.884038127s) [seg_pos={0 0}, upload=62633]: Segment reached optimal threshold of 13 pieces. Sep 9 12:39:05.844600095 (71h10m41.884173225s) [noise=true , address=77.90.31.12:4592 , piece_id=HXE45P4FBCHOP3Q343YIEWTYWD4XKRF2NCLW4K3U33MYOGPXHDLQ, seg_pos={0 0}, upload=62633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Sep 9 12:39:05.844613632 (71h10m41.884186752s) [noise=true , address=77.90.31.17:4772 , piece_id=DAHPPZUZ6N3QO5Y2EDNV4LIEUNBOC77ZCU5MPSTR6AVHH55HBFAA, seg_pos={0 0}, upload=62633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: expected piece hash; context canceled; EOF Sep 9 12:39:05.844719895 (71h10m41.884293025s) [noise=true , address=145.79.227.15:4874 , piece_id=DXSLDJ3PO3EVSAAQHDXCMD6XX2JVR4UFFGC2O67TFM6HNAW7YKIA, seg_pos={0 0}, upload=62633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 9 12:39:05.844747638 (71h10m41.884320768s) [seg_pos={0 0}, upload=62633]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 12:39:05.844823833 (71h10m41.884396953s) [upload=62633]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 12:39:05.844830386 (71h10m41.884403506s) [upload=62633]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 12:39:06.236723527 (71h10m42.276296647s) [upload=62633]: Done uploading segments... Sep 9 12:39:06.236742012 (71h10m42.276315132s) [upload=62633]: Upload finished. err: <nil> Duration: 23.290826773s core uplink us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)