Orbiter History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 4.895707178s FAIL (2025-08-26 09:34:07 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 4.89573403s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......................X...X................................] duration: 5.879860078s FAIL (2025-08-26 09:33:34 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Aug 26 09:12:27.460801938 (17h8m54.619567672s) [upload=14994]: Starting upload Aug 26 09:12:27.460861261 (17h8m54.619626995s) [upload=14994]: Done starting upload Aug 26 09:12:27.460967244 (17h8m54.619732978s) [upload=14994]: Uploading segments... Aug 26 09:12:27.461061044 (17h8m54.619826768s) [upload=14994]: Got next segment. Inline: false Aug 26 09:12:27.461137420 (17h8m54.619903154s) [upload=14994]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 09:12:27.461142410 (17h8m54.619908144s) [upload=14994]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 09:12:27.911433899 (17h8m55.070199633s) [seg_pos={0 0}, upload=14994]: Begin upload segment... Aug 26 09:12:27.911481470 (17h8m55.070247204s) [seg_pos={0 0}, upload=14994]: Done begin upload segment. Aug 26 09:12:27.911501920 (17h8m55.070267654s) [noise=true , address=104.36.82.7:4912 , piece_id=OYVJF5VJJMZGE6E2JREPMGIZGWKQQWAHK4WCUHXFATZZGJXFJW2Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.911554130 (17h8m55.070319904s) [noise=true , address=45.91.116.14:4191 , piece_id=YO65KQXJOPP2BVDRQTEURGV2RDY3M36W4JSPPBTM6LKVHZ7UIEXA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.911868270 (17h8m55.070634004s) [noise=true , address=45.91.116.11:4119 , piece_id=RRRPLNZBTVHIQTUMONDVTIBCMEBLBM2RPFCOHX7RBX4HFGZUYS3Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912181570 (17h8m55.070947305s) [noise=true , address=45.91.116.10:4081 , piece_id=YYCAJYYQ4MXTVLBHWA6R66TIAHAEJOUQ7BBH6A3PVB56MCXUXCDA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912244641 (17h8m55.071010365s) [noise=true , address=77.90.31.16:4735 , piece_id=F5ZXRAIRT3GGYVDCOHQWEAWDTJ5DN2OF2AW5YB3W3MTHTUUTVJ6Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912475152 (17h8m55.071240886s) [noise=true , address=45.91.116.5:4299 , piece_id=G2JPCAKEMRINSSYZ24B362KA54Q2T6HDEGJQFHVWNEJGGFGRR2KA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912684673 (17h8m55.071450407s) [noise=true , address=45.91.116.9:4262 , piece_id=WRDGDP5TBAYZTRPBYDW4ZESCR7NJJHVBU6WP4UYC4B3V5D7ICOMA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912718718 (17h8m55.071484452s) [noise=true , address=77.90.31.18:4806 , piece_id=RRTHOAKZSK6ZKWLXCMODWX5HZ5I62OMUEBB64FS6RSDLMNL2OESA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912890155 (17h8m55.071655889s) [noise=true , address=45.91.116.4:4937 , piece_id=AZQ6DES5FGD63E56HNPDEOJJUZNKOF3ZYU33OMOUX47L7ZGYXISQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912973765 (17h8m55.071739499s) [noise=true , address=104.36.82.4:4802 , piece_id=6TH5NRIXI5GLRDDZDKZJZWPQYCK7BTMF2U5TDQYOV3SL227M6IZA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913095419 (17h8m55.071861153s) [noise=true , address=104.36.82.10:4079 , piece_id=RSWLIXFVVRXKXD6TI4TDKEPW3HY6XU5AUAAH5N3X4UIFNEU3H5CQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913202434 (17h8m55.071968168s) [noise=true , address=77.90.31.15:4697 , piece_id=VLJCK73RVDCWWPAC7HUVHLQV2AYUPRYNEA7SNSO7P2ZMRK2FOLSQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913320449 (17h8m55.072086183s) [noise=true , address=45.91.116.9:4263 , piece_id=RYI4SAUA6IXKXAAHC62LDOKQUKQNTEG7QCG4QHUGMSREVGWEMNGA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913452622 (17h8m55.072218356s) [noise=true , address=77.90.31.12:4592 , piece_id=4RLI6WE2HS6N2QRLJQZXSYG65EIMVROLJVYNW56CSY254ZLREUYA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913534449 (17h8m55.072300183s) [noise=true , address=104.36.82.8:4971 , piece_id=UZT2NT7JR4F7NIXPSY2ORFBQVJOXZSPEJCSLFAHPH4BDSLY2W3DA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913650701 (17h8m55.072416435s) [noise=true , address=77.90.31.12:4589 , piece_id=L6ZTZ5PJPV2WM2BZGGAJEKBS4B2TS5S55PSD7WGA2YRH3MTLG5GA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:29.900914740 (17h8m57.059680464s) [upload=14994]: Next returned nil segment Aug 26 09:12:29.900934336 (17h8m57.059700081s) [upload=14994]: Waiting for error group managing segments... Aug 26 09:12:30.221707715 (17h8m57.380473449s) [noise=true , address=77.90.31.18:4806 , piece_id=RRTHOAKZSK6ZKWLXCMODWX5HZ5I62OMUEBB64FS6RSDLMNL2OESA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.225253190 (17h8m57.384018924s) [noise=true , address=77.90.31.12:4592 , piece_id=4RLI6WE2HS6N2QRLJQZXSYG65EIMVROLJVYNW56CSY254ZLREUYA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.228153169 (17h8m57.386918893s) [noise=true , address=45.91.116.4:4937 , piece_id=AZQ6DES5FGD63E56HNPDEOJJUZNKOF3ZYU33OMOUX47L7ZGYXISQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.244451243 (17h8m57.403216977s) [noise=true , address=45.91.116.9:4263 , piece_id=RYI4SAUA6IXKXAAHC62LDOKQUKQNTEG7QCG4QHUGMSREVGWEMNGA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.274597415 (17h8m57.433363149s) [noise=true , address=45.91.116.5:4299 , piece_id=G2JPCAKEMRINSSYZ24B362KA54Q2T6HDEGJQFHVWNEJGGFGRR2KA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.280700783 (17h8m57.439466517s) [noise=true , address=104.36.82.4:4802 , piece_id=6TH5NRIXI5GLRDDZDKZJZWPQYCK7BTMF2U5TDQYOV3SL227M6IZA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.294073090 (17h8m57.452838824s) [noise=true , address=104.36.82.7:4912 , piece_id=OYVJF5VJJMZGE6E2JREPMGIZGWKQQWAHK4WCUHXFATZZGJXFJW2Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.310065069 (17h8m57.468830803s) [noise=true , address=104.36.82.8:4971 , piece_id=UZT2NT7JR4F7NIXPSY2ORFBQVJOXZSPEJCSLFAHPH4BDSLY2W3DA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.310725412 (17h8m57.469491146s) [noise=true , address=45.91.116.10:4081 , piece_id=YYCAJYYQ4MXTVLBHWA6R66TIAHAEJOUQ7BBH6A3PVB56MCXUXCDA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.327312570 (17h8m57.486078304s) [noise=true , address=77.90.31.15:4697 , piece_id=VLJCK73RVDCWWPAC7HUVHLQV2AYUPRYNEA7SNSO7P2ZMRK2FOLSQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.371703187 (17h8m57.530468921s) [noise=true , address=77.90.31.16:4735 , piece_id=F5ZXRAIRT3GGYVDCOHQWEAWDTJ5DN2OF2AW5YB3W3MTHTUUTVJ6Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.427020261 (17h8m57.585785996s) [noise=true , address=45.91.116.11:4119 , piece_id=RRRPLNZBTVHIQTUMONDVTIBCMEBLBM2RPFCOHX7RBX4HFGZUYS3Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.436406982 (17h8m57.595172716s) [noise=true , address=45.91.116.14:4191 , piece_id=YO65KQXJOPP2BVDRQTEURGV2RDY3M36W4JSPPBTM6LKVHZ7UIEXA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.436435246 (17h8m57.59520098s) [seg_pos={0 0}, upload=14994]: Segment reached optimal threshold of 13 pieces. Aug 26 09:12:30.436615631 (17h8m57.595381365s) [noise=true , address=77.90.31.12:4589 , piece_id=L6ZTZ5PJPV2WM2BZGGAJEKBS4B2TS5S55PSD7WGA2YRH3MTLG5GA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv): protocol: expected piece hash; context canceled; EOF Aug 26 09:12:30.436693600 (17h8m57.595459334s) [noise=true , address=45.91.116.9:4262 , piece_id=WRDGDP5TBAYZTRPBYDW4ZESCR7NJJHVBU6WP4UYC4B3V5D7ICOMA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto): protocol: write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection; write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection Aug 26 09:12:30.436700754 (17h8m57.595466488s) [noise=true , address=104.36.82.10:4079 , piece_id=RSWLIXFVVRXKXD6TI4TDKEPW3HY6XU5AUAAH5N3X4UIFNEU3H5CQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF Aug 26 09:12:30.436750138 (17h8m57.595515872s) [seg_pos={0 0}, upload=14994]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 26 09:12:30.436849909 (17h8m57.595615643s) [upload=14994]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 09:12:30.436855740 (17h8m57.595621474s) [upload=14994]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 09:12:30.739827348 (17h8m57.898593082s) [upload=14994]: Done uploading segments... Aug 26 09:12:30.739846063 (17h8m57.898611797s) [upload=14994]: Upload finished. err: <nil> Duration: 5.879883081s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 5.038715002s FAIL (2025-08-26 09:33:27 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 5.038739891s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [........................X...X...............................] duration: 5.772616916s FAIL (2025-08-26 09:33:18 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Aug 26 09:12:27.460801938 (17h8m54.619567672s) [upload=14994]: Starting upload Aug 26 09:12:27.460861261 (17h8m54.619626995s) [upload=14994]: Done starting upload Aug 26 09:12:27.460967244 (17h8m54.619732978s) [upload=14994]: Uploading segments... Aug 26 09:12:27.461061044 (17h8m54.619826768s) [upload=14994]: Got next segment. Inline: false Aug 26 09:12:27.461137420 (17h8m54.619903154s) [upload=14994]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 09:12:27.461142410 (17h8m54.619908144s) [upload=14994]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 09:12:27.911433899 (17h8m55.070199633s) [seg_pos={0 0}, upload=14994]: Begin upload segment... Aug 26 09:12:27.911481470 (17h8m55.070247204s) [seg_pos={0 0}, upload=14994]: Done begin upload segment. Aug 26 09:12:27.911501920 (17h8m55.070267654s) [noise=true , address=104.36.82.7:4912 , piece_id=OYVJF5VJJMZGE6E2JREPMGIZGWKQQWAHK4WCUHXFATZZGJXFJW2Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.911554130 (17h8m55.070319904s) [noise=true , address=45.91.116.14:4191 , piece_id=YO65KQXJOPP2BVDRQTEURGV2RDY3M36W4JSPPBTM6LKVHZ7UIEXA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.911868270 (17h8m55.070634004s) [noise=true , address=45.91.116.11:4119 , piece_id=RRRPLNZBTVHIQTUMONDVTIBCMEBLBM2RPFCOHX7RBX4HFGZUYS3Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912181570 (17h8m55.070947305s) [noise=true , address=45.91.116.10:4081 , piece_id=YYCAJYYQ4MXTVLBHWA6R66TIAHAEJOUQ7BBH6A3PVB56MCXUXCDA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912244641 (17h8m55.071010365s) [noise=true , address=77.90.31.16:4735 , piece_id=F5ZXRAIRT3GGYVDCOHQWEAWDTJ5DN2OF2AW5YB3W3MTHTUUTVJ6Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912475152 (17h8m55.071240886s) [noise=true , address=45.91.116.5:4299 , piece_id=G2JPCAKEMRINSSYZ24B362KA54Q2T6HDEGJQFHVWNEJGGFGRR2KA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912684673 (17h8m55.071450407s) [noise=true , address=45.91.116.9:4262 , piece_id=WRDGDP5TBAYZTRPBYDW4ZESCR7NJJHVBU6WP4UYC4B3V5D7ICOMA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912718718 (17h8m55.071484452s) [noise=true , address=77.90.31.18:4806 , piece_id=RRTHOAKZSK6ZKWLXCMODWX5HZ5I62OMUEBB64FS6RSDLMNL2OESA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912890155 (17h8m55.071655889s) [noise=true , address=45.91.116.4:4937 , piece_id=AZQ6DES5FGD63E56HNPDEOJJUZNKOF3ZYU33OMOUX47L7ZGYXISQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912973765 (17h8m55.071739499s) [noise=true , address=104.36.82.4:4802 , piece_id=6TH5NRIXI5GLRDDZDKZJZWPQYCK7BTMF2U5TDQYOV3SL227M6IZA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913095419 (17h8m55.071861153s) [noise=true , address=104.36.82.10:4079 , piece_id=RSWLIXFVVRXKXD6TI4TDKEPW3HY6XU5AUAAH5N3X4UIFNEU3H5CQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913202434 (17h8m55.071968168s) [noise=true , address=77.90.31.15:4697 , piece_id=VLJCK73RVDCWWPAC7HUVHLQV2AYUPRYNEA7SNSO7P2ZMRK2FOLSQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913320449 (17h8m55.072086183s) [noise=true , address=45.91.116.9:4263 , piece_id=RYI4SAUA6IXKXAAHC62LDOKQUKQNTEG7QCG4QHUGMSREVGWEMNGA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913452622 (17h8m55.072218356s) [noise=true , address=77.90.31.12:4592 , piece_id=4RLI6WE2HS6N2QRLJQZXSYG65EIMVROLJVYNW56CSY254ZLREUYA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913534449 (17h8m55.072300183s) [noise=true , address=104.36.82.8:4971 , piece_id=UZT2NT7JR4F7NIXPSY2ORFBQVJOXZSPEJCSLFAHPH4BDSLY2W3DA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913650701 (17h8m55.072416435s) [noise=true , address=77.90.31.12:4589 , piece_id=L6ZTZ5PJPV2WM2BZGGAJEKBS4B2TS5S55PSD7WGA2YRH3MTLG5GA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:29.900914740 (17h8m57.059680464s) [upload=14994]: Next returned nil segment Aug 26 09:12:29.900934336 (17h8m57.059700081s) [upload=14994]: Waiting for error group managing segments... Aug 26 09:12:30.221707715 (17h8m57.380473449s) [noise=true , address=77.90.31.18:4806 , piece_id=RRTHOAKZSK6ZKWLXCMODWX5HZ5I62OMUEBB64FS6RSDLMNL2OESA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.225253190 (17h8m57.384018924s) [noise=true , address=77.90.31.12:4592 , piece_id=4RLI6WE2HS6N2QRLJQZXSYG65EIMVROLJVYNW56CSY254ZLREUYA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.228153169 (17h8m57.386918893s) [noise=true , address=45.91.116.4:4937 , piece_id=AZQ6DES5FGD63E56HNPDEOJJUZNKOF3ZYU33OMOUX47L7ZGYXISQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.244451243 (17h8m57.403216977s) [noise=true , address=45.91.116.9:4263 , piece_id=RYI4SAUA6IXKXAAHC62LDOKQUKQNTEG7QCG4QHUGMSREVGWEMNGA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.274597415 (17h8m57.433363149s) [noise=true , address=45.91.116.5:4299 , piece_id=G2JPCAKEMRINSSYZ24B362KA54Q2T6HDEGJQFHVWNEJGGFGRR2KA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.280700783 (17h8m57.439466517s) [noise=true , address=104.36.82.4:4802 , piece_id=6TH5NRIXI5GLRDDZDKZJZWPQYCK7BTMF2U5TDQYOV3SL227M6IZA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.294073090 (17h8m57.452838824s) [noise=true , address=104.36.82.7:4912 , piece_id=OYVJF5VJJMZGE6E2JREPMGIZGWKQQWAHK4WCUHXFATZZGJXFJW2Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.310065069 (17h8m57.468830803s) [noise=true , address=104.36.82.8:4971 , piece_id=UZT2NT7JR4F7NIXPSY2ORFBQVJOXZSPEJCSLFAHPH4BDSLY2W3DA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.310725412 (17h8m57.469491146s) [noise=true , address=45.91.116.10:4081 , piece_id=YYCAJYYQ4MXTVLBHWA6R66TIAHAEJOUQ7BBH6A3PVB56MCXUXCDA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.327312570 (17h8m57.486078304s) [noise=true , address=77.90.31.15:4697 , piece_id=VLJCK73RVDCWWPAC7HUVHLQV2AYUPRYNEA7SNSO7P2ZMRK2FOLSQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.371703187 (17h8m57.530468921s) [noise=true , address=77.90.31.16:4735 , piece_id=F5ZXRAIRT3GGYVDCOHQWEAWDTJ5DN2OF2AW5YB3W3MTHTUUTVJ6Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.427020261 (17h8m57.585785996s) [noise=true , address=45.91.116.11:4119 , piece_id=RRRPLNZBTVHIQTUMONDVTIBCMEBLBM2RPFCOHX7RBX4HFGZUYS3Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.436406982 (17h8m57.595172716s) [noise=true , address=45.91.116.14:4191 , piece_id=YO65KQXJOPP2BVDRQTEURGV2RDY3M36W4JSPPBTM6LKVHZ7UIEXA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.436435246 (17h8m57.59520098s) [seg_pos={0 0}, upload=14994]: Segment reached optimal threshold of 13 pieces. Aug 26 09:12:30.436615631 (17h8m57.595381365s) [noise=true , address=77.90.31.12:4589 , piece_id=L6ZTZ5PJPV2WM2BZGGAJEKBS4B2TS5S55PSD7WGA2YRH3MTLG5GA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv): protocol: expected piece hash; context canceled; EOF Aug 26 09:12:30.436693600 (17h8m57.595459334s) [noise=true , address=45.91.116.9:4262 , piece_id=WRDGDP5TBAYZTRPBYDW4ZESCR7NJJHVBU6WP4UYC4B3V5D7ICOMA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto): protocol: write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection; write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection Aug 26 09:12:30.436700754 (17h8m57.595466488s) [noise=true , address=104.36.82.10:4079 , piece_id=RSWLIXFVVRXKXD6TI4TDKEPW3HY6XU5AUAAH5N3X4UIFNEU3H5CQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF Aug 26 09:12:30.436750138 (17h8m57.595515872s) [seg_pos={0 0}, upload=14994]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 26 09:12:30.436849909 (17h8m57.595615643s) [upload=14994]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 09:12:30.436855740 (17h8m57.595621474s) [upload=14994]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 09:12:30.739827348 (17h8m57.898593082s) [upload=14994]: Done uploading segments... Aug 26 09:12:30.739846063 (17h8m57.898611797s) [upload=14994]: Upload finished. err: <nil> Duration: 5.772646853s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 5.006789841s FAIL (2025-08-26 09:33:05 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 5.006816964s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........................X...X..............................] duration: 5.741485773s FAIL (2025-08-26 09:32:59 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Aug 26 09:12:27.460801938 (17h8m54.619567672s) [upload=14994]: Starting upload Aug 26 09:12:27.460861261 (17h8m54.619626995s) [upload=14994]: Done starting upload Aug 26 09:12:27.460967244 (17h8m54.619732978s) [upload=14994]: Uploading segments... Aug 26 09:12:27.461061044 (17h8m54.619826768s) [upload=14994]: Got next segment. Inline: false Aug 26 09:12:27.461137420 (17h8m54.619903154s) [upload=14994]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 09:12:27.461142410 (17h8m54.619908144s) [upload=14994]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 09:12:27.911433899 (17h8m55.070199633s) [seg_pos={0 0}, upload=14994]: Begin upload segment... Aug 26 09:12:27.911481470 (17h8m55.070247204s) [seg_pos={0 0}, upload=14994]: Done begin upload segment. Aug 26 09:12:27.911501920 (17h8m55.070267654s) [noise=true , address=104.36.82.7:4912 , piece_id=OYVJF5VJJMZGE6E2JREPMGIZGWKQQWAHK4WCUHXFATZZGJXFJW2Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.911554130 (17h8m55.070319904s) [noise=true , address=45.91.116.14:4191 , piece_id=YO65KQXJOPP2BVDRQTEURGV2RDY3M36W4JSPPBTM6LKVHZ7UIEXA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.911868270 (17h8m55.070634004s) [noise=true , address=45.91.116.11:4119 , piece_id=RRRPLNZBTVHIQTUMONDVTIBCMEBLBM2RPFCOHX7RBX4HFGZUYS3Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912181570 (17h8m55.070947305s) [noise=true , address=45.91.116.10:4081 , piece_id=YYCAJYYQ4MXTVLBHWA6R66TIAHAEJOUQ7BBH6A3PVB56MCXUXCDA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912244641 (17h8m55.071010365s) [noise=true , address=77.90.31.16:4735 , piece_id=F5ZXRAIRT3GGYVDCOHQWEAWDTJ5DN2OF2AW5YB3W3MTHTUUTVJ6Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912475152 (17h8m55.071240886s) [noise=true , address=45.91.116.5:4299 , piece_id=G2JPCAKEMRINSSYZ24B362KA54Q2T6HDEGJQFHVWNEJGGFGRR2KA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912684673 (17h8m55.071450407s) [noise=true , address=45.91.116.9:4262 , piece_id=WRDGDP5TBAYZTRPBYDW4ZESCR7NJJHVBU6WP4UYC4B3V5D7ICOMA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912718718 (17h8m55.071484452s) [noise=true , address=77.90.31.18:4806 , piece_id=RRTHOAKZSK6ZKWLXCMODWX5HZ5I62OMUEBB64FS6RSDLMNL2OESA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912890155 (17h8m55.071655889s) [noise=true , address=45.91.116.4:4937 , piece_id=AZQ6DES5FGD63E56HNPDEOJJUZNKOF3ZYU33OMOUX47L7ZGYXISQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912973765 (17h8m55.071739499s) [noise=true , address=104.36.82.4:4802 , piece_id=6TH5NRIXI5GLRDDZDKZJZWPQYCK7BTMF2U5TDQYOV3SL227M6IZA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913095419 (17h8m55.071861153s) [noise=true , address=104.36.82.10:4079 , piece_id=RSWLIXFVVRXKXD6TI4TDKEPW3HY6XU5AUAAH5N3X4UIFNEU3H5CQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913202434 (17h8m55.071968168s) [noise=true , address=77.90.31.15:4697 , piece_id=VLJCK73RVDCWWPAC7HUVHLQV2AYUPRYNEA7SNSO7P2ZMRK2FOLSQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913320449 (17h8m55.072086183s) [noise=true , address=45.91.116.9:4263 , piece_id=RYI4SAUA6IXKXAAHC62LDOKQUKQNTEG7QCG4QHUGMSREVGWEMNGA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913452622 (17h8m55.072218356s) [noise=true , address=77.90.31.12:4592 , piece_id=4RLI6WE2HS6N2QRLJQZXSYG65EIMVROLJVYNW56CSY254ZLREUYA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913534449 (17h8m55.072300183s) [noise=true , address=104.36.82.8:4971 , piece_id=UZT2NT7JR4F7NIXPSY2ORFBQVJOXZSPEJCSLFAHPH4BDSLY2W3DA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913650701 (17h8m55.072416435s) [noise=true , address=77.90.31.12:4589 , piece_id=L6ZTZ5PJPV2WM2BZGGAJEKBS4B2TS5S55PSD7WGA2YRH3MTLG5GA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:29.900914740 (17h8m57.059680464s) [upload=14994]: Next returned nil segment Aug 26 09:12:29.900934336 (17h8m57.059700081s) [upload=14994]: Waiting for error group managing segments... Aug 26 09:12:30.221707715 (17h8m57.380473449s) [noise=true , address=77.90.31.18:4806 , piece_id=RRTHOAKZSK6ZKWLXCMODWX5HZ5I62OMUEBB64FS6RSDLMNL2OESA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.225253190 (17h8m57.384018924s) [noise=true , address=77.90.31.12:4592 , piece_id=4RLI6WE2HS6N2QRLJQZXSYG65EIMVROLJVYNW56CSY254ZLREUYA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.228153169 (17h8m57.386918893s) [noise=true , address=45.91.116.4:4937 , piece_id=AZQ6DES5FGD63E56HNPDEOJJUZNKOF3ZYU33OMOUX47L7ZGYXISQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.244451243 (17h8m57.403216977s) [noise=true , address=45.91.116.9:4263 , piece_id=RYI4SAUA6IXKXAAHC62LDOKQUKQNTEG7QCG4QHUGMSREVGWEMNGA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.274597415 (17h8m57.433363149s) [noise=true , address=45.91.116.5:4299 , piece_id=G2JPCAKEMRINSSYZ24B362KA54Q2T6HDEGJQFHVWNEJGGFGRR2KA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.280700783 (17h8m57.439466517s) [noise=true , address=104.36.82.4:4802 , piece_id=6TH5NRIXI5GLRDDZDKZJZWPQYCK7BTMF2U5TDQYOV3SL227M6IZA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.294073090 (17h8m57.452838824s) [noise=true , address=104.36.82.7:4912 , piece_id=OYVJF5VJJMZGE6E2JREPMGIZGWKQQWAHK4WCUHXFATZZGJXFJW2Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.310065069 (17h8m57.468830803s) [noise=true , address=104.36.82.8:4971 , piece_id=UZT2NT7JR4F7NIXPSY2ORFBQVJOXZSPEJCSLFAHPH4BDSLY2W3DA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.310725412 (17h8m57.469491146s) [noise=true , address=45.91.116.10:4081 , piece_id=YYCAJYYQ4MXTVLBHWA6R66TIAHAEJOUQ7BBH6A3PVB56MCXUXCDA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.327312570 (17h8m57.486078304s) [noise=true , address=77.90.31.15:4697 , piece_id=VLJCK73RVDCWWPAC7HUVHLQV2AYUPRYNEA7SNSO7P2ZMRK2FOLSQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.371703187 (17h8m57.530468921s) [noise=true , address=77.90.31.16:4735 , piece_id=F5ZXRAIRT3GGYVDCOHQWEAWDTJ5DN2OF2AW5YB3W3MTHTUUTVJ6Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.427020261 (17h8m57.585785996s) [noise=true , address=45.91.116.11:4119 , piece_id=RRRPLNZBTVHIQTUMONDVTIBCMEBLBM2RPFCOHX7RBX4HFGZUYS3Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.436406982 (17h8m57.595172716s) [noise=true , address=45.91.116.14:4191 , piece_id=YO65KQXJOPP2BVDRQTEURGV2RDY3M36W4JSPPBTM6LKVHZ7UIEXA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.436435246 (17h8m57.59520098s) [seg_pos={0 0}, upload=14994]: Segment reached optimal threshold of 13 pieces. Aug 26 09:12:30.436615631 (17h8m57.595381365s) [noise=true , address=77.90.31.12:4589 , piece_id=L6ZTZ5PJPV2WM2BZGGAJEKBS4B2TS5S55PSD7WGA2YRH3MTLG5GA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv): protocol: expected piece hash; context canceled; EOF Aug 26 09:12:30.436693600 (17h8m57.595459334s) [noise=true , address=45.91.116.9:4262 , piece_id=WRDGDP5TBAYZTRPBYDW4ZESCR7NJJHVBU6WP4UYC4B3V5D7ICOMA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto): protocol: write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection; write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection Aug 26 09:12:30.436700754 (17h8m57.595466488s) [noise=true , address=104.36.82.10:4079 , piece_id=RSWLIXFVVRXKXD6TI4TDKEPW3HY6XU5AUAAH5N3X4UIFNEU3H5CQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF Aug 26 09:12:30.436750138 (17h8m57.595515872s) [seg_pos={0 0}, upload=14994]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 26 09:12:30.436849909 (17h8m57.595615643s) [upload=14994]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 09:12:30.436855740 (17h8m57.595621474s) [upload=14994]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 09:12:30.739827348 (17h8m57.898593082s) [upload=14994]: Done uploading segments... Aug 26 09:12:30.739846063 (17h8m57.898611797s) [upload=14994]: Upload finished. err: <nil> Duration: 5.741513807s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........................X...X.............................] duration: 5.841793905s FAIL (2025-08-26 09:32:38 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Aug 26 09:12:27.460801938 (17h8m54.619567672s) [upload=14994]: Starting upload Aug 26 09:12:27.460861261 (17h8m54.619626995s) [upload=14994]: Done starting upload Aug 26 09:12:27.460967244 (17h8m54.619732978s) [upload=14994]: Uploading segments... Aug 26 09:12:27.461061044 (17h8m54.619826768s) [upload=14994]: Got next segment. Inline: false Aug 26 09:12:27.461137420 (17h8m54.619903154s) [upload=14994]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 09:12:27.461142410 (17h8m54.619908144s) [upload=14994]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 09:12:27.911433899 (17h8m55.070199633s) [seg_pos={0 0}, upload=14994]: Begin upload segment... Aug 26 09:12:27.911481470 (17h8m55.070247204s) [seg_pos={0 0}, upload=14994]: Done begin upload segment. Aug 26 09:12:27.911501920 (17h8m55.070267654s) [noise=true , address=104.36.82.7:4912 , piece_id=OYVJF5VJJMZGE6E2JREPMGIZGWKQQWAHK4WCUHXFATZZGJXFJW2Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.911554130 (17h8m55.070319904s) [noise=true , address=45.91.116.14:4191 , piece_id=YO65KQXJOPP2BVDRQTEURGV2RDY3M36W4JSPPBTM6LKVHZ7UIEXA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.911868270 (17h8m55.070634004s) [noise=true , address=45.91.116.11:4119 , piece_id=RRRPLNZBTVHIQTUMONDVTIBCMEBLBM2RPFCOHX7RBX4HFGZUYS3Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912181570 (17h8m55.070947305s) [noise=true , address=45.91.116.10:4081 , piece_id=YYCAJYYQ4MXTVLBHWA6R66TIAHAEJOUQ7BBH6A3PVB56MCXUXCDA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912244641 (17h8m55.071010365s) [noise=true , address=77.90.31.16:4735 , piece_id=F5ZXRAIRT3GGYVDCOHQWEAWDTJ5DN2OF2AW5YB3W3MTHTUUTVJ6Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912475152 (17h8m55.071240886s) [noise=true , address=45.91.116.5:4299 , piece_id=G2JPCAKEMRINSSYZ24B362KA54Q2T6HDEGJQFHVWNEJGGFGRR2KA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912684673 (17h8m55.071450407s) [noise=true , address=45.91.116.9:4262 , piece_id=WRDGDP5TBAYZTRPBYDW4ZESCR7NJJHVBU6WP4UYC4B3V5D7ICOMA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912718718 (17h8m55.071484452s) [noise=true , address=77.90.31.18:4806 , piece_id=RRTHOAKZSK6ZKWLXCMODWX5HZ5I62OMUEBB64FS6RSDLMNL2OESA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912890155 (17h8m55.071655889s) [noise=true , address=45.91.116.4:4937 , piece_id=AZQ6DES5FGD63E56HNPDEOJJUZNKOF3ZYU33OMOUX47L7ZGYXISQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912973765 (17h8m55.071739499s) [noise=true , address=104.36.82.4:4802 , piece_id=6TH5NRIXI5GLRDDZDKZJZWPQYCK7BTMF2U5TDQYOV3SL227M6IZA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913095419 (17h8m55.071861153s) [noise=true , address=104.36.82.10:4079 , piece_id=RSWLIXFVVRXKXD6TI4TDKEPW3HY6XU5AUAAH5N3X4UIFNEU3H5CQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913202434 (17h8m55.071968168s) [noise=true , address=77.90.31.15:4697 , piece_id=VLJCK73RVDCWWPAC7HUVHLQV2AYUPRYNEA7SNSO7P2ZMRK2FOLSQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913320449 (17h8m55.072086183s) [noise=true , address=45.91.116.9:4263 , piece_id=RYI4SAUA6IXKXAAHC62LDOKQUKQNTEG7QCG4QHUGMSREVGWEMNGA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913452622 (17h8m55.072218356s) [noise=true , address=77.90.31.12:4592 , piece_id=4RLI6WE2HS6N2QRLJQZXSYG65EIMVROLJVYNW56CSY254ZLREUYA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913534449 (17h8m55.072300183s) [noise=true , address=104.36.82.8:4971 , piece_id=UZT2NT7JR4F7NIXPSY2ORFBQVJOXZSPEJCSLFAHPH4BDSLY2W3DA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913650701 (17h8m55.072416435s) [noise=true , address=77.90.31.12:4589 , piece_id=L6ZTZ5PJPV2WM2BZGGAJEKBS4B2TS5S55PSD7WGA2YRH3MTLG5GA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:29.900914740 (17h8m57.059680464s) [upload=14994]: Next returned nil segment Aug 26 09:12:29.900934336 (17h8m57.059700081s) [upload=14994]: Waiting for error group managing segments... Aug 26 09:12:30.221707715 (17h8m57.380473449s) [noise=true , address=77.90.31.18:4806 , piece_id=RRTHOAKZSK6ZKWLXCMODWX5HZ5I62OMUEBB64FS6RSDLMNL2OESA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.225253190 (17h8m57.384018924s) [noise=true , address=77.90.31.12:4592 , piece_id=4RLI6WE2HS6N2QRLJQZXSYG65EIMVROLJVYNW56CSY254ZLREUYA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.228153169 (17h8m57.386918893s) [noise=true , address=45.91.116.4:4937 , piece_id=AZQ6DES5FGD63E56HNPDEOJJUZNKOF3ZYU33OMOUX47L7ZGYXISQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.244451243 (17h8m57.403216977s) [noise=true , address=45.91.116.9:4263 , piece_id=RYI4SAUA6IXKXAAHC62LDOKQUKQNTEG7QCG4QHUGMSREVGWEMNGA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.274597415 (17h8m57.433363149s) [noise=true , address=45.91.116.5:4299 , piece_id=G2JPCAKEMRINSSYZ24B362KA54Q2T6HDEGJQFHVWNEJGGFGRR2KA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.280700783 (17h8m57.439466517s) [noise=true , address=104.36.82.4:4802 , piece_id=6TH5NRIXI5GLRDDZDKZJZWPQYCK7BTMF2U5TDQYOV3SL227M6IZA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.294073090 (17h8m57.452838824s) [noise=true , address=104.36.82.7:4912 , piece_id=OYVJF5VJJMZGE6E2JREPMGIZGWKQQWAHK4WCUHXFATZZGJXFJW2Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.310065069 (17h8m57.468830803s) [noise=true , address=104.36.82.8:4971 , piece_id=UZT2NT7JR4F7NIXPSY2ORFBQVJOXZSPEJCSLFAHPH4BDSLY2W3DA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.310725412 (17h8m57.469491146s) [noise=true , address=45.91.116.10:4081 , piece_id=YYCAJYYQ4MXTVLBHWA6R66TIAHAEJOUQ7BBH6A3PVB56MCXUXCDA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.327312570 (17h8m57.486078304s) [noise=true , address=77.90.31.15:4697 , piece_id=VLJCK73RVDCWWPAC7HUVHLQV2AYUPRYNEA7SNSO7P2ZMRK2FOLSQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.371703187 (17h8m57.530468921s) [noise=true , address=77.90.31.16:4735 , piece_id=F5ZXRAIRT3GGYVDCOHQWEAWDTJ5DN2OF2AW5YB3W3MTHTUUTVJ6Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.427020261 (17h8m57.585785996s) [noise=true , address=45.91.116.11:4119 , piece_id=RRRPLNZBTVHIQTUMONDVTIBCMEBLBM2RPFCOHX7RBX4HFGZUYS3Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.436406982 (17h8m57.595172716s) [noise=true , address=45.91.116.14:4191 , piece_id=YO65KQXJOPP2BVDRQTEURGV2RDY3M36W4JSPPBTM6LKVHZ7UIEXA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.436435246 (17h8m57.59520098s) [seg_pos={0 0}, upload=14994]: Segment reached optimal threshold of 13 pieces. Aug 26 09:12:30.436615631 (17h8m57.595381365s) [noise=true , address=77.90.31.12:4589 , piece_id=L6ZTZ5PJPV2WM2BZGGAJEKBS4B2TS5S55PSD7WGA2YRH3MTLG5GA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv): protocol: expected piece hash; context canceled; EOF Aug 26 09:12:30.436693600 (17h8m57.595459334s) [noise=true , address=45.91.116.9:4262 , piece_id=WRDGDP5TBAYZTRPBYDW4ZESCR7NJJHVBU6WP4UYC4B3V5D7ICOMA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto): protocol: write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection; write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection Aug 26 09:12:30.436700754 (17h8m57.595466488s) [noise=true , address=104.36.82.10:4079 , piece_id=RSWLIXFVVRXKXD6TI4TDKEPW3HY6XU5AUAAH5N3X4UIFNEU3H5CQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF Aug 26 09:12:30.436750138 (17h8m57.595515872s) [seg_pos={0 0}, upload=14994]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 26 09:12:30.436849909 (17h8m57.595615643s) [upload=14994]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 09:12:30.436855740 (17h8m57.595621474s) [upload=14994]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 09:12:30.739827348 (17h8m57.898593082s) [upload=14994]: Done uploading segments... Aug 26 09:12:30.739846063 (17h8m57.898611797s) [upload=14994]: Upload finished. err: <nil> Duration: 5.841810606s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 4.835240529s FAIL (2025-08-26 09:32:34 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 4.835269174s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...........................X...X............................] duration: 5.723136956s FAIL (2025-08-26 09:32:07 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Aug 26 09:12:27.460801938 (17h8m54.619567672s) [upload=14994]: Starting upload Aug 26 09:12:27.460861261 (17h8m54.619626995s) [upload=14994]: Done starting upload Aug 26 09:12:27.460967244 (17h8m54.619732978s) [upload=14994]: Uploading segments... Aug 26 09:12:27.461061044 (17h8m54.619826768s) [upload=14994]: Got next segment. Inline: false Aug 26 09:12:27.461137420 (17h8m54.619903154s) [upload=14994]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 09:12:27.461142410 (17h8m54.619908144s) [upload=14994]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 09:12:27.911433899 (17h8m55.070199633s) [seg_pos={0 0}, upload=14994]: Begin upload segment... Aug 26 09:12:27.911481470 (17h8m55.070247204s) [seg_pos={0 0}, upload=14994]: Done begin upload segment. Aug 26 09:12:27.911501920 (17h8m55.070267654s) [noise=true , address=104.36.82.7:4912 , piece_id=OYVJF5VJJMZGE6E2JREPMGIZGWKQQWAHK4WCUHXFATZZGJXFJW2Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.911554130 (17h8m55.070319904s) [noise=true , address=45.91.116.14:4191 , piece_id=YO65KQXJOPP2BVDRQTEURGV2RDY3M36W4JSPPBTM6LKVHZ7UIEXA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.911868270 (17h8m55.070634004s) [noise=true , address=45.91.116.11:4119 , piece_id=RRRPLNZBTVHIQTUMONDVTIBCMEBLBM2RPFCOHX7RBX4HFGZUYS3Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912181570 (17h8m55.070947305s) [noise=true , address=45.91.116.10:4081 , piece_id=YYCAJYYQ4MXTVLBHWA6R66TIAHAEJOUQ7BBH6A3PVB56MCXUXCDA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912244641 (17h8m55.071010365s) [noise=true , address=77.90.31.16:4735 , piece_id=F5ZXRAIRT3GGYVDCOHQWEAWDTJ5DN2OF2AW5YB3W3MTHTUUTVJ6Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912475152 (17h8m55.071240886s) [noise=true , address=45.91.116.5:4299 , piece_id=G2JPCAKEMRINSSYZ24B362KA54Q2T6HDEGJQFHVWNEJGGFGRR2KA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912684673 (17h8m55.071450407s) [noise=true , address=45.91.116.9:4262 , piece_id=WRDGDP5TBAYZTRPBYDW4ZESCR7NJJHVBU6WP4UYC4B3V5D7ICOMA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912718718 (17h8m55.071484452s) [noise=true , address=77.90.31.18:4806 , piece_id=RRTHOAKZSK6ZKWLXCMODWX5HZ5I62OMUEBB64FS6RSDLMNL2OESA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912890155 (17h8m55.071655889s) [noise=true , address=45.91.116.4:4937 , piece_id=AZQ6DES5FGD63E56HNPDEOJJUZNKOF3ZYU33OMOUX47L7ZGYXISQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912973765 (17h8m55.071739499s) [noise=true , address=104.36.82.4:4802 , piece_id=6TH5NRIXI5GLRDDZDKZJZWPQYCK7BTMF2U5TDQYOV3SL227M6IZA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913095419 (17h8m55.071861153s) [noise=true , address=104.36.82.10:4079 , piece_id=RSWLIXFVVRXKXD6TI4TDKEPW3HY6XU5AUAAH5N3X4UIFNEU3H5CQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913202434 (17h8m55.071968168s) [noise=true , address=77.90.31.15:4697 , piece_id=VLJCK73RVDCWWPAC7HUVHLQV2AYUPRYNEA7SNSO7P2ZMRK2FOLSQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913320449 (17h8m55.072086183s) [noise=true , address=45.91.116.9:4263 , piece_id=RYI4SAUA6IXKXAAHC62LDOKQUKQNTEG7QCG4QHUGMSREVGWEMNGA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913452622 (17h8m55.072218356s) [noise=true , address=77.90.31.12:4592 , piece_id=4RLI6WE2HS6N2QRLJQZXSYG65EIMVROLJVYNW56CSY254ZLREUYA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913534449 (17h8m55.072300183s) [noise=true , address=104.36.82.8:4971 , piece_id=UZT2NT7JR4F7NIXPSY2ORFBQVJOXZSPEJCSLFAHPH4BDSLY2W3DA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913650701 (17h8m55.072416435s) [noise=true , address=77.90.31.12:4589 , piece_id=L6ZTZ5PJPV2WM2BZGGAJEKBS4B2TS5S55PSD7WGA2YRH3MTLG5GA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:29.900914740 (17h8m57.059680464s) [upload=14994]: Next returned nil segment Aug 26 09:12:29.900934336 (17h8m57.059700081s) [upload=14994]: Waiting for error group managing segments... Aug 26 09:12:30.221707715 (17h8m57.380473449s) [noise=true , address=77.90.31.18:4806 , piece_id=RRTHOAKZSK6ZKWLXCMODWX5HZ5I62OMUEBB64FS6RSDLMNL2OESA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.225253190 (17h8m57.384018924s) [noise=true , address=77.90.31.12:4592 , piece_id=4RLI6WE2HS6N2QRLJQZXSYG65EIMVROLJVYNW56CSY254ZLREUYA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.228153169 (17h8m57.386918893s) [noise=true , address=45.91.116.4:4937 , piece_id=AZQ6DES5FGD63E56HNPDEOJJUZNKOF3ZYU33OMOUX47L7ZGYXISQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.244451243 (17h8m57.403216977s) [noise=true , address=45.91.116.9:4263 , piece_id=RYI4SAUA6IXKXAAHC62LDOKQUKQNTEG7QCG4QHUGMSREVGWEMNGA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.274597415 (17h8m57.433363149s) [noise=true , address=45.91.116.5:4299 , piece_id=G2JPCAKEMRINSSYZ24B362KA54Q2T6HDEGJQFHVWNEJGGFGRR2KA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.280700783 (17h8m57.439466517s) [noise=true , address=104.36.82.4:4802 , piece_id=6TH5NRIXI5GLRDDZDKZJZWPQYCK7BTMF2U5TDQYOV3SL227M6IZA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.294073090 (17h8m57.452838824s) [noise=true , address=104.36.82.7:4912 , piece_id=OYVJF5VJJMZGE6E2JREPMGIZGWKQQWAHK4WCUHXFATZZGJXFJW2Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.310065069 (17h8m57.468830803s) [noise=true , address=104.36.82.8:4971 , piece_id=UZT2NT7JR4F7NIXPSY2ORFBQVJOXZSPEJCSLFAHPH4BDSLY2W3DA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.310725412 (17h8m57.469491146s) [noise=true , address=45.91.116.10:4081 , piece_id=YYCAJYYQ4MXTVLBHWA6R66TIAHAEJOUQ7BBH6A3PVB56MCXUXCDA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.327312570 (17h8m57.486078304s) [noise=true , address=77.90.31.15:4697 , piece_id=VLJCK73RVDCWWPAC7HUVHLQV2AYUPRYNEA7SNSO7P2ZMRK2FOLSQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.371703187 (17h8m57.530468921s) [noise=true , address=77.90.31.16:4735 , piece_id=F5ZXRAIRT3GGYVDCOHQWEAWDTJ5DN2OF2AW5YB3W3MTHTUUTVJ6Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.427020261 (17h8m57.585785996s) [noise=true , address=45.91.116.11:4119 , piece_id=RRRPLNZBTVHIQTUMONDVTIBCMEBLBM2RPFCOHX7RBX4HFGZUYS3Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.436406982 (17h8m57.595172716s) [noise=true , address=45.91.116.14:4191 , piece_id=YO65KQXJOPP2BVDRQTEURGV2RDY3M36W4JSPPBTM6LKVHZ7UIEXA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.436435246 (17h8m57.59520098s) [seg_pos={0 0}, upload=14994]: Segment reached optimal threshold of 13 pieces. Aug 26 09:12:30.436615631 (17h8m57.595381365s) [noise=true , address=77.90.31.12:4589 , piece_id=L6ZTZ5PJPV2WM2BZGGAJEKBS4B2TS5S55PSD7WGA2YRH3MTLG5GA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv): protocol: expected piece hash; context canceled; EOF Aug 26 09:12:30.436693600 (17h8m57.595459334s) [noise=true , address=45.91.116.9:4262 , piece_id=WRDGDP5TBAYZTRPBYDW4ZESCR7NJJHVBU6WP4UYC4B3V5D7ICOMA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto): protocol: write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection; write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection Aug 26 09:12:30.436700754 (17h8m57.595466488s) [noise=true , address=104.36.82.10:4079 , piece_id=RSWLIXFVVRXKXD6TI4TDKEPW3HY6XU5AUAAH5N3X4UIFNEU3H5CQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF Aug 26 09:12:30.436750138 (17h8m57.595515872s) [seg_pos={0 0}, upload=14994]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 26 09:12:30.436849909 (17h8m57.595615643s) [upload=14994]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 09:12:30.436855740 (17h8m57.595621474s) [upload=14994]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 09:12:30.739827348 (17h8m57.898593082s) [upload=14994]: Done uploading segments... Aug 26 09:12:30.739846063 (17h8m57.898611797s) [upload=14994]: Upload finished. err: <nil> Duration: 5.723160311s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [............................X...X...........................] duration: 5.768589695s FAIL (2025-08-26 09:31:41 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Aug 26 09:12:27.460801938 (17h8m54.619567672s) [upload=14994]: Starting upload Aug 26 09:12:27.460861261 (17h8m54.619626995s) [upload=14994]: Done starting upload Aug 26 09:12:27.460967244 (17h8m54.619732978s) [upload=14994]: Uploading segments... Aug 26 09:12:27.461061044 (17h8m54.619826768s) [upload=14994]: Got next segment. Inline: false Aug 26 09:12:27.461137420 (17h8m54.619903154s) [upload=14994]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 09:12:27.461142410 (17h8m54.619908144s) [upload=14994]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 09:12:27.911433899 (17h8m55.070199633s) [seg_pos={0 0}, upload=14994]: Begin upload segment... Aug 26 09:12:27.911481470 (17h8m55.070247204s) [seg_pos={0 0}, upload=14994]: Done begin upload segment. Aug 26 09:12:27.911501920 (17h8m55.070267654s) [noise=true , address=104.36.82.7:4912 , piece_id=OYVJF5VJJMZGE6E2JREPMGIZGWKQQWAHK4WCUHXFATZZGJXFJW2Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.911554130 (17h8m55.070319904s) [noise=true , address=45.91.116.14:4191 , piece_id=YO65KQXJOPP2BVDRQTEURGV2RDY3M36W4JSPPBTM6LKVHZ7UIEXA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.911868270 (17h8m55.070634004s) [noise=true , address=45.91.116.11:4119 , piece_id=RRRPLNZBTVHIQTUMONDVTIBCMEBLBM2RPFCOHX7RBX4HFGZUYS3Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912181570 (17h8m55.070947305s) [noise=true , address=45.91.116.10:4081 , piece_id=YYCAJYYQ4MXTVLBHWA6R66TIAHAEJOUQ7BBH6A3PVB56MCXUXCDA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912244641 (17h8m55.071010365s) [noise=true , address=77.90.31.16:4735 , piece_id=F5ZXRAIRT3GGYVDCOHQWEAWDTJ5DN2OF2AW5YB3W3MTHTUUTVJ6Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912475152 (17h8m55.071240886s) [noise=true , address=45.91.116.5:4299 , piece_id=G2JPCAKEMRINSSYZ24B362KA54Q2T6HDEGJQFHVWNEJGGFGRR2KA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912684673 (17h8m55.071450407s) [noise=true , address=45.91.116.9:4262 , piece_id=WRDGDP5TBAYZTRPBYDW4ZESCR7NJJHVBU6WP4UYC4B3V5D7ICOMA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912718718 (17h8m55.071484452s) [noise=true , address=77.90.31.18:4806 , piece_id=RRTHOAKZSK6ZKWLXCMODWX5HZ5I62OMUEBB64FS6RSDLMNL2OESA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912890155 (17h8m55.071655889s) [noise=true , address=45.91.116.4:4937 , piece_id=AZQ6DES5FGD63E56HNPDEOJJUZNKOF3ZYU33OMOUX47L7ZGYXISQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912973765 (17h8m55.071739499s) [noise=true , address=104.36.82.4:4802 , piece_id=6TH5NRIXI5GLRDDZDKZJZWPQYCK7BTMF2U5TDQYOV3SL227M6IZA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913095419 (17h8m55.071861153s) [noise=true , address=104.36.82.10:4079 , piece_id=RSWLIXFVVRXKXD6TI4TDKEPW3HY6XU5AUAAH5N3X4UIFNEU3H5CQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913202434 (17h8m55.071968168s) [noise=true , address=77.90.31.15:4697 , piece_id=VLJCK73RVDCWWPAC7HUVHLQV2AYUPRYNEA7SNSO7P2ZMRK2FOLSQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913320449 (17h8m55.072086183s) [noise=true , address=45.91.116.9:4263 , piece_id=RYI4SAUA6IXKXAAHC62LDOKQUKQNTEG7QCG4QHUGMSREVGWEMNGA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913452622 (17h8m55.072218356s) [noise=true , address=77.90.31.12:4592 , piece_id=4RLI6WE2HS6N2QRLJQZXSYG65EIMVROLJVYNW56CSY254ZLREUYA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913534449 (17h8m55.072300183s) [noise=true , address=104.36.82.8:4971 , piece_id=UZT2NT7JR4F7NIXPSY2ORFBQVJOXZSPEJCSLFAHPH4BDSLY2W3DA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913650701 (17h8m55.072416435s) [noise=true , address=77.90.31.12:4589 , piece_id=L6ZTZ5PJPV2WM2BZGGAJEKBS4B2TS5S55PSD7WGA2YRH3MTLG5GA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:29.900914740 (17h8m57.059680464s) [upload=14994]: Next returned nil segment Aug 26 09:12:29.900934336 (17h8m57.059700081s) [upload=14994]: Waiting for error group managing segments... Aug 26 09:12:30.221707715 (17h8m57.380473449s) [noise=true , address=77.90.31.18:4806 , piece_id=RRTHOAKZSK6ZKWLXCMODWX5HZ5I62OMUEBB64FS6RSDLMNL2OESA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.225253190 (17h8m57.384018924s) [noise=true , address=77.90.31.12:4592 , piece_id=4RLI6WE2HS6N2QRLJQZXSYG65EIMVROLJVYNW56CSY254ZLREUYA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.228153169 (17h8m57.386918893s) [noise=true , address=45.91.116.4:4937 , piece_id=AZQ6DES5FGD63E56HNPDEOJJUZNKOF3ZYU33OMOUX47L7ZGYXISQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.244451243 (17h8m57.403216977s) [noise=true , address=45.91.116.9:4263 , piece_id=RYI4SAUA6IXKXAAHC62LDOKQUKQNTEG7QCG4QHUGMSREVGWEMNGA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.274597415 (17h8m57.433363149s) [noise=true , address=45.91.116.5:4299 , piece_id=G2JPCAKEMRINSSYZ24B362KA54Q2T6HDEGJQFHVWNEJGGFGRR2KA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.280700783 (17h8m57.439466517s) [noise=true , address=104.36.82.4:4802 , piece_id=6TH5NRIXI5GLRDDZDKZJZWPQYCK7BTMF2U5TDQYOV3SL227M6IZA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.294073090 (17h8m57.452838824s) [noise=true , address=104.36.82.7:4912 , piece_id=OYVJF5VJJMZGE6E2JREPMGIZGWKQQWAHK4WCUHXFATZZGJXFJW2Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.310065069 (17h8m57.468830803s) [noise=true , address=104.36.82.8:4971 , piece_id=UZT2NT7JR4F7NIXPSY2ORFBQVJOXZSPEJCSLFAHPH4BDSLY2W3DA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.310725412 (17h8m57.469491146s) [noise=true , address=45.91.116.10:4081 , piece_id=YYCAJYYQ4MXTVLBHWA6R66TIAHAEJOUQ7BBH6A3PVB56MCXUXCDA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.327312570 (17h8m57.486078304s) [noise=true , address=77.90.31.15:4697 , piece_id=VLJCK73RVDCWWPAC7HUVHLQV2AYUPRYNEA7SNSO7P2ZMRK2FOLSQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.371703187 (17h8m57.530468921s) [noise=true , address=77.90.31.16:4735 , piece_id=F5ZXRAIRT3GGYVDCOHQWEAWDTJ5DN2OF2AW5YB3W3MTHTUUTVJ6Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.427020261 (17h8m57.585785996s) [noise=true , address=45.91.116.11:4119 , piece_id=RRRPLNZBTVHIQTUMONDVTIBCMEBLBM2RPFCOHX7RBX4HFGZUYS3Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.436406982 (17h8m57.595172716s) [noise=true , address=45.91.116.14:4191 , piece_id=YO65KQXJOPP2BVDRQTEURGV2RDY3M36W4JSPPBTM6LKVHZ7UIEXA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.436435246 (17h8m57.59520098s) [seg_pos={0 0}, upload=14994]: Segment reached optimal threshold of 13 pieces. Aug 26 09:12:30.436615631 (17h8m57.595381365s) [noise=true , address=77.90.31.12:4589 , piece_id=L6ZTZ5PJPV2WM2BZGGAJEKBS4B2TS5S55PSD7WGA2YRH3MTLG5GA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv): protocol: expected piece hash; context canceled; EOF Aug 26 09:12:30.436693600 (17h8m57.595459334s) [noise=true , address=45.91.116.9:4262 , piece_id=WRDGDP5TBAYZTRPBYDW4ZESCR7NJJHVBU6WP4UYC4B3V5D7ICOMA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto): protocol: write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection; write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection Aug 26 09:12:30.436700754 (17h8m57.595466488s) [noise=true , address=104.36.82.10:4079 , piece_id=RSWLIXFVVRXKXD6TI4TDKEPW3HY6XU5AUAAH5N3X4UIFNEU3H5CQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF Aug 26 09:12:30.436750138 (17h8m57.595515872s) [seg_pos={0 0}, upload=14994]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 26 09:12:30.436849909 (17h8m57.595615643s) [upload=14994]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 09:12:30.436855740 (17h8m57.595621474s) [upload=14994]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 09:12:30.739827348 (17h8m57.898593082s) [upload=14994]: Done uploading segments... Aug 26 09:12:30.739846063 (17h8m57.898611797s) [upload=14994]: Upload finished. err: <nil> Duration: 5.76861881s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 5.02768315s FAIL (2025-08-26 09:31:41 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 5.02770389s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.............................X...X..........................] duration: 5.733872045s FAIL (2025-08-26 09:30:45 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Aug 26 09:12:27.460801938 (17h8m54.619567672s) [upload=14994]: Starting upload Aug 26 09:12:27.460861261 (17h8m54.619626995s) [upload=14994]: Done starting upload Aug 26 09:12:27.460967244 (17h8m54.619732978s) [upload=14994]: Uploading segments... Aug 26 09:12:27.461061044 (17h8m54.619826768s) [upload=14994]: Got next segment. Inline: false Aug 26 09:12:27.461137420 (17h8m54.619903154s) [upload=14994]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 09:12:27.461142410 (17h8m54.619908144s) [upload=14994]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 09:12:27.911433899 (17h8m55.070199633s) [seg_pos={0 0}, upload=14994]: Begin upload segment... Aug 26 09:12:27.911481470 (17h8m55.070247204s) [seg_pos={0 0}, upload=14994]: Done begin upload segment. Aug 26 09:12:27.911501920 (17h8m55.070267654s) [noise=true , address=104.36.82.7:4912 , piece_id=OYVJF5VJJMZGE6E2JREPMGIZGWKQQWAHK4WCUHXFATZZGJXFJW2Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.911554130 (17h8m55.070319904s) [noise=true , address=45.91.116.14:4191 , piece_id=YO65KQXJOPP2BVDRQTEURGV2RDY3M36W4JSPPBTM6LKVHZ7UIEXA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.911868270 (17h8m55.070634004s) [noise=true , address=45.91.116.11:4119 , piece_id=RRRPLNZBTVHIQTUMONDVTIBCMEBLBM2RPFCOHX7RBX4HFGZUYS3Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912181570 (17h8m55.070947305s) [noise=true , address=45.91.116.10:4081 , piece_id=YYCAJYYQ4MXTVLBHWA6R66TIAHAEJOUQ7BBH6A3PVB56MCXUXCDA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912244641 (17h8m55.071010365s) [noise=true , address=77.90.31.16:4735 , piece_id=F5ZXRAIRT3GGYVDCOHQWEAWDTJ5DN2OF2AW5YB3W3MTHTUUTVJ6Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912475152 (17h8m55.071240886s) [noise=true , address=45.91.116.5:4299 , piece_id=G2JPCAKEMRINSSYZ24B362KA54Q2T6HDEGJQFHVWNEJGGFGRR2KA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912684673 (17h8m55.071450407s) [noise=true , address=45.91.116.9:4262 , piece_id=WRDGDP5TBAYZTRPBYDW4ZESCR7NJJHVBU6WP4UYC4B3V5D7ICOMA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912718718 (17h8m55.071484452s) [noise=true , address=77.90.31.18:4806 , piece_id=RRTHOAKZSK6ZKWLXCMODWX5HZ5I62OMUEBB64FS6RSDLMNL2OESA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912890155 (17h8m55.071655889s) [noise=true , address=45.91.116.4:4937 , piece_id=AZQ6DES5FGD63E56HNPDEOJJUZNKOF3ZYU33OMOUX47L7ZGYXISQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912973765 (17h8m55.071739499s) [noise=true , address=104.36.82.4:4802 , piece_id=6TH5NRIXI5GLRDDZDKZJZWPQYCK7BTMF2U5TDQYOV3SL227M6IZA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913095419 (17h8m55.071861153s) [noise=true , address=104.36.82.10:4079 , piece_id=RSWLIXFVVRXKXD6TI4TDKEPW3HY6XU5AUAAH5N3X4UIFNEU3H5CQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913202434 (17h8m55.071968168s) [noise=true , address=77.90.31.15:4697 , piece_id=VLJCK73RVDCWWPAC7HUVHLQV2AYUPRYNEA7SNSO7P2ZMRK2FOLSQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913320449 (17h8m55.072086183s) [noise=true , address=45.91.116.9:4263 , piece_id=RYI4SAUA6IXKXAAHC62LDOKQUKQNTEG7QCG4QHUGMSREVGWEMNGA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913452622 (17h8m55.072218356s) [noise=true , address=77.90.31.12:4592 , piece_id=4RLI6WE2HS6N2QRLJQZXSYG65EIMVROLJVYNW56CSY254ZLREUYA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913534449 (17h8m55.072300183s) [noise=true , address=104.36.82.8:4971 , piece_id=UZT2NT7JR4F7NIXPSY2ORFBQVJOXZSPEJCSLFAHPH4BDSLY2W3DA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913650701 (17h8m55.072416435s) [noise=true , address=77.90.31.12:4589 , piece_id=L6ZTZ5PJPV2WM2BZGGAJEKBS4B2TS5S55PSD7WGA2YRH3MTLG5GA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:29.900914740 (17h8m57.059680464s) [upload=14994]: Next returned nil segment Aug 26 09:12:29.900934336 (17h8m57.059700081s) [upload=14994]: Waiting for error group managing segments... Aug 26 09:12:30.221707715 (17h8m57.380473449s) [noise=true , address=77.90.31.18:4806 , piece_id=RRTHOAKZSK6ZKWLXCMODWX5HZ5I62OMUEBB64FS6RSDLMNL2OESA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.225253190 (17h8m57.384018924s) [noise=true , address=77.90.31.12:4592 , piece_id=4RLI6WE2HS6N2QRLJQZXSYG65EIMVROLJVYNW56CSY254ZLREUYA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.228153169 (17h8m57.386918893s) [noise=true , address=45.91.116.4:4937 , piece_id=AZQ6DES5FGD63E56HNPDEOJJUZNKOF3ZYU33OMOUX47L7ZGYXISQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.244451243 (17h8m57.403216977s) [noise=true , address=45.91.116.9:4263 , piece_id=RYI4SAUA6IXKXAAHC62LDOKQUKQNTEG7QCG4QHUGMSREVGWEMNGA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.274597415 (17h8m57.433363149s) [noise=true , address=45.91.116.5:4299 , piece_id=G2JPCAKEMRINSSYZ24B362KA54Q2T6HDEGJQFHVWNEJGGFGRR2KA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.280700783 (17h8m57.439466517s) [noise=true , address=104.36.82.4:4802 , piece_id=6TH5NRIXI5GLRDDZDKZJZWPQYCK7BTMF2U5TDQYOV3SL227M6IZA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.294073090 (17h8m57.452838824s) [noise=true , address=104.36.82.7:4912 , piece_id=OYVJF5VJJMZGE6E2JREPMGIZGWKQQWAHK4WCUHXFATZZGJXFJW2Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.310065069 (17h8m57.468830803s) [noise=true , address=104.36.82.8:4971 , piece_id=UZT2NT7JR4F7NIXPSY2ORFBQVJOXZSPEJCSLFAHPH4BDSLY2W3DA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.310725412 (17h8m57.469491146s) [noise=true , address=45.91.116.10:4081 , piece_id=YYCAJYYQ4MXTVLBHWA6R66TIAHAEJOUQ7BBH6A3PVB56MCXUXCDA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.327312570 (17h8m57.486078304s) [noise=true , address=77.90.31.15:4697 , piece_id=VLJCK73RVDCWWPAC7HUVHLQV2AYUPRYNEA7SNSO7P2ZMRK2FOLSQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.371703187 (17h8m57.530468921s) [noise=true , address=77.90.31.16:4735 , piece_id=F5ZXRAIRT3GGYVDCOHQWEAWDTJ5DN2OF2AW5YB3W3MTHTUUTVJ6Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.427020261 (17h8m57.585785996s) [noise=true , address=45.91.116.11:4119 , piece_id=RRRPLNZBTVHIQTUMONDVTIBCMEBLBM2RPFCOHX7RBX4HFGZUYS3Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.436406982 (17h8m57.595172716s) [noise=true , address=45.91.116.14:4191 , piece_id=YO65KQXJOPP2BVDRQTEURGV2RDY3M36W4JSPPBTM6LKVHZ7UIEXA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.436435246 (17h8m57.59520098s) [seg_pos={0 0}, upload=14994]: Segment reached optimal threshold of 13 pieces. Aug 26 09:12:30.436615631 (17h8m57.595381365s) [noise=true , address=77.90.31.12:4589 , piece_id=L6ZTZ5PJPV2WM2BZGGAJEKBS4B2TS5S55PSD7WGA2YRH3MTLG5GA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv): protocol: expected piece hash; context canceled; EOF Aug 26 09:12:30.436693600 (17h8m57.595459334s) [noise=true , address=45.91.116.9:4262 , piece_id=WRDGDP5TBAYZTRPBYDW4ZESCR7NJJHVBU6WP4UYC4B3V5D7ICOMA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto): protocol: write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection; write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection Aug 26 09:12:30.436700754 (17h8m57.595466488s) [noise=true , address=104.36.82.10:4079 , piece_id=RSWLIXFVVRXKXD6TI4TDKEPW3HY6XU5AUAAH5N3X4UIFNEU3H5CQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF Aug 26 09:12:30.436750138 (17h8m57.595515872s) [seg_pos={0 0}, upload=14994]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 26 09:12:30.436849909 (17h8m57.595615643s) [upload=14994]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 09:12:30.436855740 (17h8m57.595621474s) [upload=14994]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 09:12:30.739827348 (17h8m57.898593082s) [upload=14994]: Done uploading segments... Aug 26 09:12:30.739846063 (17h8m57.898611797s) [upload=14994]: Upload finished. err: <nil> Duration: 5.733899969s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 5.423949098s FAIL (2025-08-26 09:30:26 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 5.42398732s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 4.973817252s FAIL (2025-08-26 09:29:56 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 4.973853381s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..............................X...X.........................] duration: 5.675866467s FAIL (2025-08-26 09:29:49 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Aug 26 09:12:27.460801938 (17h8m54.619567672s) [upload=14994]: Starting upload Aug 26 09:12:27.460861261 (17h8m54.619626995s) [upload=14994]: Done starting upload Aug 26 09:12:27.460967244 (17h8m54.619732978s) [upload=14994]: Uploading segments... Aug 26 09:12:27.461061044 (17h8m54.619826768s) [upload=14994]: Got next segment. Inline: false Aug 26 09:12:27.461137420 (17h8m54.619903154s) [upload=14994]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 09:12:27.461142410 (17h8m54.619908144s) [upload=14994]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 09:12:27.911433899 (17h8m55.070199633s) [seg_pos={0 0}, upload=14994]: Begin upload segment... Aug 26 09:12:27.911481470 (17h8m55.070247204s) [seg_pos={0 0}, upload=14994]: Done begin upload segment. Aug 26 09:12:27.911501920 (17h8m55.070267654s) [noise=true , address=104.36.82.7:4912 , piece_id=OYVJF5VJJMZGE6E2JREPMGIZGWKQQWAHK4WCUHXFATZZGJXFJW2Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.911554130 (17h8m55.070319904s) [noise=true , address=45.91.116.14:4191 , piece_id=YO65KQXJOPP2BVDRQTEURGV2RDY3M36W4JSPPBTM6LKVHZ7UIEXA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.911868270 (17h8m55.070634004s) [noise=true , address=45.91.116.11:4119 , piece_id=RRRPLNZBTVHIQTUMONDVTIBCMEBLBM2RPFCOHX7RBX4HFGZUYS3Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912181570 (17h8m55.070947305s) [noise=true , address=45.91.116.10:4081 , piece_id=YYCAJYYQ4MXTVLBHWA6R66TIAHAEJOUQ7BBH6A3PVB56MCXUXCDA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912244641 (17h8m55.071010365s) [noise=true , address=77.90.31.16:4735 , piece_id=F5ZXRAIRT3GGYVDCOHQWEAWDTJ5DN2OF2AW5YB3W3MTHTUUTVJ6Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912475152 (17h8m55.071240886s) [noise=true , address=45.91.116.5:4299 , piece_id=G2JPCAKEMRINSSYZ24B362KA54Q2T6HDEGJQFHVWNEJGGFGRR2KA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912684673 (17h8m55.071450407s) [noise=true , address=45.91.116.9:4262 , piece_id=WRDGDP5TBAYZTRPBYDW4ZESCR7NJJHVBU6WP4UYC4B3V5D7ICOMA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912718718 (17h8m55.071484452s) [noise=true , address=77.90.31.18:4806 , piece_id=RRTHOAKZSK6ZKWLXCMODWX5HZ5I62OMUEBB64FS6RSDLMNL2OESA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912890155 (17h8m55.071655889s) [noise=true , address=45.91.116.4:4937 , piece_id=AZQ6DES5FGD63E56HNPDEOJJUZNKOF3ZYU33OMOUX47L7ZGYXISQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912973765 (17h8m55.071739499s) [noise=true , address=104.36.82.4:4802 , piece_id=6TH5NRIXI5GLRDDZDKZJZWPQYCK7BTMF2U5TDQYOV3SL227M6IZA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913095419 (17h8m55.071861153s) [noise=true , address=104.36.82.10:4079 , piece_id=RSWLIXFVVRXKXD6TI4TDKEPW3HY6XU5AUAAH5N3X4UIFNEU3H5CQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913202434 (17h8m55.071968168s) [noise=true , address=77.90.31.15:4697 , piece_id=VLJCK73RVDCWWPAC7HUVHLQV2AYUPRYNEA7SNSO7P2ZMRK2FOLSQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913320449 (17h8m55.072086183s) [noise=true , address=45.91.116.9:4263 , piece_id=RYI4SAUA6IXKXAAHC62LDOKQUKQNTEG7QCG4QHUGMSREVGWEMNGA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913452622 (17h8m55.072218356s) [noise=true , address=77.90.31.12:4592 , piece_id=4RLI6WE2HS6N2QRLJQZXSYG65EIMVROLJVYNW56CSY254ZLREUYA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913534449 (17h8m55.072300183s) [noise=true , address=104.36.82.8:4971 , piece_id=UZT2NT7JR4F7NIXPSY2ORFBQVJOXZSPEJCSLFAHPH4BDSLY2W3DA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913650701 (17h8m55.072416435s) [noise=true , address=77.90.31.12:4589 , piece_id=L6ZTZ5PJPV2WM2BZGGAJEKBS4B2TS5S55PSD7WGA2YRH3MTLG5GA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:29.900914740 (17h8m57.059680464s) [upload=14994]: Next returned nil segment Aug 26 09:12:29.900934336 (17h8m57.059700081s) [upload=14994]: Waiting for error group managing segments... Aug 26 09:12:30.221707715 (17h8m57.380473449s) [noise=true , address=77.90.31.18:4806 , piece_id=RRTHOAKZSK6ZKWLXCMODWX5HZ5I62OMUEBB64FS6RSDLMNL2OESA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.225253190 (17h8m57.384018924s) [noise=true , address=77.90.31.12:4592 , piece_id=4RLI6WE2HS6N2QRLJQZXSYG65EIMVROLJVYNW56CSY254ZLREUYA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.228153169 (17h8m57.386918893s) [noise=true , address=45.91.116.4:4937 , piece_id=AZQ6DES5FGD63E56HNPDEOJJUZNKOF3ZYU33OMOUX47L7ZGYXISQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.244451243 (17h8m57.403216977s) [noise=true , address=45.91.116.9:4263 , piece_id=RYI4SAUA6IXKXAAHC62LDOKQUKQNTEG7QCG4QHUGMSREVGWEMNGA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.274597415 (17h8m57.433363149s) [noise=true , address=45.91.116.5:4299 , piece_id=G2JPCAKEMRINSSYZ24B362KA54Q2T6HDEGJQFHVWNEJGGFGRR2KA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.280700783 (17h8m57.439466517s) [noise=true , address=104.36.82.4:4802 , piece_id=6TH5NRIXI5GLRDDZDKZJZWPQYCK7BTMF2U5TDQYOV3SL227M6IZA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.294073090 (17h8m57.452838824s) [noise=true , address=104.36.82.7:4912 , piece_id=OYVJF5VJJMZGE6E2JREPMGIZGWKQQWAHK4WCUHXFATZZGJXFJW2Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.310065069 (17h8m57.468830803s) [noise=true , address=104.36.82.8:4971 , piece_id=UZT2NT7JR4F7NIXPSY2ORFBQVJOXZSPEJCSLFAHPH4BDSLY2W3DA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.310725412 (17h8m57.469491146s) [noise=true , address=45.91.116.10:4081 , piece_id=YYCAJYYQ4MXTVLBHWA6R66TIAHAEJOUQ7BBH6A3PVB56MCXUXCDA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.327312570 (17h8m57.486078304s) [noise=true , address=77.90.31.15:4697 , piece_id=VLJCK73RVDCWWPAC7HUVHLQV2AYUPRYNEA7SNSO7P2ZMRK2FOLSQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.371703187 (17h8m57.530468921s) [noise=true , address=77.90.31.16:4735 , piece_id=F5ZXRAIRT3GGYVDCOHQWEAWDTJ5DN2OF2AW5YB3W3MTHTUUTVJ6Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.427020261 (17h8m57.585785996s) [noise=true , address=45.91.116.11:4119 , piece_id=RRRPLNZBTVHIQTUMONDVTIBCMEBLBM2RPFCOHX7RBX4HFGZUYS3Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.436406982 (17h8m57.595172716s) [noise=true , address=45.91.116.14:4191 , piece_id=YO65KQXJOPP2BVDRQTEURGV2RDY3M36W4JSPPBTM6LKVHZ7UIEXA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.436435246 (17h8m57.59520098s) [seg_pos={0 0}, upload=14994]: Segment reached optimal threshold of 13 pieces. Aug 26 09:12:30.436615631 (17h8m57.595381365s) [noise=true , address=77.90.31.12:4589 , piece_id=L6ZTZ5PJPV2WM2BZGGAJEKBS4B2TS5S55PSD7WGA2YRH3MTLG5GA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv): protocol: expected piece hash; context canceled; EOF Aug 26 09:12:30.436693600 (17h8m57.595459334s) [noise=true , address=45.91.116.9:4262 , piece_id=WRDGDP5TBAYZTRPBYDW4ZESCR7NJJHVBU6WP4UYC4B3V5D7ICOMA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto): protocol: write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection; write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection Aug 26 09:12:30.436700754 (17h8m57.595466488s) [noise=true , address=104.36.82.10:4079 , piece_id=RSWLIXFVVRXKXD6TI4TDKEPW3HY6XU5AUAAH5N3X4UIFNEU3H5CQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF Aug 26 09:12:30.436750138 (17h8m57.595515872s) [seg_pos={0 0}, upload=14994]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 26 09:12:30.436849909 (17h8m57.595615643s) [upload=14994]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 09:12:30.436855740 (17h8m57.595621474s) [upload=14994]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 09:12:30.739827348 (17h8m57.898593082s) [upload=14994]: Done uploading segments... Aug 26 09:12:30.739846063 (17h8m57.898611797s) [upload=14994]: Upload finished. err: <nil> Duration: 5.675894011s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...............................X...X........................] duration: 5.731993031s FAIL (2025-08-26 09:28:56 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Aug 26 09:12:27.460801938 (17h8m54.619567672s) [upload=14994]: Starting upload Aug 26 09:12:27.460861261 (17h8m54.619626995s) [upload=14994]: Done starting upload Aug 26 09:12:27.460967244 (17h8m54.619732978s) [upload=14994]: Uploading segments... Aug 26 09:12:27.461061044 (17h8m54.619826768s) [upload=14994]: Got next segment. Inline: false Aug 26 09:12:27.461137420 (17h8m54.619903154s) [upload=14994]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 09:12:27.461142410 (17h8m54.619908144s) [upload=14994]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 09:12:27.911433899 (17h8m55.070199633s) [seg_pos={0 0}, upload=14994]: Begin upload segment... Aug 26 09:12:27.911481470 (17h8m55.070247204s) [seg_pos={0 0}, upload=14994]: Done begin upload segment. Aug 26 09:12:27.911501920 (17h8m55.070267654s) [noise=true , address=104.36.82.7:4912 , piece_id=OYVJF5VJJMZGE6E2JREPMGIZGWKQQWAHK4WCUHXFATZZGJXFJW2Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.911554130 (17h8m55.070319904s) [noise=true , address=45.91.116.14:4191 , piece_id=YO65KQXJOPP2BVDRQTEURGV2RDY3M36W4JSPPBTM6LKVHZ7UIEXA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.911868270 (17h8m55.070634004s) [noise=true , address=45.91.116.11:4119 , piece_id=RRRPLNZBTVHIQTUMONDVTIBCMEBLBM2RPFCOHX7RBX4HFGZUYS3Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912181570 (17h8m55.070947305s) [noise=true , address=45.91.116.10:4081 , piece_id=YYCAJYYQ4MXTVLBHWA6R66TIAHAEJOUQ7BBH6A3PVB56MCXUXCDA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912244641 (17h8m55.071010365s) [noise=true , address=77.90.31.16:4735 , piece_id=F5ZXRAIRT3GGYVDCOHQWEAWDTJ5DN2OF2AW5YB3W3MTHTUUTVJ6Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912475152 (17h8m55.071240886s) [noise=true , address=45.91.116.5:4299 , piece_id=G2JPCAKEMRINSSYZ24B362KA54Q2T6HDEGJQFHVWNEJGGFGRR2KA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912684673 (17h8m55.071450407s) [noise=true , address=45.91.116.9:4262 , piece_id=WRDGDP5TBAYZTRPBYDW4ZESCR7NJJHVBU6WP4UYC4B3V5D7ICOMA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912718718 (17h8m55.071484452s) [noise=true , address=77.90.31.18:4806 , piece_id=RRTHOAKZSK6ZKWLXCMODWX5HZ5I62OMUEBB64FS6RSDLMNL2OESA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912890155 (17h8m55.071655889s) [noise=true , address=45.91.116.4:4937 , piece_id=AZQ6DES5FGD63E56HNPDEOJJUZNKOF3ZYU33OMOUX47L7ZGYXISQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912973765 (17h8m55.071739499s) [noise=true , address=104.36.82.4:4802 , piece_id=6TH5NRIXI5GLRDDZDKZJZWPQYCK7BTMF2U5TDQYOV3SL227M6IZA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913095419 (17h8m55.071861153s) [noise=true , address=104.36.82.10:4079 , piece_id=RSWLIXFVVRXKXD6TI4TDKEPW3HY6XU5AUAAH5N3X4UIFNEU3H5CQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913202434 (17h8m55.071968168s) [noise=true , address=77.90.31.15:4697 , piece_id=VLJCK73RVDCWWPAC7HUVHLQV2AYUPRYNEA7SNSO7P2ZMRK2FOLSQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913320449 (17h8m55.072086183s) [noise=true , address=45.91.116.9:4263 , piece_id=RYI4SAUA6IXKXAAHC62LDOKQUKQNTEG7QCG4QHUGMSREVGWEMNGA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913452622 (17h8m55.072218356s) [noise=true , address=77.90.31.12:4592 , piece_id=4RLI6WE2HS6N2QRLJQZXSYG65EIMVROLJVYNW56CSY254ZLREUYA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913534449 (17h8m55.072300183s) [noise=true , address=104.36.82.8:4971 , piece_id=UZT2NT7JR4F7NIXPSY2ORFBQVJOXZSPEJCSLFAHPH4BDSLY2W3DA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913650701 (17h8m55.072416435s) [noise=true , address=77.90.31.12:4589 , piece_id=L6ZTZ5PJPV2WM2BZGGAJEKBS4B2TS5S55PSD7WGA2YRH3MTLG5GA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:29.900914740 (17h8m57.059680464s) [upload=14994]: Next returned nil segment Aug 26 09:12:29.900934336 (17h8m57.059700081s) [upload=14994]: Waiting for error group managing segments... Aug 26 09:12:30.221707715 (17h8m57.380473449s) [noise=true , address=77.90.31.18:4806 , piece_id=RRTHOAKZSK6ZKWLXCMODWX5HZ5I62OMUEBB64FS6RSDLMNL2OESA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.225253190 (17h8m57.384018924s) [noise=true , address=77.90.31.12:4592 , piece_id=4RLI6WE2HS6N2QRLJQZXSYG65EIMVROLJVYNW56CSY254ZLREUYA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.228153169 (17h8m57.386918893s) [noise=true , address=45.91.116.4:4937 , piece_id=AZQ6DES5FGD63E56HNPDEOJJUZNKOF3ZYU33OMOUX47L7ZGYXISQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.244451243 (17h8m57.403216977s) [noise=true , address=45.91.116.9:4263 , piece_id=RYI4SAUA6IXKXAAHC62LDOKQUKQNTEG7QCG4QHUGMSREVGWEMNGA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.274597415 (17h8m57.433363149s) [noise=true , address=45.91.116.5:4299 , piece_id=G2JPCAKEMRINSSYZ24B362KA54Q2T6HDEGJQFHVWNEJGGFGRR2KA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.280700783 (17h8m57.439466517s) [noise=true , address=104.36.82.4:4802 , piece_id=6TH5NRIXI5GLRDDZDKZJZWPQYCK7BTMF2U5TDQYOV3SL227M6IZA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.294073090 (17h8m57.452838824s) [noise=true , address=104.36.82.7:4912 , piece_id=OYVJF5VJJMZGE6E2JREPMGIZGWKQQWAHK4WCUHXFATZZGJXFJW2Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.310065069 (17h8m57.468830803s) [noise=true , address=104.36.82.8:4971 , piece_id=UZT2NT7JR4F7NIXPSY2ORFBQVJOXZSPEJCSLFAHPH4BDSLY2W3DA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.310725412 (17h8m57.469491146s) [noise=true , address=45.91.116.10:4081 , piece_id=YYCAJYYQ4MXTVLBHWA6R66TIAHAEJOUQ7BBH6A3PVB56MCXUXCDA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.327312570 (17h8m57.486078304s) [noise=true , address=77.90.31.15:4697 , piece_id=VLJCK73RVDCWWPAC7HUVHLQV2AYUPRYNEA7SNSO7P2ZMRK2FOLSQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.371703187 (17h8m57.530468921s) [noise=true , address=77.90.31.16:4735 , piece_id=F5ZXRAIRT3GGYVDCOHQWEAWDTJ5DN2OF2AW5YB3W3MTHTUUTVJ6Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.427020261 (17h8m57.585785996s) [noise=true , address=45.91.116.11:4119 , piece_id=RRRPLNZBTVHIQTUMONDVTIBCMEBLBM2RPFCOHX7RBX4HFGZUYS3Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.436406982 (17h8m57.595172716s) [noise=true , address=45.91.116.14:4191 , piece_id=YO65KQXJOPP2BVDRQTEURGV2RDY3M36W4JSPPBTM6LKVHZ7UIEXA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.436435246 (17h8m57.59520098s) [seg_pos={0 0}, upload=14994]: Segment reached optimal threshold of 13 pieces. Aug 26 09:12:30.436615631 (17h8m57.595381365s) [noise=true , address=77.90.31.12:4589 , piece_id=L6ZTZ5PJPV2WM2BZGGAJEKBS4B2TS5S55PSD7WGA2YRH3MTLG5GA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv): protocol: expected piece hash; context canceled; EOF Aug 26 09:12:30.436693600 (17h8m57.595459334s) [noise=true , address=45.91.116.9:4262 , piece_id=WRDGDP5TBAYZTRPBYDW4ZESCR7NJJHVBU6WP4UYC4B3V5D7ICOMA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto): protocol: write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection; write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection Aug 26 09:12:30.436700754 (17h8m57.595466488s) [noise=true , address=104.36.82.10:4079 , piece_id=RSWLIXFVVRXKXD6TI4TDKEPW3HY6XU5AUAAH5N3X4UIFNEU3H5CQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF Aug 26 09:12:30.436750138 (17h8m57.595515872s) [seg_pos={0 0}, upload=14994]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 26 09:12:30.436849909 (17h8m57.595615643s) [upload=14994]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 09:12:30.436855740 (17h8m57.595621474s) [upload=14994]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 09:12:30.739827348 (17h8m57.898593082s) [upload=14994]: Done uploading segments... Aug 26 09:12:30.739846063 (17h8m57.898611797s) [upload=14994]: Upload finished. err: <nil> Duration: 5.732018471s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 4.96456603s FAIL (2025-08-26 09:28:43 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 4.964593805s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [................................X...X.......................] duration: 5.834336845s FAIL (2025-08-26 09:28:17 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Aug 26 09:12:27.460801938 (17h8m54.619567672s) [upload=14994]: Starting upload Aug 26 09:12:27.460861261 (17h8m54.619626995s) [upload=14994]: Done starting upload Aug 26 09:12:27.460967244 (17h8m54.619732978s) [upload=14994]: Uploading segments... Aug 26 09:12:27.461061044 (17h8m54.619826768s) [upload=14994]: Got next segment. Inline: false Aug 26 09:12:27.461137420 (17h8m54.619903154s) [upload=14994]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 09:12:27.461142410 (17h8m54.619908144s) [upload=14994]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 09:12:27.911433899 (17h8m55.070199633s) [seg_pos={0 0}, upload=14994]: Begin upload segment... Aug 26 09:12:27.911481470 (17h8m55.070247204s) [seg_pos={0 0}, upload=14994]: Done begin upload segment. Aug 26 09:12:27.911501920 (17h8m55.070267654s) [noise=true , address=104.36.82.7:4912 , piece_id=OYVJF5VJJMZGE6E2JREPMGIZGWKQQWAHK4WCUHXFATZZGJXFJW2Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.911554130 (17h8m55.070319904s) [noise=true , address=45.91.116.14:4191 , piece_id=YO65KQXJOPP2BVDRQTEURGV2RDY3M36W4JSPPBTM6LKVHZ7UIEXA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.911868270 (17h8m55.070634004s) [noise=true , address=45.91.116.11:4119 , piece_id=RRRPLNZBTVHIQTUMONDVTIBCMEBLBM2RPFCOHX7RBX4HFGZUYS3Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912181570 (17h8m55.070947305s) [noise=true , address=45.91.116.10:4081 , piece_id=YYCAJYYQ4MXTVLBHWA6R66TIAHAEJOUQ7BBH6A3PVB56MCXUXCDA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912244641 (17h8m55.071010365s) [noise=true , address=77.90.31.16:4735 , piece_id=F5ZXRAIRT3GGYVDCOHQWEAWDTJ5DN2OF2AW5YB3W3MTHTUUTVJ6Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912475152 (17h8m55.071240886s) [noise=true , address=45.91.116.5:4299 , piece_id=G2JPCAKEMRINSSYZ24B362KA54Q2T6HDEGJQFHVWNEJGGFGRR2KA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912684673 (17h8m55.071450407s) [noise=true , address=45.91.116.9:4262 , piece_id=WRDGDP5TBAYZTRPBYDW4ZESCR7NJJHVBU6WP4UYC4B3V5D7ICOMA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912718718 (17h8m55.071484452s) [noise=true , address=77.90.31.18:4806 , piece_id=RRTHOAKZSK6ZKWLXCMODWX5HZ5I62OMUEBB64FS6RSDLMNL2OESA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912890155 (17h8m55.071655889s) [noise=true , address=45.91.116.4:4937 , piece_id=AZQ6DES5FGD63E56HNPDEOJJUZNKOF3ZYU33OMOUX47L7ZGYXISQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912973765 (17h8m55.071739499s) [noise=true , address=104.36.82.4:4802 , piece_id=6TH5NRIXI5GLRDDZDKZJZWPQYCK7BTMF2U5TDQYOV3SL227M6IZA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913095419 (17h8m55.071861153s) [noise=true , address=104.36.82.10:4079 , piece_id=RSWLIXFVVRXKXD6TI4TDKEPW3HY6XU5AUAAH5N3X4UIFNEU3H5CQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913202434 (17h8m55.071968168s) [noise=true , address=77.90.31.15:4697 , piece_id=VLJCK73RVDCWWPAC7HUVHLQV2AYUPRYNEA7SNSO7P2ZMRK2FOLSQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913320449 (17h8m55.072086183s) [noise=true , address=45.91.116.9:4263 , piece_id=RYI4SAUA6IXKXAAHC62LDOKQUKQNTEG7QCG4QHUGMSREVGWEMNGA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913452622 (17h8m55.072218356s) [noise=true , address=77.90.31.12:4592 , piece_id=4RLI6WE2HS6N2QRLJQZXSYG65EIMVROLJVYNW56CSY254ZLREUYA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913534449 (17h8m55.072300183s) [noise=true , address=104.36.82.8:4971 , piece_id=UZT2NT7JR4F7NIXPSY2ORFBQVJOXZSPEJCSLFAHPH4BDSLY2W3DA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913650701 (17h8m55.072416435s) [noise=true , address=77.90.31.12:4589 , piece_id=L6ZTZ5PJPV2WM2BZGGAJEKBS4B2TS5S55PSD7WGA2YRH3MTLG5GA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:29.900914740 (17h8m57.059680464s) [upload=14994]: Next returned nil segment Aug 26 09:12:29.900934336 (17h8m57.059700081s) [upload=14994]: Waiting for error group managing segments... Aug 26 09:12:30.221707715 (17h8m57.380473449s) [noise=true , address=77.90.31.18:4806 , piece_id=RRTHOAKZSK6ZKWLXCMODWX5HZ5I62OMUEBB64FS6RSDLMNL2OESA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.225253190 (17h8m57.384018924s) [noise=true , address=77.90.31.12:4592 , piece_id=4RLI6WE2HS6N2QRLJQZXSYG65EIMVROLJVYNW56CSY254ZLREUYA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.228153169 (17h8m57.386918893s) [noise=true , address=45.91.116.4:4937 , piece_id=AZQ6DES5FGD63E56HNPDEOJJUZNKOF3ZYU33OMOUX47L7ZGYXISQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.244451243 (17h8m57.403216977s) [noise=true , address=45.91.116.9:4263 , piece_id=RYI4SAUA6IXKXAAHC62LDOKQUKQNTEG7QCG4QHUGMSREVGWEMNGA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.274597415 (17h8m57.433363149s) [noise=true , address=45.91.116.5:4299 , piece_id=G2JPCAKEMRINSSYZ24B362KA54Q2T6HDEGJQFHVWNEJGGFGRR2KA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.280700783 (17h8m57.439466517s) [noise=true , address=104.36.82.4:4802 , piece_id=6TH5NRIXI5GLRDDZDKZJZWPQYCK7BTMF2U5TDQYOV3SL227M6IZA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.294073090 (17h8m57.452838824s) [noise=true , address=104.36.82.7:4912 , piece_id=OYVJF5VJJMZGE6E2JREPMGIZGWKQQWAHK4WCUHXFATZZGJXFJW2Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.310065069 (17h8m57.468830803s) [noise=true , address=104.36.82.8:4971 , piece_id=UZT2NT7JR4F7NIXPSY2ORFBQVJOXZSPEJCSLFAHPH4BDSLY2W3DA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.310725412 (17h8m57.469491146s) [noise=true , address=45.91.116.10:4081 , piece_id=YYCAJYYQ4MXTVLBHWA6R66TIAHAEJOUQ7BBH6A3PVB56MCXUXCDA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.327312570 (17h8m57.486078304s) [noise=true , address=77.90.31.15:4697 , piece_id=VLJCK73RVDCWWPAC7HUVHLQV2AYUPRYNEA7SNSO7P2ZMRK2FOLSQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.371703187 (17h8m57.530468921s) [noise=true , address=77.90.31.16:4735 , piece_id=F5ZXRAIRT3GGYVDCOHQWEAWDTJ5DN2OF2AW5YB3W3MTHTUUTVJ6Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.427020261 (17h8m57.585785996s) [noise=true , address=45.91.116.11:4119 , piece_id=RRRPLNZBTVHIQTUMONDVTIBCMEBLBM2RPFCOHX7RBX4HFGZUYS3Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.436406982 (17h8m57.595172716s) [noise=true , address=45.91.116.14:4191 , piece_id=YO65KQXJOPP2BVDRQTEURGV2RDY3M36W4JSPPBTM6LKVHZ7UIEXA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.436435246 (17h8m57.59520098s) [seg_pos={0 0}, upload=14994]: Segment reached optimal threshold of 13 pieces. Aug 26 09:12:30.436615631 (17h8m57.595381365s) [noise=true , address=77.90.31.12:4589 , piece_id=L6ZTZ5PJPV2WM2BZGGAJEKBS4B2TS5S55PSD7WGA2YRH3MTLG5GA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv): protocol: expected piece hash; context canceled; EOF Aug 26 09:12:30.436693600 (17h8m57.595459334s) [noise=true , address=45.91.116.9:4262 , piece_id=WRDGDP5TBAYZTRPBYDW4ZESCR7NJJHVBU6WP4UYC4B3V5D7ICOMA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto): protocol: write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection; write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection Aug 26 09:12:30.436700754 (17h8m57.595466488s) [noise=true , address=104.36.82.10:4079 , piece_id=RSWLIXFVVRXKXD6TI4TDKEPW3HY6XU5AUAAH5N3X4UIFNEU3H5CQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF Aug 26 09:12:30.436750138 (17h8m57.595515872s) [seg_pos={0 0}, upload=14994]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 26 09:12:30.436849909 (17h8m57.595615643s) [upload=14994]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 09:12:30.436855740 (17h8m57.595621474s) [upload=14994]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 09:12:30.739827348 (17h8m57.898593082s) [upload=14994]: Done uploading segments... Aug 26 09:12:30.739846063 (17h8m57.898611797s) [upload=14994]: Upload finished. err: <nil> Duration: 5.834359529s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.................................X...X......................] duration: 5.758353058s FAIL (2025-08-26 09:27:32 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Aug 26 09:12:27.460801938 (17h8m54.619567672s) [upload=14994]: Starting upload Aug 26 09:12:27.460861261 (17h8m54.619626995s) [upload=14994]: Done starting upload Aug 26 09:12:27.460967244 (17h8m54.619732978s) [upload=14994]: Uploading segments... Aug 26 09:12:27.461061044 (17h8m54.619826768s) [upload=14994]: Got next segment. Inline: false Aug 26 09:12:27.461137420 (17h8m54.619903154s) [upload=14994]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 09:12:27.461142410 (17h8m54.619908144s) [upload=14994]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 09:12:27.911433899 (17h8m55.070199633s) [seg_pos={0 0}, upload=14994]: Begin upload segment... Aug 26 09:12:27.911481470 (17h8m55.070247204s) [seg_pos={0 0}, upload=14994]: Done begin upload segment. Aug 26 09:12:27.911501920 (17h8m55.070267654s) [noise=true , address=104.36.82.7:4912 , piece_id=OYVJF5VJJMZGE6E2JREPMGIZGWKQQWAHK4WCUHXFATZZGJXFJW2Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.911554130 (17h8m55.070319904s) [noise=true , address=45.91.116.14:4191 , piece_id=YO65KQXJOPP2BVDRQTEURGV2RDY3M36W4JSPPBTM6LKVHZ7UIEXA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.911868270 (17h8m55.070634004s) [noise=true , address=45.91.116.11:4119 , piece_id=RRRPLNZBTVHIQTUMONDVTIBCMEBLBM2RPFCOHX7RBX4HFGZUYS3Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912181570 (17h8m55.070947305s) [noise=true , address=45.91.116.10:4081 , piece_id=YYCAJYYQ4MXTVLBHWA6R66TIAHAEJOUQ7BBH6A3PVB56MCXUXCDA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912244641 (17h8m55.071010365s) [noise=true , address=77.90.31.16:4735 , piece_id=F5ZXRAIRT3GGYVDCOHQWEAWDTJ5DN2OF2AW5YB3W3MTHTUUTVJ6Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912475152 (17h8m55.071240886s) [noise=true , address=45.91.116.5:4299 , piece_id=G2JPCAKEMRINSSYZ24B362KA54Q2T6HDEGJQFHVWNEJGGFGRR2KA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912684673 (17h8m55.071450407s) [noise=true , address=45.91.116.9:4262 , piece_id=WRDGDP5TBAYZTRPBYDW4ZESCR7NJJHVBU6WP4UYC4B3V5D7ICOMA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912718718 (17h8m55.071484452s) [noise=true , address=77.90.31.18:4806 , piece_id=RRTHOAKZSK6ZKWLXCMODWX5HZ5I62OMUEBB64FS6RSDLMNL2OESA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912890155 (17h8m55.071655889s) [noise=true , address=45.91.116.4:4937 , piece_id=AZQ6DES5FGD63E56HNPDEOJJUZNKOF3ZYU33OMOUX47L7ZGYXISQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912973765 (17h8m55.071739499s) [noise=true , address=104.36.82.4:4802 , piece_id=6TH5NRIXI5GLRDDZDKZJZWPQYCK7BTMF2U5TDQYOV3SL227M6IZA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913095419 (17h8m55.071861153s) [noise=true , address=104.36.82.10:4079 , piece_id=RSWLIXFVVRXKXD6TI4TDKEPW3HY6XU5AUAAH5N3X4UIFNEU3H5CQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913202434 (17h8m55.071968168s) [noise=true , address=77.90.31.15:4697 , piece_id=VLJCK73RVDCWWPAC7HUVHLQV2AYUPRYNEA7SNSO7P2ZMRK2FOLSQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913320449 (17h8m55.072086183s) [noise=true , address=45.91.116.9:4263 , piece_id=RYI4SAUA6IXKXAAHC62LDOKQUKQNTEG7QCG4QHUGMSREVGWEMNGA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913452622 (17h8m55.072218356s) [noise=true , address=77.90.31.12:4592 , piece_id=4RLI6WE2HS6N2QRLJQZXSYG65EIMVROLJVYNW56CSY254ZLREUYA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913534449 (17h8m55.072300183s) [noise=true , address=104.36.82.8:4971 , piece_id=UZT2NT7JR4F7NIXPSY2ORFBQVJOXZSPEJCSLFAHPH4BDSLY2W3DA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913650701 (17h8m55.072416435s) [noise=true , address=77.90.31.12:4589 , piece_id=L6ZTZ5PJPV2WM2BZGGAJEKBS4B2TS5S55PSD7WGA2YRH3MTLG5GA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:29.900914740 (17h8m57.059680464s) [upload=14994]: Next returned nil segment Aug 26 09:12:29.900934336 (17h8m57.059700081s) [upload=14994]: Waiting for error group managing segments... Aug 26 09:12:30.221707715 (17h8m57.380473449s) [noise=true , address=77.90.31.18:4806 , piece_id=RRTHOAKZSK6ZKWLXCMODWX5HZ5I62OMUEBB64FS6RSDLMNL2OESA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.225253190 (17h8m57.384018924s) [noise=true , address=77.90.31.12:4592 , piece_id=4RLI6WE2HS6N2QRLJQZXSYG65EIMVROLJVYNW56CSY254ZLREUYA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.228153169 (17h8m57.386918893s) [noise=true , address=45.91.116.4:4937 , piece_id=AZQ6DES5FGD63E56HNPDEOJJUZNKOF3ZYU33OMOUX47L7ZGYXISQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.244451243 (17h8m57.403216977s) [noise=true , address=45.91.116.9:4263 , piece_id=RYI4SAUA6IXKXAAHC62LDOKQUKQNTEG7QCG4QHUGMSREVGWEMNGA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.274597415 (17h8m57.433363149s) [noise=true , address=45.91.116.5:4299 , piece_id=G2JPCAKEMRINSSYZ24B362KA54Q2T6HDEGJQFHVWNEJGGFGRR2KA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.280700783 (17h8m57.439466517s) [noise=true , address=104.36.82.4:4802 , piece_id=6TH5NRIXI5GLRDDZDKZJZWPQYCK7BTMF2U5TDQYOV3SL227M6IZA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.294073090 (17h8m57.452838824s) [noise=true , address=104.36.82.7:4912 , piece_id=OYVJF5VJJMZGE6E2JREPMGIZGWKQQWAHK4WCUHXFATZZGJXFJW2Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.310065069 (17h8m57.468830803s) [noise=true , address=104.36.82.8:4971 , piece_id=UZT2NT7JR4F7NIXPSY2ORFBQVJOXZSPEJCSLFAHPH4BDSLY2W3DA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.310725412 (17h8m57.469491146s) [noise=true , address=45.91.116.10:4081 , piece_id=YYCAJYYQ4MXTVLBHWA6R66TIAHAEJOUQ7BBH6A3PVB56MCXUXCDA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.327312570 (17h8m57.486078304s) [noise=true , address=77.90.31.15:4697 , piece_id=VLJCK73RVDCWWPAC7HUVHLQV2AYUPRYNEA7SNSO7P2ZMRK2FOLSQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.371703187 (17h8m57.530468921s) [noise=true , address=77.90.31.16:4735 , piece_id=F5ZXRAIRT3GGYVDCOHQWEAWDTJ5DN2OF2AW5YB3W3MTHTUUTVJ6Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.427020261 (17h8m57.585785996s) [noise=true , address=45.91.116.11:4119 , piece_id=RRRPLNZBTVHIQTUMONDVTIBCMEBLBM2RPFCOHX7RBX4HFGZUYS3Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.436406982 (17h8m57.595172716s) [noise=true , address=45.91.116.14:4191 , piece_id=YO65KQXJOPP2BVDRQTEURGV2RDY3M36W4JSPPBTM6LKVHZ7UIEXA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.436435246 (17h8m57.59520098s) [seg_pos={0 0}, upload=14994]: Segment reached optimal threshold of 13 pieces. Aug 26 09:12:30.436615631 (17h8m57.595381365s) [noise=true , address=77.90.31.12:4589 , piece_id=L6ZTZ5PJPV2WM2BZGGAJEKBS4B2TS5S55PSD7WGA2YRH3MTLG5GA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv): protocol: expected piece hash; context canceled; EOF Aug 26 09:12:30.436693600 (17h8m57.595459334s) [noise=true , address=45.91.116.9:4262 , piece_id=WRDGDP5TBAYZTRPBYDW4ZESCR7NJJHVBU6WP4UYC4B3V5D7ICOMA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto): protocol: write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection; write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection Aug 26 09:12:30.436700754 (17h8m57.595466488s) [noise=true , address=104.36.82.10:4079 , piece_id=RSWLIXFVVRXKXD6TI4TDKEPW3HY6XU5AUAAH5N3X4UIFNEU3H5CQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF Aug 26 09:12:30.436750138 (17h8m57.595515872s) [seg_pos={0 0}, upload=14994]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 26 09:12:30.436849909 (17h8m57.595615643s) [upload=14994]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 09:12:30.436855740 (17h8m57.595621474s) [upload=14994]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 09:12:30.739827348 (17h8m57.898593082s) [upload=14994]: Done uploading segments... Aug 26 09:12:30.739846063 (17h8m57.898611797s) [upload=14994]: Upload finished. err: <nil> Duration: 5.758376933s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 4.967862879s FAIL (2025-08-26 09:27:28 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 4.967901373s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 4.823985052s FAIL (2025-08-26 09:27:01 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 4.824017395s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..................................X...X.....................] duration: 5.988153369s FAIL (2025-08-26 09:26:57 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Aug 26 09:12:27.460801938 (17h8m54.619567672s) [upload=14994]: Starting upload Aug 26 09:12:27.460861261 (17h8m54.619626995s) [upload=14994]: Done starting upload Aug 26 09:12:27.460967244 (17h8m54.619732978s) [upload=14994]: Uploading segments... Aug 26 09:12:27.461061044 (17h8m54.619826768s) [upload=14994]: Got next segment. Inline: false Aug 26 09:12:27.461137420 (17h8m54.619903154s) [upload=14994]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 09:12:27.461142410 (17h8m54.619908144s) [upload=14994]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 09:12:27.911433899 (17h8m55.070199633s) [seg_pos={0 0}, upload=14994]: Begin upload segment... Aug 26 09:12:27.911481470 (17h8m55.070247204s) [seg_pos={0 0}, upload=14994]: Done begin upload segment. Aug 26 09:12:27.911501920 (17h8m55.070267654s) [noise=true , address=104.36.82.7:4912 , piece_id=OYVJF5VJJMZGE6E2JREPMGIZGWKQQWAHK4WCUHXFATZZGJXFJW2Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.911554130 (17h8m55.070319904s) [noise=true , address=45.91.116.14:4191 , piece_id=YO65KQXJOPP2BVDRQTEURGV2RDY3M36W4JSPPBTM6LKVHZ7UIEXA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.911868270 (17h8m55.070634004s) [noise=true , address=45.91.116.11:4119 , piece_id=RRRPLNZBTVHIQTUMONDVTIBCMEBLBM2RPFCOHX7RBX4HFGZUYS3Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912181570 (17h8m55.070947305s) [noise=true , address=45.91.116.10:4081 , piece_id=YYCAJYYQ4MXTVLBHWA6R66TIAHAEJOUQ7BBH6A3PVB56MCXUXCDA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912244641 (17h8m55.071010365s) [noise=true , address=77.90.31.16:4735 , piece_id=F5ZXRAIRT3GGYVDCOHQWEAWDTJ5DN2OF2AW5YB3W3MTHTUUTVJ6Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912475152 (17h8m55.071240886s) [noise=true , address=45.91.116.5:4299 , piece_id=G2JPCAKEMRINSSYZ24B362KA54Q2T6HDEGJQFHVWNEJGGFGRR2KA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912684673 (17h8m55.071450407s) [noise=true , address=45.91.116.9:4262 , piece_id=WRDGDP5TBAYZTRPBYDW4ZESCR7NJJHVBU6WP4UYC4B3V5D7ICOMA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912718718 (17h8m55.071484452s) [noise=true , address=77.90.31.18:4806 , piece_id=RRTHOAKZSK6ZKWLXCMODWX5HZ5I62OMUEBB64FS6RSDLMNL2OESA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912890155 (17h8m55.071655889s) [noise=true , address=45.91.116.4:4937 , piece_id=AZQ6DES5FGD63E56HNPDEOJJUZNKOF3ZYU33OMOUX47L7ZGYXISQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912973765 (17h8m55.071739499s) [noise=true , address=104.36.82.4:4802 , piece_id=6TH5NRIXI5GLRDDZDKZJZWPQYCK7BTMF2U5TDQYOV3SL227M6IZA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913095419 (17h8m55.071861153s) [noise=true , address=104.36.82.10:4079 , piece_id=RSWLIXFVVRXKXD6TI4TDKEPW3HY6XU5AUAAH5N3X4UIFNEU3H5CQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913202434 (17h8m55.071968168s) [noise=true , address=77.90.31.15:4697 , piece_id=VLJCK73RVDCWWPAC7HUVHLQV2AYUPRYNEA7SNSO7P2ZMRK2FOLSQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913320449 (17h8m55.072086183s) [noise=true , address=45.91.116.9:4263 , piece_id=RYI4SAUA6IXKXAAHC62LDOKQUKQNTEG7QCG4QHUGMSREVGWEMNGA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913452622 (17h8m55.072218356s) [noise=true , address=77.90.31.12:4592 , piece_id=4RLI6WE2HS6N2QRLJQZXSYG65EIMVROLJVYNW56CSY254ZLREUYA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913534449 (17h8m55.072300183s) [noise=true , address=104.36.82.8:4971 , piece_id=UZT2NT7JR4F7NIXPSY2ORFBQVJOXZSPEJCSLFAHPH4BDSLY2W3DA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913650701 (17h8m55.072416435s) [noise=true , address=77.90.31.12:4589 , piece_id=L6ZTZ5PJPV2WM2BZGGAJEKBS4B2TS5S55PSD7WGA2YRH3MTLG5GA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:29.900914740 (17h8m57.059680464s) [upload=14994]: Next returned nil segment Aug 26 09:12:29.900934336 (17h8m57.059700081s) [upload=14994]: Waiting for error group managing segments... Aug 26 09:12:30.221707715 (17h8m57.380473449s) [noise=true , address=77.90.31.18:4806 , piece_id=RRTHOAKZSK6ZKWLXCMODWX5HZ5I62OMUEBB64FS6RSDLMNL2OESA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.225253190 (17h8m57.384018924s) [noise=true , address=77.90.31.12:4592 , piece_id=4RLI6WE2HS6N2QRLJQZXSYG65EIMVROLJVYNW56CSY254ZLREUYA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.228153169 (17h8m57.386918893s) [noise=true , address=45.91.116.4:4937 , piece_id=AZQ6DES5FGD63E56HNPDEOJJUZNKOF3ZYU33OMOUX47L7ZGYXISQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.244451243 (17h8m57.403216977s) [noise=true , address=45.91.116.9:4263 , piece_id=RYI4SAUA6IXKXAAHC62LDOKQUKQNTEG7QCG4QHUGMSREVGWEMNGA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.274597415 (17h8m57.433363149s) [noise=true , address=45.91.116.5:4299 , piece_id=G2JPCAKEMRINSSYZ24B362KA54Q2T6HDEGJQFHVWNEJGGFGRR2KA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.280700783 (17h8m57.439466517s) [noise=true , address=104.36.82.4:4802 , piece_id=6TH5NRIXI5GLRDDZDKZJZWPQYCK7BTMF2U5TDQYOV3SL227M6IZA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.294073090 (17h8m57.452838824s) [noise=true , address=104.36.82.7:4912 , piece_id=OYVJF5VJJMZGE6E2JREPMGIZGWKQQWAHK4WCUHXFATZZGJXFJW2Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.310065069 (17h8m57.468830803s) [noise=true , address=104.36.82.8:4971 , piece_id=UZT2NT7JR4F7NIXPSY2ORFBQVJOXZSPEJCSLFAHPH4BDSLY2W3DA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.310725412 (17h8m57.469491146s) [noise=true , address=45.91.116.10:4081 , piece_id=YYCAJYYQ4MXTVLBHWA6R66TIAHAEJOUQ7BBH6A3PVB56MCXUXCDA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.327312570 (17h8m57.486078304s) [noise=true , address=77.90.31.15:4697 , piece_id=VLJCK73RVDCWWPAC7HUVHLQV2AYUPRYNEA7SNSO7P2ZMRK2FOLSQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.371703187 (17h8m57.530468921s) [noise=true , address=77.90.31.16:4735 , piece_id=F5ZXRAIRT3GGYVDCOHQWEAWDTJ5DN2OF2AW5YB3W3MTHTUUTVJ6Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.427020261 (17h8m57.585785996s) [noise=true , address=45.91.116.11:4119 , piece_id=RRRPLNZBTVHIQTUMONDVTIBCMEBLBM2RPFCOHX7RBX4HFGZUYS3Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.436406982 (17h8m57.595172716s) [noise=true , address=45.91.116.14:4191 , piece_id=YO65KQXJOPP2BVDRQTEURGV2RDY3M36W4JSPPBTM6LKVHZ7UIEXA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.436435246 (17h8m57.59520098s) [seg_pos={0 0}, upload=14994]: Segment reached optimal threshold of 13 pieces. Aug 26 09:12:30.436615631 (17h8m57.595381365s) [noise=true , address=77.90.31.12:4589 , piece_id=L6ZTZ5PJPV2WM2BZGGAJEKBS4B2TS5S55PSD7WGA2YRH3MTLG5GA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv): protocol: expected piece hash; context canceled; EOF Aug 26 09:12:30.436693600 (17h8m57.595459334s) [noise=true , address=45.91.116.9:4262 , piece_id=WRDGDP5TBAYZTRPBYDW4ZESCR7NJJHVBU6WP4UYC4B3V5D7ICOMA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto): protocol: write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection; write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection Aug 26 09:12:30.436700754 (17h8m57.595466488s) [noise=true , address=104.36.82.10:4079 , piece_id=RSWLIXFVVRXKXD6TI4TDKEPW3HY6XU5AUAAH5N3X4UIFNEU3H5CQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF Aug 26 09:12:30.436750138 (17h8m57.595515872s) [seg_pos={0 0}, upload=14994]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 26 09:12:30.436849909 (17h8m57.595615643s) [upload=14994]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 09:12:30.436855740 (17h8m57.595621474s) [upload=14994]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 09:12:30.739827348 (17h8m57.898593082s) [upload=14994]: Done uploading segments... Aug 26 09:12:30.739846063 (17h8m57.898611797s) [upload=14994]: Upload finished. err: <nil> Duration: 5.988189058s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 5.076014438s FAIL (2025-08-26 09:25:51 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 5.076058111s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...................................X...X....................] duration: 5.77874701s FAIL (2025-08-26 09:25:47 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Aug 26 09:12:27.460801938 (17h8m54.619567672s) [upload=14994]: Starting upload Aug 26 09:12:27.460861261 (17h8m54.619626995s) [upload=14994]: Done starting upload Aug 26 09:12:27.460967244 (17h8m54.619732978s) [upload=14994]: Uploading segments... Aug 26 09:12:27.461061044 (17h8m54.619826768s) [upload=14994]: Got next segment. Inline: false Aug 26 09:12:27.461137420 (17h8m54.619903154s) [upload=14994]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 09:12:27.461142410 (17h8m54.619908144s) [upload=14994]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 09:12:27.911433899 (17h8m55.070199633s) [seg_pos={0 0}, upload=14994]: Begin upload segment... Aug 26 09:12:27.911481470 (17h8m55.070247204s) [seg_pos={0 0}, upload=14994]: Done begin upload segment. Aug 26 09:12:27.911501920 (17h8m55.070267654s) [noise=true , address=104.36.82.7:4912 , piece_id=OYVJF5VJJMZGE6E2JREPMGIZGWKQQWAHK4WCUHXFATZZGJXFJW2Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.911554130 (17h8m55.070319904s) [noise=true , address=45.91.116.14:4191 , piece_id=YO65KQXJOPP2BVDRQTEURGV2RDY3M36W4JSPPBTM6LKVHZ7UIEXA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.911868270 (17h8m55.070634004s) [noise=true , address=45.91.116.11:4119 , piece_id=RRRPLNZBTVHIQTUMONDVTIBCMEBLBM2RPFCOHX7RBX4HFGZUYS3Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912181570 (17h8m55.070947305s) [noise=true , address=45.91.116.10:4081 , piece_id=YYCAJYYQ4MXTVLBHWA6R66TIAHAEJOUQ7BBH6A3PVB56MCXUXCDA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912244641 (17h8m55.071010365s) [noise=true , address=77.90.31.16:4735 , piece_id=F5ZXRAIRT3GGYVDCOHQWEAWDTJ5DN2OF2AW5YB3W3MTHTUUTVJ6Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912475152 (17h8m55.071240886s) [noise=true , address=45.91.116.5:4299 , piece_id=G2JPCAKEMRINSSYZ24B362KA54Q2T6HDEGJQFHVWNEJGGFGRR2KA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912684673 (17h8m55.071450407s) [noise=true , address=45.91.116.9:4262 , piece_id=WRDGDP5TBAYZTRPBYDW4ZESCR7NJJHVBU6WP4UYC4B3V5D7ICOMA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912718718 (17h8m55.071484452s) [noise=true , address=77.90.31.18:4806 , piece_id=RRTHOAKZSK6ZKWLXCMODWX5HZ5I62OMUEBB64FS6RSDLMNL2OESA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912890155 (17h8m55.071655889s) [noise=true , address=45.91.116.4:4937 , piece_id=AZQ6DES5FGD63E56HNPDEOJJUZNKOF3ZYU33OMOUX47L7ZGYXISQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912973765 (17h8m55.071739499s) [noise=true , address=104.36.82.4:4802 , piece_id=6TH5NRIXI5GLRDDZDKZJZWPQYCK7BTMF2U5TDQYOV3SL227M6IZA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913095419 (17h8m55.071861153s) [noise=true , address=104.36.82.10:4079 , piece_id=RSWLIXFVVRXKXD6TI4TDKEPW3HY6XU5AUAAH5N3X4UIFNEU3H5CQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913202434 (17h8m55.071968168s) [noise=true , address=77.90.31.15:4697 , piece_id=VLJCK73RVDCWWPAC7HUVHLQV2AYUPRYNEA7SNSO7P2ZMRK2FOLSQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913320449 (17h8m55.072086183s) [noise=true , address=45.91.116.9:4263 , piece_id=RYI4SAUA6IXKXAAHC62LDOKQUKQNTEG7QCG4QHUGMSREVGWEMNGA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913452622 (17h8m55.072218356s) [noise=true , address=77.90.31.12:4592 , piece_id=4RLI6WE2HS6N2QRLJQZXSYG65EIMVROLJVYNW56CSY254ZLREUYA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913534449 (17h8m55.072300183s) [noise=true , address=104.36.82.8:4971 , piece_id=UZT2NT7JR4F7NIXPSY2ORFBQVJOXZSPEJCSLFAHPH4BDSLY2W3DA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913650701 (17h8m55.072416435s) [noise=true , address=77.90.31.12:4589 , piece_id=L6ZTZ5PJPV2WM2BZGGAJEKBS4B2TS5S55PSD7WGA2YRH3MTLG5GA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:29.900914740 (17h8m57.059680464s) [upload=14994]: Next returned nil segment Aug 26 09:12:29.900934336 (17h8m57.059700081s) [upload=14994]: Waiting for error group managing segments... Aug 26 09:12:30.221707715 (17h8m57.380473449s) [noise=true , address=77.90.31.18:4806 , piece_id=RRTHOAKZSK6ZKWLXCMODWX5HZ5I62OMUEBB64FS6RSDLMNL2OESA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.225253190 (17h8m57.384018924s) [noise=true , address=77.90.31.12:4592 , piece_id=4RLI6WE2HS6N2QRLJQZXSYG65EIMVROLJVYNW56CSY254ZLREUYA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.228153169 (17h8m57.386918893s) [noise=true , address=45.91.116.4:4937 , piece_id=AZQ6DES5FGD63E56HNPDEOJJUZNKOF3ZYU33OMOUX47L7ZGYXISQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.244451243 (17h8m57.403216977s) [noise=true , address=45.91.116.9:4263 , piece_id=RYI4SAUA6IXKXAAHC62LDOKQUKQNTEG7QCG4QHUGMSREVGWEMNGA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.274597415 (17h8m57.433363149s) [noise=true , address=45.91.116.5:4299 , piece_id=G2JPCAKEMRINSSYZ24B362KA54Q2T6HDEGJQFHVWNEJGGFGRR2KA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.280700783 (17h8m57.439466517s) [noise=true , address=104.36.82.4:4802 , piece_id=6TH5NRIXI5GLRDDZDKZJZWPQYCK7BTMF2U5TDQYOV3SL227M6IZA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.294073090 (17h8m57.452838824s) [noise=true , address=104.36.82.7:4912 , piece_id=OYVJF5VJJMZGE6E2JREPMGIZGWKQQWAHK4WCUHXFATZZGJXFJW2Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.310065069 (17h8m57.468830803s) [noise=true , address=104.36.82.8:4971 , piece_id=UZT2NT7JR4F7NIXPSY2ORFBQVJOXZSPEJCSLFAHPH4BDSLY2W3DA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.310725412 (17h8m57.469491146s) [noise=true , address=45.91.116.10:4081 , piece_id=YYCAJYYQ4MXTVLBHWA6R66TIAHAEJOUQ7BBH6A3PVB56MCXUXCDA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.327312570 (17h8m57.486078304s) [noise=true , address=77.90.31.15:4697 , piece_id=VLJCK73RVDCWWPAC7HUVHLQV2AYUPRYNEA7SNSO7P2ZMRK2FOLSQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.371703187 (17h8m57.530468921s) [noise=true , address=77.90.31.16:4735 , piece_id=F5ZXRAIRT3GGYVDCOHQWEAWDTJ5DN2OF2AW5YB3W3MTHTUUTVJ6Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.427020261 (17h8m57.585785996s) [noise=true , address=45.91.116.11:4119 , piece_id=RRRPLNZBTVHIQTUMONDVTIBCMEBLBM2RPFCOHX7RBX4HFGZUYS3Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.436406982 (17h8m57.595172716s) [noise=true , address=45.91.116.14:4191 , piece_id=YO65KQXJOPP2BVDRQTEURGV2RDY3M36W4JSPPBTM6LKVHZ7UIEXA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.436435246 (17h8m57.59520098s) [seg_pos={0 0}, upload=14994]: Segment reached optimal threshold of 13 pieces. Aug 26 09:12:30.436615631 (17h8m57.595381365s) [noise=true , address=77.90.31.12:4589 , piece_id=L6ZTZ5PJPV2WM2BZGGAJEKBS4B2TS5S55PSD7WGA2YRH3MTLG5GA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv): protocol: expected piece hash; context canceled; EOF Aug 26 09:12:30.436693600 (17h8m57.595459334s) [noise=true , address=45.91.116.9:4262 , piece_id=WRDGDP5TBAYZTRPBYDW4ZESCR7NJJHVBU6WP4UYC4B3V5D7ICOMA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto): protocol: write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection; write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection Aug 26 09:12:30.436700754 (17h8m57.595466488s) [noise=true , address=104.36.82.10:4079 , piece_id=RSWLIXFVVRXKXD6TI4TDKEPW3HY6XU5AUAAH5N3X4UIFNEU3H5CQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF Aug 26 09:12:30.436750138 (17h8m57.595515872s) [seg_pos={0 0}, upload=14994]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 26 09:12:30.436849909 (17h8m57.595615643s) [upload=14994]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 09:12:30.436855740 (17h8m57.595621474s) [upload=14994]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 09:12:30.739827348 (17h8m57.898593082s) [upload=14994]: Done uploading segments... Aug 26 09:12:30.739846063 (17h8m57.898611797s) [upload=14994]: Upload finished. err: <nil> Duration: 5.778769934s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 5.036238701s FAIL (2025-08-26 09:25:31 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 5.03626891s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [....................................X...X...................] duration: 5.700445286s FAIL (2025-08-26 09:24:36 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Aug 26 09:12:27.460801938 (17h8m54.619567672s) [upload=14994]: Starting upload Aug 26 09:12:27.460861261 (17h8m54.619626995s) [upload=14994]: Done starting upload Aug 26 09:12:27.460967244 (17h8m54.619732978s) [upload=14994]: Uploading segments... Aug 26 09:12:27.461061044 (17h8m54.619826768s) [upload=14994]: Got next segment. Inline: false Aug 26 09:12:27.461137420 (17h8m54.619903154s) [upload=14994]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 09:12:27.461142410 (17h8m54.619908144s) [upload=14994]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 09:12:27.911433899 (17h8m55.070199633s) [seg_pos={0 0}, upload=14994]: Begin upload segment... Aug 26 09:12:27.911481470 (17h8m55.070247204s) [seg_pos={0 0}, upload=14994]: Done begin upload segment. Aug 26 09:12:27.911501920 (17h8m55.070267654s) [noise=true , address=104.36.82.7:4912 , piece_id=OYVJF5VJJMZGE6E2JREPMGIZGWKQQWAHK4WCUHXFATZZGJXFJW2Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.911554130 (17h8m55.070319904s) [noise=true , address=45.91.116.14:4191 , piece_id=YO65KQXJOPP2BVDRQTEURGV2RDY3M36W4JSPPBTM6LKVHZ7UIEXA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.911868270 (17h8m55.070634004s) [noise=true , address=45.91.116.11:4119 , piece_id=RRRPLNZBTVHIQTUMONDVTIBCMEBLBM2RPFCOHX7RBX4HFGZUYS3Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912181570 (17h8m55.070947305s) [noise=true , address=45.91.116.10:4081 , piece_id=YYCAJYYQ4MXTVLBHWA6R66TIAHAEJOUQ7BBH6A3PVB56MCXUXCDA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912244641 (17h8m55.071010365s) [noise=true , address=77.90.31.16:4735 , piece_id=F5ZXRAIRT3GGYVDCOHQWEAWDTJ5DN2OF2AW5YB3W3MTHTUUTVJ6Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912475152 (17h8m55.071240886s) [noise=true , address=45.91.116.5:4299 , piece_id=G2JPCAKEMRINSSYZ24B362KA54Q2T6HDEGJQFHVWNEJGGFGRR2KA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912684673 (17h8m55.071450407s) [noise=true , address=45.91.116.9:4262 , piece_id=WRDGDP5TBAYZTRPBYDW4ZESCR7NJJHVBU6WP4UYC4B3V5D7ICOMA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912718718 (17h8m55.071484452s) [noise=true , address=77.90.31.18:4806 , piece_id=RRTHOAKZSK6ZKWLXCMODWX5HZ5I62OMUEBB64FS6RSDLMNL2OESA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912890155 (17h8m55.071655889s) [noise=true , address=45.91.116.4:4937 , piece_id=AZQ6DES5FGD63E56HNPDEOJJUZNKOF3ZYU33OMOUX47L7ZGYXISQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912973765 (17h8m55.071739499s) [noise=true , address=104.36.82.4:4802 , piece_id=6TH5NRIXI5GLRDDZDKZJZWPQYCK7BTMF2U5TDQYOV3SL227M6IZA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913095419 (17h8m55.071861153s) [noise=true , address=104.36.82.10:4079 , piece_id=RSWLIXFVVRXKXD6TI4TDKEPW3HY6XU5AUAAH5N3X4UIFNEU3H5CQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913202434 (17h8m55.071968168s) [noise=true , address=77.90.31.15:4697 , piece_id=VLJCK73RVDCWWPAC7HUVHLQV2AYUPRYNEA7SNSO7P2ZMRK2FOLSQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913320449 (17h8m55.072086183s) [noise=true , address=45.91.116.9:4263 , piece_id=RYI4SAUA6IXKXAAHC62LDOKQUKQNTEG7QCG4QHUGMSREVGWEMNGA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913452622 (17h8m55.072218356s) [noise=true , address=77.90.31.12:4592 , piece_id=4RLI6WE2HS6N2QRLJQZXSYG65EIMVROLJVYNW56CSY254ZLREUYA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913534449 (17h8m55.072300183s) [noise=true , address=104.36.82.8:4971 , piece_id=UZT2NT7JR4F7NIXPSY2ORFBQVJOXZSPEJCSLFAHPH4BDSLY2W3DA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913650701 (17h8m55.072416435s) [noise=true , address=77.90.31.12:4589 , piece_id=L6ZTZ5PJPV2WM2BZGGAJEKBS4B2TS5S55PSD7WGA2YRH3MTLG5GA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:29.900914740 (17h8m57.059680464s) [upload=14994]: Next returned nil segment Aug 26 09:12:29.900934336 (17h8m57.059700081s) [upload=14994]: Waiting for error group managing segments... Aug 26 09:12:30.221707715 (17h8m57.380473449s) [noise=true , address=77.90.31.18:4806 , piece_id=RRTHOAKZSK6ZKWLXCMODWX5HZ5I62OMUEBB64FS6RSDLMNL2OESA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.225253190 (17h8m57.384018924s) [noise=true , address=77.90.31.12:4592 , piece_id=4RLI6WE2HS6N2QRLJQZXSYG65EIMVROLJVYNW56CSY254ZLREUYA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.228153169 (17h8m57.386918893s) [noise=true , address=45.91.116.4:4937 , piece_id=AZQ6DES5FGD63E56HNPDEOJJUZNKOF3ZYU33OMOUX47L7ZGYXISQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.244451243 (17h8m57.403216977s) [noise=true , address=45.91.116.9:4263 , piece_id=RYI4SAUA6IXKXAAHC62LDOKQUKQNTEG7QCG4QHUGMSREVGWEMNGA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.274597415 (17h8m57.433363149s) [noise=true , address=45.91.116.5:4299 , piece_id=G2JPCAKEMRINSSYZ24B362KA54Q2T6HDEGJQFHVWNEJGGFGRR2KA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.280700783 (17h8m57.439466517s) [noise=true , address=104.36.82.4:4802 , piece_id=6TH5NRIXI5GLRDDZDKZJZWPQYCK7BTMF2U5TDQYOV3SL227M6IZA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.294073090 (17h8m57.452838824s) [noise=true , address=104.36.82.7:4912 , piece_id=OYVJF5VJJMZGE6E2JREPMGIZGWKQQWAHK4WCUHXFATZZGJXFJW2Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.310065069 (17h8m57.468830803s) [noise=true , address=104.36.82.8:4971 , piece_id=UZT2NT7JR4F7NIXPSY2ORFBQVJOXZSPEJCSLFAHPH4BDSLY2W3DA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.310725412 (17h8m57.469491146s) [noise=true , address=45.91.116.10:4081 , piece_id=YYCAJYYQ4MXTVLBHWA6R66TIAHAEJOUQ7BBH6A3PVB56MCXUXCDA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.327312570 (17h8m57.486078304s) [noise=true , address=77.90.31.15:4697 , piece_id=VLJCK73RVDCWWPAC7HUVHLQV2AYUPRYNEA7SNSO7P2ZMRK2FOLSQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.371703187 (17h8m57.530468921s) [noise=true , address=77.90.31.16:4735 , piece_id=F5ZXRAIRT3GGYVDCOHQWEAWDTJ5DN2OF2AW5YB3W3MTHTUUTVJ6Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.427020261 (17h8m57.585785996s) [noise=true , address=45.91.116.11:4119 , piece_id=RRRPLNZBTVHIQTUMONDVTIBCMEBLBM2RPFCOHX7RBX4HFGZUYS3Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.436406982 (17h8m57.595172716s) [noise=true , address=45.91.116.14:4191 , piece_id=YO65KQXJOPP2BVDRQTEURGV2RDY3M36W4JSPPBTM6LKVHZ7UIEXA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.436435246 (17h8m57.59520098s) [seg_pos={0 0}, upload=14994]: Segment reached optimal threshold of 13 pieces. Aug 26 09:12:30.436615631 (17h8m57.595381365s) [noise=true , address=77.90.31.12:4589 , piece_id=L6ZTZ5PJPV2WM2BZGGAJEKBS4B2TS5S55PSD7WGA2YRH3MTLG5GA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv): protocol: expected piece hash; context canceled; EOF Aug 26 09:12:30.436693600 (17h8m57.595459334s) [noise=true , address=45.91.116.9:4262 , piece_id=WRDGDP5TBAYZTRPBYDW4ZESCR7NJJHVBU6WP4UYC4B3V5D7ICOMA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto): protocol: write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection; write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection Aug 26 09:12:30.436700754 (17h8m57.595466488s) [noise=true , address=104.36.82.10:4079 , piece_id=RSWLIXFVVRXKXD6TI4TDKEPW3HY6XU5AUAAH5N3X4UIFNEU3H5CQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF Aug 26 09:12:30.436750138 (17h8m57.595515872s) [seg_pos={0 0}, upload=14994]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 26 09:12:30.436849909 (17h8m57.595615643s) [upload=14994]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 09:12:30.436855740 (17h8m57.595621474s) [upload=14994]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 09:12:30.739827348 (17h8m57.898593082s) [upload=14994]: Done uploading segments... Aug 26 09:12:30.739846063 (17h8m57.898611797s) [upload=14994]: Upload finished. err: <nil> Duration: 5.700472047s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 4.936997503s FAIL (2025-08-26 09:24:31 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 4.937036427s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....................................X...X..................] duration: 5.771590778s FAIL (2025-08-26 09:24:20 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Aug 26 09:12:27.460801938 (17h8m54.619567672s) [upload=14994]: Starting upload Aug 26 09:12:27.460861261 (17h8m54.619626995s) [upload=14994]: Done starting upload Aug 26 09:12:27.460967244 (17h8m54.619732978s) [upload=14994]: Uploading segments... Aug 26 09:12:27.461061044 (17h8m54.619826768s) [upload=14994]: Got next segment. Inline: false Aug 26 09:12:27.461137420 (17h8m54.619903154s) [upload=14994]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 09:12:27.461142410 (17h8m54.619908144s) [upload=14994]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 09:12:27.911433899 (17h8m55.070199633s) [seg_pos={0 0}, upload=14994]: Begin upload segment... Aug 26 09:12:27.911481470 (17h8m55.070247204s) [seg_pos={0 0}, upload=14994]: Done begin upload segment. Aug 26 09:12:27.911501920 (17h8m55.070267654s) [noise=true , address=104.36.82.7:4912 , piece_id=OYVJF5VJJMZGE6E2JREPMGIZGWKQQWAHK4WCUHXFATZZGJXFJW2Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.911554130 (17h8m55.070319904s) [noise=true , address=45.91.116.14:4191 , piece_id=YO65KQXJOPP2BVDRQTEURGV2RDY3M36W4JSPPBTM6LKVHZ7UIEXA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.911868270 (17h8m55.070634004s) [noise=true , address=45.91.116.11:4119 , piece_id=RRRPLNZBTVHIQTUMONDVTIBCMEBLBM2RPFCOHX7RBX4HFGZUYS3Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912181570 (17h8m55.070947305s) [noise=true , address=45.91.116.10:4081 , piece_id=YYCAJYYQ4MXTVLBHWA6R66TIAHAEJOUQ7BBH6A3PVB56MCXUXCDA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912244641 (17h8m55.071010365s) [noise=true , address=77.90.31.16:4735 , piece_id=F5ZXRAIRT3GGYVDCOHQWEAWDTJ5DN2OF2AW5YB3W3MTHTUUTVJ6Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912475152 (17h8m55.071240886s) [noise=true , address=45.91.116.5:4299 , piece_id=G2JPCAKEMRINSSYZ24B362KA54Q2T6HDEGJQFHVWNEJGGFGRR2KA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912684673 (17h8m55.071450407s) [noise=true , address=45.91.116.9:4262 , piece_id=WRDGDP5TBAYZTRPBYDW4ZESCR7NJJHVBU6WP4UYC4B3V5D7ICOMA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912718718 (17h8m55.071484452s) [noise=true , address=77.90.31.18:4806 , piece_id=RRTHOAKZSK6ZKWLXCMODWX5HZ5I62OMUEBB64FS6RSDLMNL2OESA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912890155 (17h8m55.071655889s) [noise=true , address=45.91.116.4:4937 , piece_id=AZQ6DES5FGD63E56HNPDEOJJUZNKOF3ZYU33OMOUX47L7ZGYXISQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912973765 (17h8m55.071739499s) [noise=true , address=104.36.82.4:4802 , piece_id=6TH5NRIXI5GLRDDZDKZJZWPQYCK7BTMF2U5TDQYOV3SL227M6IZA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913095419 (17h8m55.071861153s) [noise=true , address=104.36.82.10:4079 , piece_id=RSWLIXFVVRXKXD6TI4TDKEPW3HY6XU5AUAAH5N3X4UIFNEU3H5CQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913202434 (17h8m55.071968168s) [noise=true , address=77.90.31.15:4697 , piece_id=VLJCK73RVDCWWPAC7HUVHLQV2AYUPRYNEA7SNSO7P2ZMRK2FOLSQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913320449 (17h8m55.072086183s) [noise=true , address=45.91.116.9:4263 , piece_id=RYI4SAUA6IXKXAAHC62LDOKQUKQNTEG7QCG4QHUGMSREVGWEMNGA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913452622 (17h8m55.072218356s) [noise=true , address=77.90.31.12:4592 , piece_id=4RLI6WE2HS6N2QRLJQZXSYG65EIMVROLJVYNW56CSY254ZLREUYA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913534449 (17h8m55.072300183s) [noise=true , address=104.36.82.8:4971 , piece_id=UZT2NT7JR4F7NIXPSY2ORFBQVJOXZSPEJCSLFAHPH4BDSLY2W3DA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913650701 (17h8m55.072416435s) [noise=true , address=77.90.31.12:4589 , piece_id=L6ZTZ5PJPV2WM2BZGGAJEKBS4B2TS5S55PSD7WGA2YRH3MTLG5GA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:29.900914740 (17h8m57.059680464s) [upload=14994]: Next returned nil segment Aug 26 09:12:29.900934336 (17h8m57.059700081s) [upload=14994]: Waiting for error group managing segments... Aug 26 09:12:30.221707715 (17h8m57.380473449s) [noise=true , address=77.90.31.18:4806 , piece_id=RRTHOAKZSK6ZKWLXCMODWX5HZ5I62OMUEBB64FS6RSDLMNL2OESA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.225253190 (17h8m57.384018924s) [noise=true , address=77.90.31.12:4592 , piece_id=4RLI6WE2HS6N2QRLJQZXSYG65EIMVROLJVYNW56CSY254ZLREUYA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.228153169 (17h8m57.386918893s) [noise=true , address=45.91.116.4:4937 , piece_id=AZQ6DES5FGD63E56HNPDEOJJUZNKOF3ZYU33OMOUX47L7ZGYXISQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.244451243 (17h8m57.403216977s) [noise=true , address=45.91.116.9:4263 , piece_id=RYI4SAUA6IXKXAAHC62LDOKQUKQNTEG7QCG4QHUGMSREVGWEMNGA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.274597415 (17h8m57.433363149s) [noise=true , address=45.91.116.5:4299 , piece_id=G2JPCAKEMRINSSYZ24B362KA54Q2T6HDEGJQFHVWNEJGGFGRR2KA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.280700783 (17h8m57.439466517s) [noise=true , address=104.36.82.4:4802 , piece_id=6TH5NRIXI5GLRDDZDKZJZWPQYCK7BTMF2U5TDQYOV3SL227M6IZA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.294073090 (17h8m57.452838824s) [noise=true , address=104.36.82.7:4912 , piece_id=OYVJF5VJJMZGE6E2JREPMGIZGWKQQWAHK4WCUHXFATZZGJXFJW2Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.310065069 (17h8m57.468830803s) [noise=true , address=104.36.82.8:4971 , piece_id=UZT2NT7JR4F7NIXPSY2ORFBQVJOXZSPEJCSLFAHPH4BDSLY2W3DA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.310725412 (17h8m57.469491146s) [noise=true , address=45.91.116.10:4081 , piece_id=YYCAJYYQ4MXTVLBHWA6R66TIAHAEJOUQ7BBH6A3PVB56MCXUXCDA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.327312570 (17h8m57.486078304s) [noise=true , address=77.90.31.15:4697 , piece_id=VLJCK73RVDCWWPAC7HUVHLQV2AYUPRYNEA7SNSO7P2ZMRK2FOLSQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.371703187 (17h8m57.530468921s) [noise=true , address=77.90.31.16:4735 , piece_id=F5ZXRAIRT3GGYVDCOHQWEAWDTJ5DN2OF2AW5YB3W3MTHTUUTVJ6Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.427020261 (17h8m57.585785996s) [noise=true , address=45.91.116.11:4119 , piece_id=RRRPLNZBTVHIQTUMONDVTIBCMEBLBM2RPFCOHX7RBX4HFGZUYS3Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.436406982 (17h8m57.595172716s) [noise=true , address=45.91.116.14:4191 , piece_id=YO65KQXJOPP2BVDRQTEURGV2RDY3M36W4JSPPBTM6LKVHZ7UIEXA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.436435246 (17h8m57.59520098s) [seg_pos={0 0}, upload=14994]: Segment reached optimal threshold of 13 pieces. Aug 26 09:12:30.436615631 (17h8m57.595381365s) [noise=true , address=77.90.31.12:4589 , piece_id=L6ZTZ5PJPV2WM2BZGGAJEKBS4B2TS5S55PSD7WGA2YRH3MTLG5GA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv): protocol: expected piece hash; context canceled; EOF Aug 26 09:12:30.436693600 (17h8m57.595459334s) [noise=true , address=45.91.116.9:4262 , piece_id=WRDGDP5TBAYZTRPBYDW4ZESCR7NJJHVBU6WP4UYC4B3V5D7ICOMA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto): protocol: write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection; write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection Aug 26 09:12:30.436700754 (17h8m57.595466488s) [noise=true , address=104.36.82.10:4079 , piece_id=RSWLIXFVVRXKXD6TI4TDKEPW3HY6XU5AUAAH5N3X4UIFNEU3H5CQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF Aug 26 09:12:30.436750138 (17h8m57.595515872s) [seg_pos={0 0}, upload=14994]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 26 09:12:30.436849909 (17h8m57.595615643s) [upload=14994]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 09:12:30.436855740 (17h8m57.595621474s) [upload=14994]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 09:12:30.739827348 (17h8m57.898593082s) [upload=14994]: Done uploading segments... Aug 26 09:12:30.739846063 (17h8m57.898611797s) [upload=14994]: Upload finished. err: <nil> Duration: 5.77162857s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 4.826443466s FAIL (2025-08-26 09:24:08 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 4.826469175s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [......................................X...X.................] duration: 5.710713705s FAIL (2025-08-26 09:24:00 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Aug 26 09:12:27.460801938 (17h8m54.619567672s) [upload=14994]: Starting upload Aug 26 09:12:27.460861261 (17h8m54.619626995s) [upload=14994]: Done starting upload Aug 26 09:12:27.460967244 (17h8m54.619732978s) [upload=14994]: Uploading segments... Aug 26 09:12:27.461061044 (17h8m54.619826768s) [upload=14994]: Got next segment. Inline: false Aug 26 09:12:27.461137420 (17h8m54.619903154s) [upload=14994]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 09:12:27.461142410 (17h8m54.619908144s) [upload=14994]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 09:12:27.911433899 (17h8m55.070199633s) [seg_pos={0 0}, upload=14994]: Begin upload segment... Aug 26 09:12:27.911481470 (17h8m55.070247204s) [seg_pos={0 0}, upload=14994]: Done begin upload segment. Aug 26 09:12:27.911501920 (17h8m55.070267654s) [noise=true , address=104.36.82.7:4912 , piece_id=OYVJF5VJJMZGE6E2JREPMGIZGWKQQWAHK4WCUHXFATZZGJXFJW2Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.911554130 (17h8m55.070319904s) [noise=true , address=45.91.116.14:4191 , piece_id=YO65KQXJOPP2BVDRQTEURGV2RDY3M36W4JSPPBTM6LKVHZ7UIEXA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.911868270 (17h8m55.070634004s) [noise=true , address=45.91.116.11:4119 , piece_id=RRRPLNZBTVHIQTUMONDVTIBCMEBLBM2RPFCOHX7RBX4HFGZUYS3Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912181570 (17h8m55.070947305s) [noise=true , address=45.91.116.10:4081 , piece_id=YYCAJYYQ4MXTVLBHWA6R66TIAHAEJOUQ7BBH6A3PVB56MCXUXCDA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912244641 (17h8m55.071010365s) [noise=true , address=77.90.31.16:4735 , piece_id=F5ZXRAIRT3GGYVDCOHQWEAWDTJ5DN2OF2AW5YB3W3MTHTUUTVJ6Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912475152 (17h8m55.071240886s) [noise=true , address=45.91.116.5:4299 , piece_id=G2JPCAKEMRINSSYZ24B362KA54Q2T6HDEGJQFHVWNEJGGFGRR2KA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912684673 (17h8m55.071450407s) [noise=true , address=45.91.116.9:4262 , piece_id=WRDGDP5TBAYZTRPBYDW4ZESCR7NJJHVBU6WP4UYC4B3V5D7ICOMA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912718718 (17h8m55.071484452s) [noise=true , address=77.90.31.18:4806 , piece_id=RRTHOAKZSK6ZKWLXCMODWX5HZ5I62OMUEBB64FS6RSDLMNL2OESA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912890155 (17h8m55.071655889s) [noise=true , address=45.91.116.4:4937 , piece_id=AZQ6DES5FGD63E56HNPDEOJJUZNKOF3ZYU33OMOUX47L7ZGYXISQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912973765 (17h8m55.071739499s) [noise=true , address=104.36.82.4:4802 , piece_id=6TH5NRIXI5GLRDDZDKZJZWPQYCK7BTMF2U5TDQYOV3SL227M6IZA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913095419 (17h8m55.071861153s) [noise=true , address=104.36.82.10:4079 , piece_id=RSWLIXFVVRXKXD6TI4TDKEPW3HY6XU5AUAAH5N3X4UIFNEU3H5CQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913202434 (17h8m55.071968168s) [noise=true , address=77.90.31.15:4697 , piece_id=VLJCK73RVDCWWPAC7HUVHLQV2AYUPRYNEA7SNSO7P2ZMRK2FOLSQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913320449 (17h8m55.072086183s) [noise=true , address=45.91.116.9:4263 , piece_id=RYI4SAUA6IXKXAAHC62LDOKQUKQNTEG7QCG4QHUGMSREVGWEMNGA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913452622 (17h8m55.072218356s) [noise=true , address=77.90.31.12:4592 , piece_id=4RLI6WE2HS6N2QRLJQZXSYG65EIMVROLJVYNW56CSY254ZLREUYA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913534449 (17h8m55.072300183s) [noise=true , address=104.36.82.8:4971 , piece_id=UZT2NT7JR4F7NIXPSY2ORFBQVJOXZSPEJCSLFAHPH4BDSLY2W3DA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913650701 (17h8m55.072416435s) [noise=true , address=77.90.31.12:4589 , piece_id=L6ZTZ5PJPV2WM2BZGGAJEKBS4B2TS5S55PSD7WGA2YRH3MTLG5GA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:29.900914740 (17h8m57.059680464s) [upload=14994]: Next returned nil segment Aug 26 09:12:29.900934336 (17h8m57.059700081s) [upload=14994]: Waiting for error group managing segments... Aug 26 09:12:30.221707715 (17h8m57.380473449s) [noise=true , address=77.90.31.18:4806 , piece_id=RRTHOAKZSK6ZKWLXCMODWX5HZ5I62OMUEBB64FS6RSDLMNL2OESA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.225253190 (17h8m57.384018924s) [noise=true , address=77.90.31.12:4592 , piece_id=4RLI6WE2HS6N2QRLJQZXSYG65EIMVROLJVYNW56CSY254ZLREUYA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.228153169 (17h8m57.386918893s) [noise=true , address=45.91.116.4:4937 , piece_id=AZQ6DES5FGD63E56HNPDEOJJUZNKOF3ZYU33OMOUX47L7ZGYXISQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.244451243 (17h8m57.403216977s) [noise=true , address=45.91.116.9:4263 , piece_id=RYI4SAUA6IXKXAAHC62LDOKQUKQNTEG7QCG4QHUGMSREVGWEMNGA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.274597415 (17h8m57.433363149s) [noise=true , address=45.91.116.5:4299 , piece_id=G2JPCAKEMRINSSYZ24B362KA54Q2T6HDEGJQFHVWNEJGGFGRR2KA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.280700783 (17h8m57.439466517s) [noise=true , address=104.36.82.4:4802 , piece_id=6TH5NRIXI5GLRDDZDKZJZWPQYCK7BTMF2U5TDQYOV3SL227M6IZA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.294073090 (17h8m57.452838824s) [noise=true , address=104.36.82.7:4912 , piece_id=OYVJF5VJJMZGE6E2JREPMGIZGWKQQWAHK4WCUHXFATZZGJXFJW2Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.310065069 (17h8m57.468830803s) [noise=true , address=104.36.82.8:4971 , piece_id=UZT2NT7JR4F7NIXPSY2ORFBQVJOXZSPEJCSLFAHPH4BDSLY2W3DA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.310725412 (17h8m57.469491146s) [noise=true , address=45.91.116.10:4081 , piece_id=YYCAJYYQ4MXTVLBHWA6R66TIAHAEJOUQ7BBH6A3PVB56MCXUXCDA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.327312570 (17h8m57.486078304s) [noise=true , address=77.90.31.15:4697 , piece_id=VLJCK73RVDCWWPAC7HUVHLQV2AYUPRYNEA7SNSO7P2ZMRK2FOLSQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.371703187 (17h8m57.530468921s) [noise=true , address=77.90.31.16:4735 , piece_id=F5ZXRAIRT3GGYVDCOHQWEAWDTJ5DN2OF2AW5YB3W3MTHTUUTVJ6Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.427020261 (17h8m57.585785996s) [noise=true , address=45.91.116.11:4119 , piece_id=RRRPLNZBTVHIQTUMONDVTIBCMEBLBM2RPFCOHX7RBX4HFGZUYS3Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.436406982 (17h8m57.595172716s) [noise=true , address=45.91.116.14:4191 , piece_id=YO65KQXJOPP2BVDRQTEURGV2RDY3M36W4JSPPBTM6LKVHZ7UIEXA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.436435246 (17h8m57.59520098s) [seg_pos={0 0}, upload=14994]: Segment reached optimal threshold of 13 pieces. Aug 26 09:12:30.436615631 (17h8m57.595381365s) [noise=true , address=77.90.31.12:4589 , piece_id=L6ZTZ5PJPV2WM2BZGGAJEKBS4B2TS5S55PSD7WGA2YRH3MTLG5GA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv): protocol: expected piece hash; context canceled; EOF Aug 26 09:12:30.436693600 (17h8m57.595459334s) [noise=true , address=45.91.116.9:4262 , piece_id=WRDGDP5TBAYZTRPBYDW4ZESCR7NJJHVBU6WP4UYC4B3V5D7ICOMA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto): protocol: write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection; write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection Aug 26 09:12:30.436700754 (17h8m57.595466488s) [noise=true , address=104.36.82.10:4079 , piece_id=RSWLIXFVVRXKXD6TI4TDKEPW3HY6XU5AUAAH5N3X4UIFNEU3H5CQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF Aug 26 09:12:30.436750138 (17h8m57.595515872s) [seg_pos={0 0}, upload=14994]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 26 09:12:30.436849909 (17h8m57.595615643s) [upload=14994]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 09:12:30.436855740 (17h8m57.595621474s) [upload=14994]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 09:12:30.739827348 (17h8m57.898593082s) [upload=14994]: Done uploading segments... Aug 26 09:12:30.739846063 (17h8m57.898611797s) [upload=14994]: Upload finished. err: <nil> Duration: 5.710751036s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......................................X...X................] duration: 5.882955985s FAIL (2025-08-26 09:23:42 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Aug 26 09:12:27.460801938 (17h8m54.619567672s) [upload=14994]: Starting upload Aug 26 09:12:27.460861261 (17h8m54.619626995s) [upload=14994]: Done starting upload Aug 26 09:12:27.460967244 (17h8m54.619732978s) [upload=14994]: Uploading segments... Aug 26 09:12:27.461061044 (17h8m54.619826768s) [upload=14994]: Got next segment. Inline: false Aug 26 09:12:27.461137420 (17h8m54.619903154s) [upload=14994]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 09:12:27.461142410 (17h8m54.619908144s) [upload=14994]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 09:12:27.911433899 (17h8m55.070199633s) [seg_pos={0 0}, upload=14994]: Begin upload segment... Aug 26 09:12:27.911481470 (17h8m55.070247204s) [seg_pos={0 0}, upload=14994]: Done begin upload segment. Aug 26 09:12:27.911501920 (17h8m55.070267654s) [noise=true , address=104.36.82.7:4912 , piece_id=OYVJF5VJJMZGE6E2JREPMGIZGWKQQWAHK4WCUHXFATZZGJXFJW2Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.911554130 (17h8m55.070319904s) [noise=true , address=45.91.116.14:4191 , piece_id=YO65KQXJOPP2BVDRQTEURGV2RDY3M36W4JSPPBTM6LKVHZ7UIEXA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.911868270 (17h8m55.070634004s) [noise=true , address=45.91.116.11:4119 , piece_id=RRRPLNZBTVHIQTUMONDVTIBCMEBLBM2RPFCOHX7RBX4HFGZUYS3Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912181570 (17h8m55.070947305s) [noise=true , address=45.91.116.10:4081 , piece_id=YYCAJYYQ4MXTVLBHWA6R66TIAHAEJOUQ7BBH6A3PVB56MCXUXCDA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912244641 (17h8m55.071010365s) [noise=true , address=77.90.31.16:4735 , piece_id=F5ZXRAIRT3GGYVDCOHQWEAWDTJ5DN2OF2AW5YB3W3MTHTUUTVJ6Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912475152 (17h8m55.071240886s) [noise=true , address=45.91.116.5:4299 , piece_id=G2JPCAKEMRINSSYZ24B362KA54Q2T6HDEGJQFHVWNEJGGFGRR2KA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912684673 (17h8m55.071450407s) [noise=true , address=45.91.116.9:4262 , piece_id=WRDGDP5TBAYZTRPBYDW4ZESCR7NJJHVBU6WP4UYC4B3V5D7ICOMA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912718718 (17h8m55.071484452s) [noise=true , address=77.90.31.18:4806 , piece_id=RRTHOAKZSK6ZKWLXCMODWX5HZ5I62OMUEBB64FS6RSDLMNL2OESA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912890155 (17h8m55.071655889s) [noise=true , address=45.91.116.4:4937 , piece_id=AZQ6DES5FGD63E56HNPDEOJJUZNKOF3ZYU33OMOUX47L7ZGYXISQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912973765 (17h8m55.071739499s) [noise=true , address=104.36.82.4:4802 , piece_id=6TH5NRIXI5GLRDDZDKZJZWPQYCK7BTMF2U5TDQYOV3SL227M6IZA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913095419 (17h8m55.071861153s) [noise=true , address=104.36.82.10:4079 , piece_id=RSWLIXFVVRXKXD6TI4TDKEPW3HY6XU5AUAAH5N3X4UIFNEU3H5CQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913202434 (17h8m55.071968168s) [noise=true , address=77.90.31.15:4697 , piece_id=VLJCK73RVDCWWPAC7HUVHLQV2AYUPRYNEA7SNSO7P2ZMRK2FOLSQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913320449 (17h8m55.072086183s) [noise=true , address=45.91.116.9:4263 , piece_id=RYI4SAUA6IXKXAAHC62LDOKQUKQNTEG7QCG4QHUGMSREVGWEMNGA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913452622 (17h8m55.072218356s) [noise=true , address=77.90.31.12:4592 , piece_id=4RLI6WE2HS6N2QRLJQZXSYG65EIMVROLJVYNW56CSY254ZLREUYA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913534449 (17h8m55.072300183s) [noise=true , address=104.36.82.8:4971 , piece_id=UZT2NT7JR4F7NIXPSY2ORFBQVJOXZSPEJCSLFAHPH4BDSLY2W3DA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913650701 (17h8m55.072416435s) [noise=true , address=77.90.31.12:4589 , piece_id=L6ZTZ5PJPV2WM2BZGGAJEKBS4B2TS5S55PSD7WGA2YRH3MTLG5GA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:29.900914740 (17h8m57.059680464s) [upload=14994]: Next returned nil segment Aug 26 09:12:29.900934336 (17h8m57.059700081s) [upload=14994]: Waiting for error group managing segments... Aug 26 09:12:30.221707715 (17h8m57.380473449s) [noise=true , address=77.90.31.18:4806 , piece_id=RRTHOAKZSK6ZKWLXCMODWX5HZ5I62OMUEBB64FS6RSDLMNL2OESA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.225253190 (17h8m57.384018924s) [noise=true , address=77.90.31.12:4592 , piece_id=4RLI6WE2HS6N2QRLJQZXSYG65EIMVROLJVYNW56CSY254ZLREUYA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.228153169 (17h8m57.386918893s) [noise=true , address=45.91.116.4:4937 , piece_id=AZQ6DES5FGD63E56HNPDEOJJUZNKOF3ZYU33OMOUX47L7ZGYXISQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.244451243 (17h8m57.403216977s) [noise=true , address=45.91.116.9:4263 , piece_id=RYI4SAUA6IXKXAAHC62LDOKQUKQNTEG7QCG4QHUGMSREVGWEMNGA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.274597415 (17h8m57.433363149s) [noise=true , address=45.91.116.5:4299 , piece_id=G2JPCAKEMRINSSYZ24B362KA54Q2T6HDEGJQFHVWNEJGGFGRR2KA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.280700783 (17h8m57.439466517s) [noise=true , address=104.36.82.4:4802 , piece_id=6TH5NRIXI5GLRDDZDKZJZWPQYCK7BTMF2U5TDQYOV3SL227M6IZA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.294073090 (17h8m57.452838824s) [noise=true , address=104.36.82.7:4912 , piece_id=OYVJF5VJJMZGE6E2JREPMGIZGWKQQWAHK4WCUHXFATZZGJXFJW2Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.310065069 (17h8m57.468830803s) [noise=true , address=104.36.82.8:4971 , piece_id=UZT2NT7JR4F7NIXPSY2ORFBQVJOXZSPEJCSLFAHPH4BDSLY2W3DA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.310725412 (17h8m57.469491146s) [noise=true , address=45.91.116.10:4081 , piece_id=YYCAJYYQ4MXTVLBHWA6R66TIAHAEJOUQ7BBH6A3PVB56MCXUXCDA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.327312570 (17h8m57.486078304s) [noise=true , address=77.90.31.15:4697 , piece_id=VLJCK73RVDCWWPAC7HUVHLQV2AYUPRYNEA7SNSO7P2ZMRK2FOLSQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.371703187 (17h8m57.530468921s) [noise=true , address=77.90.31.16:4735 , piece_id=F5ZXRAIRT3GGYVDCOHQWEAWDTJ5DN2OF2AW5YB3W3MTHTUUTVJ6Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.427020261 (17h8m57.585785996s) [noise=true , address=45.91.116.11:4119 , piece_id=RRRPLNZBTVHIQTUMONDVTIBCMEBLBM2RPFCOHX7RBX4HFGZUYS3Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.436406982 (17h8m57.595172716s) [noise=true , address=45.91.116.14:4191 , piece_id=YO65KQXJOPP2BVDRQTEURGV2RDY3M36W4JSPPBTM6LKVHZ7UIEXA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.436435246 (17h8m57.59520098s) [seg_pos={0 0}, upload=14994]: Segment reached optimal threshold of 13 pieces. Aug 26 09:12:30.436615631 (17h8m57.595381365s) [noise=true , address=77.90.31.12:4589 , piece_id=L6ZTZ5PJPV2WM2BZGGAJEKBS4B2TS5S55PSD7WGA2YRH3MTLG5GA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv): protocol: expected piece hash; context canceled; EOF Aug 26 09:12:30.436693600 (17h8m57.595459334s) [noise=true , address=45.91.116.9:4262 , piece_id=WRDGDP5TBAYZTRPBYDW4ZESCR7NJJHVBU6WP4UYC4B3V5D7ICOMA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto): protocol: write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection; write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection Aug 26 09:12:30.436700754 (17h8m57.595466488s) [noise=true , address=104.36.82.10:4079 , piece_id=RSWLIXFVVRXKXD6TI4TDKEPW3HY6XU5AUAAH5N3X4UIFNEU3H5CQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF Aug 26 09:12:30.436750138 (17h8m57.595515872s) [seg_pos={0 0}, upload=14994]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 26 09:12:30.436849909 (17h8m57.595615643s) [upload=14994]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 09:12:30.436855740 (17h8m57.595621474s) [upload=14994]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 09:12:30.739827348 (17h8m57.898593082s) [upload=14994]: Done uploading segments... Aug 26 09:12:30.739846063 (17h8m57.898611797s) [upload=14994]: Upload finished. err: <nil> Duration: 5.882982545s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 5.07960677s FAIL (2025-08-26 09:23:41 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 5.079635837s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [........................................X...X...............] duration: 6.041210117s FAIL (2025-08-26 09:23:25 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Aug 26 09:12:27.460801938 (17h8m54.619567672s) [upload=14994]: Starting upload Aug 26 09:12:27.460861261 (17h8m54.619626995s) [upload=14994]: Done starting upload Aug 26 09:12:27.460967244 (17h8m54.619732978s) [upload=14994]: Uploading segments... Aug 26 09:12:27.461061044 (17h8m54.619826768s) [upload=14994]: Got next segment. Inline: false Aug 26 09:12:27.461137420 (17h8m54.619903154s) [upload=14994]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 09:12:27.461142410 (17h8m54.619908144s) [upload=14994]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 09:12:27.911433899 (17h8m55.070199633s) [seg_pos={0 0}, upload=14994]: Begin upload segment... Aug 26 09:12:27.911481470 (17h8m55.070247204s) [seg_pos={0 0}, upload=14994]: Done begin upload segment. Aug 26 09:12:27.911501920 (17h8m55.070267654s) [noise=true , address=104.36.82.7:4912 , piece_id=OYVJF5VJJMZGE6E2JREPMGIZGWKQQWAHK4WCUHXFATZZGJXFJW2Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.911554130 (17h8m55.070319904s) [noise=true , address=45.91.116.14:4191 , piece_id=YO65KQXJOPP2BVDRQTEURGV2RDY3M36W4JSPPBTM6LKVHZ7UIEXA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.911868270 (17h8m55.070634004s) [noise=true , address=45.91.116.11:4119 , piece_id=RRRPLNZBTVHIQTUMONDVTIBCMEBLBM2RPFCOHX7RBX4HFGZUYS3Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912181570 (17h8m55.070947305s) [noise=true , address=45.91.116.10:4081 , piece_id=YYCAJYYQ4MXTVLBHWA6R66TIAHAEJOUQ7BBH6A3PVB56MCXUXCDA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912244641 (17h8m55.071010365s) [noise=true , address=77.90.31.16:4735 , piece_id=F5ZXRAIRT3GGYVDCOHQWEAWDTJ5DN2OF2AW5YB3W3MTHTUUTVJ6Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912475152 (17h8m55.071240886s) [noise=true , address=45.91.116.5:4299 , piece_id=G2JPCAKEMRINSSYZ24B362KA54Q2T6HDEGJQFHVWNEJGGFGRR2KA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912684673 (17h8m55.071450407s) [noise=true , address=45.91.116.9:4262 , piece_id=WRDGDP5TBAYZTRPBYDW4ZESCR7NJJHVBU6WP4UYC4B3V5D7ICOMA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912718718 (17h8m55.071484452s) [noise=true , address=77.90.31.18:4806 , piece_id=RRTHOAKZSK6ZKWLXCMODWX5HZ5I62OMUEBB64FS6RSDLMNL2OESA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912890155 (17h8m55.071655889s) [noise=true , address=45.91.116.4:4937 , piece_id=AZQ6DES5FGD63E56HNPDEOJJUZNKOF3ZYU33OMOUX47L7ZGYXISQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912973765 (17h8m55.071739499s) [noise=true , address=104.36.82.4:4802 , piece_id=6TH5NRIXI5GLRDDZDKZJZWPQYCK7BTMF2U5TDQYOV3SL227M6IZA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913095419 (17h8m55.071861153s) [noise=true , address=104.36.82.10:4079 , piece_id=RSWLIXFVVRXKXD6TI4TDKEPW3HY6XU5AUAAH5N3X4UIFNEU3H5CQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913202434 (17h8m55.071968168s) [noise=true , address=77.90.31.15:4697 , piece_id=VLJCK73RVDCWWPAC7HUVHLQV2AYUPRYNEA7SNSO7P2ZMRK2FOLSQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913320449 (17h8m55.072086183s) [noise=true , address=45.91.116.9:4263 , piece_id=RYI4SAUA6IXKXAAHC62LDOKQUKQNTEG7QCG4QHUGMSREVGWEMNGA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913452622 (17h8m55.072218356s) [noise=true , address=77.90.31.12:4592 , piece_id=4RLI6WE2HS6N2QRLJQZXSYG65EIMVROLJVYNW56CSY254ZLREUYA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913534449 (17h8m55.072300183s) [noise=true , address=104.36.82.8:4971 , piece_id=UZT2NT7JR4F7NIXPSY2ORFBQVJOXZSPEJCSLFAHPH4BDSLY2W3DA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913650701 (17h8m55.072416435s) [noise=true , address=77.90.31.12:4589 , piece_id=L6ZTZ5PJPV2WM2BZGGAJEKBS4B2TS5S55PSD7WGA2YRH3MTLG5GA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:29.900914740 (17h8m57.059680464s) [upload=14994]: Next returned nil segment Aug 26 09:12:29.900934336 (17h8m57.059700081s) [upload=14994]: Waiting for error group managing segments... Aug 26 09:12:30.221707715 (17h8m57.380473449s) [noise=true , address=77.90.31.18:4806 , piece_id=RRTHOAKZSK6ZKWLXCMODWX5HZ5I62OMUEBB64FS6RSDLMNL2OESA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.225253190 (17h8m57.384018924s) [noise=true , address=77.90.31.12:4592 , piece_id=4RLI6WE2HS6N2QRLJQZXSYG65EIMVROLJVYNW56CSY254ZLREUYA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.228153169 (17h8m57.386918893s) [noise=true , address=45.91.116.4:4937 , piece_id=AZQ6DES5FGD63E56HNPDEOJJUZNKOF3ZYU33OMOUX47L7ZGYXISQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.244451243 (17h8m57.403216977s) [noise=true , address=45.91.116.9:4263 , piece_id=RYI4SAUA6IXKXAAHC62LDOKQUKQNTEG7QCG4QHUGMSREVGWEMNGA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.274597415 (17h8m57.433363149s) [noise=true , address=45.91.116.5:4299 , piece_id=G2JPCAKEMRINSSYZ24B362KA54Q2T6HDEGJQFHVWNEJGGFGRR2KA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.280700783 (17h8m57.439466517s) [noise=true , address=104.36.82.4:4802 , piece_id=6TH5NRIXI5GLRDDZDKZJZWPQYCK7BTMF2U5TDQYOV3SL227M6IZA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.294073090 (17h8m57.452838824s) [noise=true , address=104.36.82.7:4912 , piece_id=OYVJF5VJJMZGE6E2JREPMGIZGWKQQWAHK4WCUHXFATZZGJXFJW2Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.310065069 (17h8m57.468830803s) [noise=true , address=104.36.82.8:4971 , piece_id=UZT2NT7JR4F7NIXPSY2ORFBQVJOXZSPEJCSLFAHPH4BDSLY2W3DA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.310725412 (17h8m57.469491146s) [noise=true , address=45.91.116.10:4081 , piece_id=YYCAJYYQ4MXTVLBHWA6R66TIAHAEJOUQ7BBH6A3PVB56MCXUXCDA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.327312570 (17h8m57.486078304s) [noise=true , address=77.90.31.15:4697 , piece_id=VLJCK73RVDCWWPAC7HUVHLQV2AYUPRYNEA7SNSO7P2ZMRK2FOLSQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.371703187 (17h8m57.530468921s) [noise=true , address=77.90.31.16:4735 , piece_id=F5ZXRAIRT3GGYVDCOHQWEAWDTJ5DN2OF2AW5YB3W3MTHTUUTVJ6Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.427020261 (17h8m57.585785996s) [noise=true , address=45.91.116.11:4119 , piece_id=RRRPLNZBTVHIQTUMONDVTIBCMEBLBM2RPFCOHX7RBX4HFGZUYS3Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.436406982 (17h8m57.595172716s) [noise=true , address=45.91.116.14:4191 , piece_id=YO65KQXJOPP2BVDRQTEURGV2RDY3M36W4JSPPBTM6LKVHZ7UIEXA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.436435246 (17h8m57.59520098s) [seg_pos={0 0}, upload=14994]: Segment reached optimal threshold of 13 pieces. Aug 26 09:12:30.436615631 (17h8m57.595381365s) [noise=true , address=77.90.31.12:4589 , piece_id=L6ZTZ5PJPV2WM2BZGGAJEKBS4B2TS5S55PSD7WGA2YRH3MTLG5GA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv): protocol: expected piece hash; context canceled; EOF Aug 26 09:12:30.436693600 (17h8m57.595459334s) [noise=true , address=45.91.116.9:4262 , piece_id=WRDGDP5TBAYZTRPBYDW4ZESCR7NJJHVBU6WP4UYC4B3V5D7ICOMA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto): protocol: write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection; write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection Aug 26 09:12:30.436700754 (17h8m57.595466488s) [noise=true , address=104.36.82.10:4079 , piece_id=RSWLIXFVVRXKXD6TI4TDKEPW3HY6XU5AUAAH5N3X4UIFNEU3H5CQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF Aug 26 09:12:30.436750138 (17h8m57.595515872s) [seg_pos={0 0}, upload=14994]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 26 09:12:30.436849909 (17h8m57.595615643s) [upload=14994]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 09:12:30.436855740 (17h8m57.595621474s) [upload=14994]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 09:12:30.739827348 (17h8m57.898593082s) [upload=14994]: Done uploading segments... Aug 26 09:12:30.739846063 (17h8m57.898611797s) [upload=14994]: Upload finished. err: <nil> Duration: 6.041248151s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 4.967483183s FAIL (2025-08-26 09:23:24 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 4.967509273s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 4.974202783s FAIL (2025-08-26 09:22:35 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 4.97422788s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 5.020943754s FAIL (2025-08-26 09:22:12 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 5.02096834s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........................................X...X..............] duration: 5.780711128s FAIL (2025-08-26 09:22:10 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Aug 26 09:12:27.460801938 (17h8m54.619567672s) [upload=14994]: Starting upload Aug 26 09:12:27.460861261 (17h8m54.619626995s) [upload=14994]: Done starting upload Aug 26 09:12:27.460967244 (17h8m54.619732978s) [upload=14994]: Uploading segments... Aug 26 09:12:27.461061044 (17h8m54.619826768s) [upload=14994]: Got next segment. Inline: false Aug 26 09:12:27.461137420 (17h8m54.619903154s) [upload=14994]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 09:12:27.461142410 (17h8m54.619908144s) [upload=14994]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 09:12:27.911433899 (17h8m55.070199633s) [seg_pos={0 0}, upload=14994]: Begin upload segment... Aug 26 09:12:27.911481470 (17h8m55.070247204s) [seg_pos={0 0}, upload=14994]: Done begin upload segment. Aug 26 09:12:27.911501920 (17h8m55.070267654s) [noise=true , address=104.36.82.7:4912 , piece_id=OYVJF5VJJMZGE6E2JREPMGIZGWKQQWAHK4WCUHXFATZZGJXFJW2Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.911554130 (17h8m55.070319904s) [noise=true , address=45.91.116.14:4191 , piece_id=YO65KQXJOPP2BVDRQTEURGV2RDY3M36W4JSPPBTM6LKVHZ7UIEXA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.911868270 (17h8m55.070634004s) [noise=true , address=45.91.116.11:4119 , piece_id=RRRPLNZBTVHIQTUMONDVTIBCMEBLBM2RPFCOHX7RBX4HFGZUYS3Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912181570 (17h8m55.070947305s) [noise=true , address=45.91.116.10:4081 , piece_id=YYCAJYYQ4MXTVLBHWA6R66TIAHAEJOUQ7BBH6A3PVB56MCXUXCDA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912244641 (17h8m55.071010365s) [noise=true , address=77.90.31.16:4735 , piece_id=F5ZXRAIRT3GGYVDCOHQWEAWDTJ5DN2OF2AW5YB3W3MTHTUUTVJ6Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912475152 (17h8m55.071240886s) [noise=true , address=45.91.116.5:4299 , piece_id=G2JPCAKEMRINSSYZ24B362KA54Q2T6HDEGJQFHVWNEJGGFGRR2KA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912684673 (17h8m55.071450407s) [noise=true , address=45.91.116.9:4262 , piece_id=WRDGDP5TBAYZTRPBYDW4ZESCR7NJJHVBU6WP4UYC4B3V5D7ICOMA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912718718 (17h8m55.071484452s) [noise=true , address=77.90.31.18:4806 , piece_id=RRTHOAKZSK6ZKWLXCMODWX5HZ5I62OMUEBB64FS6RSDLMNL2OESA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912890155 (17h8m55.071655889s) [noise=true , address=45.91.116.4:4937 , piece_id=AZQ6DES5FGD63E56HNPDEOJJUZNKOF3ZYU33OMOUX47L7ZGYXISQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912973765 (17h8m55.071739499s) [noise=true , address=104.36.82.4:4802 , piece_id=6TH5NRIXI5GLRDDZDKZJZWPQYCK7BTMF2U5TDQYOV3SL227M6IZA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913095419 (17h8m55.071861153s) [noise=true , address=104.36.82.10:4079 , piece_id=RSWLIXFVVRXKXD6TI4TDKEPW3HY6XU5AUAAH5N3X4UIFNEU3H5CQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913202434 (17h8m55.071968168s) [noise=true , address=77.90.31.15:4697 , piece_id=VLJCK73RVDCWWPAC7HUVHLQV2AYUPRYNEA7SNSO7P2ZMRK2FOLSQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913320449 (17h8m55.072086183s) [noise=true , address=45.91.116.9:4263 , piece_id=RYI4SAUA6IXKXAAHC62LDOKQUKQNTEG7QCG4QHUGMSREVGWEMNGA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913452622 (17h8m55.072218356s) [noise=true , address=77.90.31.12:4592 , piece_id=4RLI6WE2HS6N2QRLJQZXSYG65EIMVROLJVYNW56CSY254ZLREUYA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913534449 (17h8m55.072300183s) [noise=true , address=104.36.82.8:4971 , piece_id=UZT2NT7JR4F7NIXPSY2ORFBQVJOXZSPEJCSLFAHPH4BDSLY2W3DA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913650701 (17h8m55.072416435s) [noise=true , address=77.90.31.12:4589 , piece_id=L6ZTZ5PJPV2WM2BZGGAJEKBS4B2TS5S55PSD7WGA2YRH3MTLG5GA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:29.900914740 (17h8m57.059680464s) [upload=14994]: Next returned nil segment Aug 26 09:12:29.900934336 (17h8m57.059700081s) [upload=14994]: Waiting for error group managing segments... Aug 26 09:12:30.221707715 (17h8m57.380473449s) [noise=true , address=77.90.31.18:4806 , piece_id=RRTHOAKZSK6ZKWLXCMODWX5HZ5I62OMUEBB64FS6RSDLMNL2OESA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.225253190 (17h8m57.384018924s) [noise=true , address=77.90.31.12:4592 , piece_id=4RLI6WE2HS6N2QRLJQZXSYG65EIMVROLJVYNW56CSY254ZLREUYA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.228153169 (17h8m57.386918893s) [noise=true , address=45.91.116.4:4937 , piece_id=AZQ6DES5FGD63E56HNPDEOJJUZNKOF3ZYU33OMOUX47L7ZGYXISQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.244451243 (17h8m57.403216977s) [noise=true , address=45.91.116.9:4263 , piece_id=RYI4SAUA6IXKXAAHC62LDOKQUKQNTEG7QCG4QHUGMSREVGWEMNGA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.274597415 (17h8m57.433363149s) [noise=true , address=45.91.116.5:4299 , piece_id=G2JPCAKEMRINSSYZ24B362KA54Q2T6HDEGJQFHVWNEJGGFGRR2KA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.280700783 (17h8m57.439466517s) [noise=true , address=104.36.82.4:4802 , piece_id=6TH5NRIXI5GLRDDZDKZJZWPQYCK7BTMF2U5TDQYOV3SL227M6IZA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.294073090 (17h8m57.452838824s) [noise=true , address=104.36.82.7:4912 , piece_id=OYVJF5VJJMZGE6E2JREPMGIZGWKQQWAHK4WCUHXFATZZGJXFJW2Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.310065069 (17h8m57.468830803s) [noise=true , address=104.36.82.8:4971 , piece_id=UZT2NT7JR4F7NIXPSY2ORFBQVJOXZSPEJCSLFAHPH4BDSLY2W3DA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.310725412 (17h8m57.469491146s) [noise=true , address=45.91.116.10:4081 , piece_id=YYCAJYYQ4MXTVLBHWA6R66TIAHAEJOUQ7BBH6A3PVB56MCXUXCDA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.327312570 (17h8m57.486078304s) [noise=true , address=77.90.31.15:4697 , piece_id=VLJCK73RVDCWWPAC7HUVHLQV2AYUPRYNEA7SNSO7P2ZMRK2FOLSQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.371703187 (17h8m57.530468921s) [noise=true , address=77.90.31.16:4735 , piece_id=F5ZXRAIRT3GGYVDCOHQWEAWDTJ5DN2OF2AW5YB3W3MTHTUUTVJ6Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.427020261 (17h8m57.585785996s) [noise=true , address=45.91.116.11:4119 , piece_id=RRRPLNZBTVHIQTUMONDVTIBCMEBLBM2RPFCOHX7RBX4HFGZUYS3Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.436406982 (17h8m57.595172716s) [noise=true , address=45.91.116.14:4191 , piece_id=YO65KQXJOPP2BVDRQTEURGV2RDY3M36W4JSPPBTM6LKVHZ7UIEXA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.436435246 (17h8m57.59520098s) [seg_pos={0 0}, upload=14994]: Segment reached optimal threshold of 13 pieces. Aug 26 09:12:30.436615631 (17h8m57.595381365s) [noise=true , address=77.90.31.12:4589 , piece_id=L6ZTZ5PJPV2WM2BZGGAJEKBS4B2TS5S55PSD7WGA2YRH3MTLG5GA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv): protocol: expected piece hash; context canceled; EOF Aug 26 09:12:30.436693600 (17h8m57.595459334s) [noise=true , address=45.91.116.9:4262 , piece_id=WRDGDP5TBAYZTRPBYDW4ZESCR7NJJHVBU6WP4UYC4B3V5D7ICOMA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto): protocol: write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection; write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection Aug 26 09:12:30.436700754 (17h8m57.595466488s) [noise=true , address=104.36.82.10:4079 , piece_id=RSWLIXFVVRXKXD6TI4TDKEPW3HY6XU5AUAAH5N3X4UIFNEU3H5CQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF Aug 26 09:12:30.436750138 (17h8m57.595515872s) [seg_pos={0 0}, upload=14994]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 26 09:12:30.436849909 (17h8m57.595615643s) [upload=14994]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 09:12:30.436855740 (17h8m57.595621474s) [upload=14994]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 09:12:30.739827348 (17h8m57.898593082s) [upload=14994]: Done uploading segments... Aug 26 09:12:30.739846063 (17h8m57.898611797s) [upload=14994]: Upload finished. err: <nil> Duration: 5.78073778s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 4.937977106s FAIL (2025-08-26 09:21:14 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 4.938013365s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........................................X...X.............] duration: 5.845522158s FAIL (2025-08-26 09:21:02 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Aug 26 09:12:27.460801938 (17h8m54.619567672s) [upload=14994]: Starting upload Aug 26 09:12:27.460861261 (17h8m54.619626995s) [upload=14994]: Done starting upload Aug 26 09:12:27.460967244 (17h8m54.619732978s) [upload=14994]: Uploading segments... Aug 26 09:12:27.461061044 (17h8m54.619826768s) [upload=14994]: Got next segment. Inline: false Aug 26 09:12:27.461137420 (17h8m54.619903154s) [upload=14994]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 09:12:27.461142410 (17h8m54.619908144s) [upload=14994]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 09:12:27.911433899 (17h8m55.070199633s) [seg_pos={0 0}, upload=14994]: Begin upload segment... Aug 26 09:12:27.911481470 (17h8m55.070247204s) [seg_pos={0 0}, upload=14994]: Done begin upload segment. Aug 26 09:12:27.911501920 (17h8m55.070267654s) [noise=true , address=104.36.82.7:4912 , piece_id=OYVJF5VJJMZGE6E2JREPMGIZGWKQQWAHK4WCUHXFATZZGJXFJW2Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.911554130 (17h8m55.070319904s) [noise=true , address=45.91.116.14:4191 , piece_id=YO65KQXJOPP2BVDRQTEURGV2RDY3M36W4JSPPBTM6LKVHZ7UIEXA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.911868270 (17h8m55.070634004s) [noise=true , address=45.91.116.11:4119 , piece_id=RRRPLNZBTVHIQTUMONDVTIBCMEBLBM2RPFCOHX7RBX4HFGZUYS3Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912181570 (17h8m55.070947305s) [noise=true , address=45.91.116.10:4081 , piece_id=YYCAJYYQ4MXTVLBHWA6R66TIAHAEJOUQ7BBH6A3PVB56MCXUXCDA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912244641 (17h8m55.071010365s) [noise=true , address=77.90.31.16:4735 , piece_id=F5ZXRAIRT3GGYVDCOHQWEAWDTJ5DN2OF2AW5YB3W3MTHTUUTVJ6Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912475152 (17h8m55.071240886s) [noise=true , address=45.91.116.5:4299 , piece_id=G2JPCAKEMRINSSYZ24B362KA54Q2T6HDEGJQFHVWNEJGGFGRR2KA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912684673 (17h8m55.071450407s) [noise=true , address=45.91.116.9:4262 , piece_id=WRDGDP5TBAYZTRPBYDW4ZESCR7NJJHVBU6WP4UYC4B3V5D7ICOMA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912718718 (17h8m55.071484452s) [noise=true , address=77.90.31.18:4806 , piece_id=RRTHOAKZSK6ZKWLXCMODWX5HZ5I62OMUEBB64FS6RSDLMNL2OESA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912890155 (17h8m55.071655889s) [noise=true , address=45.91.116.4:4937 , piece_id=AZQ6DES5FGD63E56HNPDEOJJUZNKOF3ZYU33OMOUX47L7ZGYXISQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912973765 (17h8m55.071739499s) [noise=true , address=104.36.82.4:4802 , piece_id=6TH5NRIXI5GLRDDZDKZJZWPQYCK7BTMF2U5TDQYOV3SL227M6IZA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913095419 (17h8m55.071861153s) [noise=true , address=104.36.82.10:4079 , piece_id=RSWLIXFVVRXKXD6TI4TDKEPW3HY6XU5AUAAH5N3X4UIFNEU3H5CQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913202434 (17h8m55.071968168s) [noise=true , address=77.90.31.15:4697 , piece_id=VLJCK73RVDCWWPAC7HUVHLQV2AYUPRYNEA7SNSO7P2ZMRK2FOLSQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913320449 (17h8m55.072086183s) [noise=true , address=45.91.116.9:4263 , piece_id=RYI4SAUA6IXKXAAHC62LDOKQUKQNTEG7QCG4QHUGMSREVGWEMNGA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913452622 (17h8m55.072218356s) [noise=true , address=77.90.31.12:4592 , piece_id=4RLI6WE2HS6N2QRLJQZXSYG65EIMVROLJVYNW56CSY254ZLREUYA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913534449 (17h8m55.072300183s) [noise=true , address=104.36.82.8:4971 , piece_id=UZT2NT7JR4F7NIXPSY2ORFBQVJOXZSPEJCSLFAHPH4BDSLY2W3DA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913650701 (17h8m55.072416435s) [noise=true , address=77.90.31.12:4589 , piece_id=L6ZTZ5PJPV2WM2BZGGAJEKBS4B2TS5S55PSD7WGA2YRH3MTLG5GA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:29.900914740 (17h8m57.059680464s) [upload=14994]: Next returned nil segment Aug 26 09:12:29.900934336 (17h8m57.059700081s) [upload=14994]: Waiting for error group managing segments... Aug 26 09:12:30.221707715 (17h8m57.380473449s) [noise=true , address=77.90.31.18:4806 , piece_id=RRTHOAKZSK6ZKWLXCMODWX5HZ5I62OMUEBB64FS6RSDLMNL2OESA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.225253190 (17h8m57.384018924s) [noise=true , address=77.90.31.12:4592 , piece_id=4RLI6WE2HS6N2QRLJQZXSYG65EIMVROLJVYNW56CSY254ZLREUYA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.228153169 (17h8m57.386918893s) [noise=true , address=45.91.116.4:4937 , piece_id=AZQ6DES5FGD63E56HNPDEOJJUZNKOF3ZYU33OMOUX47L7ZGYXISQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.244451243 (17h8m57.403216977s) [noise=true , address=45.91.116.9:4263 , piece_id=RYI4SAUA6IXKXAAHC62LDOKQUKQNTEG7QCG4QHUGMSREVGWEMNGA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.274597415 (17h8m57.433363149s) [noise=true , address=45.91.116.5:4299 , piece_id=G2JPCAKEMRINSSYZ24B362KA54Q2T6HDEGJQFHVWNEJGGFGRR2KA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.280700783 (17h8m57.439466517s) [noise=true , address=104.36.82.4:4802 , piece_id=6TH5NRIXI5GLRDDZDKZJZWPQYCK7BTMF2U5TDQYOV3SL227M6IZA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.294073090 (17h8m57.452838824s) [noise=true , address=104.36.82.7:4912 , piece_id=OYVJF5VJJMZGE6E2JREPMGIZGWKQQWAHK4WCUHXFATZZGJXFJW2Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.310065069 (17h8m57.468830803s) [noise=true , address=104.36.82.8:4971 , piece_id=UZT2NT7JR4F7NIXPSY2ORFBQVJOXZSPEJCSLFAHPH4BDSLY2W3DA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.310725412 (17h8m57.469491146s) [noise=true , address=45.91.116.10:4081 , piece_id=YYCAJYYQ4MXTVLBHWA6R66TIAHAEJOUQ7BBH6A3PVB56MCXUXCDA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.327312570 (17h8m57.486078304s) [noise=true , address=77.90.31.15:4697 , piece_id=VLJCK73RVDCWWPAC7HUVHLQV2AYUPRYNEA7SNSO7P2ZMRK2FOLSQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.371703187 (17h8m57.530468921s) [noise=true , address=77.90.31.16:4735 , piece_id=F5ZXRAIRT3GGYVDCOHQWEAWDTJ5DN2OF2AW5YB3W3MTHTUUTVJ6Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.427020261 (17h8m57.585785996s) [noise=true , address=45.91.116.11:4119 , piece_id=RRRPLNZBTVHIQTUMONDVTIBCMEBLBM2RPFCOHX7RBX4HFGZUYS3Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.436406982 (17h8m57.595172716s) [noise=true , address=45.91.116.14:4191 , piece_id=YO65KQXJOPP2BVDRQTEURGV2RDY3M36W4JSPPBTM6LKVHZ7UIEXA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.436435246 (17h8m57.59520098s) [seg_pos={0 0}, upload=14994]: Segment reached optimal threshold of 13 pieces. Aug 26 09:12:30.436615631 (17h8m57.595381365s) [noise=true , address=77.90.31.12:4589 , piece_id=L6ZTZ5PJPV2WM2BZGGAJEKBS4B2TS5S55PSD7WGA2YRH3MTLG5GA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv): protocol: expected piece hash; context canceled; EOF Aug 26 09:12:30.436693600 (17h8m57.595459334s) [noise=true , address=45.91.116.9:4262 , piece_id=WRDGDP5TBAYZTRPBYDW4ZESCR7NJJHVBU6WP4UYC4B3V5D7ICOMA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto): protocol: write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection; write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection Aug 26 09:12:30.436700754 (17h8m57.595466488s) [noise=true , address=104.36.82.10:4079 , piece_id=RSWLIXFVVRXKXD6TI4TDKEPW3HY6XU5AUAAH5N3X4UIFNEU3H5CQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF Aug 26 09:12:30.436750138 (17h8m57.595515872s) [seg_pos={0 0}, upload=14994]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 26 09:12:30.436849909 (17h8m57.595615643s) [upload=14994]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 09:12:30.436855740 (17h8m57.595621474s) [upload=14994]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 09:12:30.739827348 (17h8m57.898593082s) [upload=14994]: Done uploading segments... Aug 26 09:12:30.739846063 (17h8m57.898611797s) [upload=14994]: Upload finished. err: <nil> Duration: 5.845544329s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 5.075274922s FAIL (2025-08-26 09:20:50 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 5.075308376s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...........................................X...X............] duration: 5.906817259s FAIL (2025-08-26 09:20:28 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Aug 26 09:12:27.460801938 (17h8m54.619567672s) [upload=14994]: Starting upload Aug 26 09:12:27.460861261 (17h8m54.619626995s) [upload=14994]: Done starting upload Aug 26 09:12:27.460967244 (17h8m54.619732978s) [upload=14994]: Uploading segments... Aug 26 09:12:27.461061044 (17h8m54.619826768s) [upload=14994]: Got next segment. Inline: false Aug 26 09:12:27.461137420 (17h8m54.619903154s) [upload=14994]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 09:12:27.461142410 (17h8m54.619908144s) [upload=14994]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 09:12:27.911433899 (17h8m55.070199633s) [seg_pos={0 0}, upload=14994]: Begin upload segment... Aug 26 09:12:27.911481470 (17h8m55.070247204s) [seg_pos={0 0}, upload=14994]: Done begin upload segment. Aug 26 09:12:27.911501920 (17h8m55.070267654s) [noise=true , address=104.36.82.7:4912 , piece_id=OYVJF5VJJMZGE6E2JREPMGIZGWKQQWAHK4WCUHXFATZZGJXFJW2Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.911554130 (17h8m55.070319904s) [noise=true , address=45.91.116.14:4191 , piece_id=YO65KQXJOPP2BVDRQTEURGV2RDY3M36W4JSPPBTM6LKVHZ7UIEXA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.911868270 (17h8m55.070634004s) [noise=true , address=45.91.116.11:4119 , piece_id=RRRPLNZBTVHIQTUMONDVTIBCMEBLBM2RPFCOHX7RBX4HFGZUYS3Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912181570 (17h8m55.070947305s) [noise=true , address=45.91.116.10:4081 , piece_id=YYCAJYYQ4MXTVLBHWA6R66TIAHAEJOUQ7BBH6A3PVB56MCXUXCDA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912244641 (17h8m55.071010365s) [noise=true , address=77.90.31.16:4735 , piece_id=F5ZXRAIRT3GGYVDCOHQWEAWDTJ5DN2OF2AW5YB3W3MTHTUUTVJ6Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912475152 (17h8m55.071240886s) [noise=true , address=45.91.116.5:4299 , piece_id=G2JPCAKEMRINSSYZ24B362KA54Q2T6HDEGJQFHVWNEJGGFGRR2KA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912684673 (17h8m55.071450407s) [noise=true , address=45.91.116.9:4262 , piece_id=WRDGDP5TBAYZTRPBYDW4ZESCR7NJJHVBU6WP4UYC4B3V5D7ICOMA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912718718 (17h8m55.071484452s) [noise=true , address=77.90.31.18:4806 , piece_id=RRTHOAKZSK6ZKWLXCMODWX5HZ5I62OMUEBB64FS6RSDLMNL2OESA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912890155 (17h8m55.071655889s) [noise=true , address=45.91.116.4:4937 , piece_id=AZQ6DES5FGD63E56HNPDEOJJUZNKOF3ZYU33OMOUX47L7ZGYXISQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912973765 (17h8m55.071739499s) [noise=true , address=104.36.82.4:4802 , piece_id=6TH5NRIXI5GLRDDZDKZJZWPQYCK7BTMF2U5TDQYOV3SL227M6IZA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913095419 (17h8m55.071861153s) [noise=true , address=104.36.82.10:4079 , piece_id=RSWLIXFVVRXKXD6TI4TDKEPW3HY6XU5AUAAH5N3X4UIFNEU3H5CQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913202434 (17h8m55.071968168s) [noise=true , address=77.90.31.15:4697 , piece_id=VLJCK73RVDCWWPAC7HUVHLQV2AYUPRYNEA7SNSO7P2ZMRK2FOLSQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913320449 (17h8m55.072086183s) [noise=true , address=45.91.116.9:4263 , piece_id=RYI4SAUA6IXKXAAHC62LDOKQUKQNTEG7QCG4QHUGMSREVGWEMNGA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913452622 (17h8m55.072218356s) [noise=true , address=77.90.31.12:4592 , piece_id=4RLI6WE2HS6N2QRLJQZXSYG65EIMVROLJVYNW56CSY254ZLREUYA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913534449 (17h8m55.072300183s) [noise=true , address=104.36.82.8:4971 , piece_id=UZT2NT7JR4F7NIXPSY2ORFBQVJOXZSPEJCSLFAHPH4BDSLY2W3DA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913650701 (17h8m55.072416435s) [noise=true , address=77.90.31.12:4589 , piece_id=L6ZTZ5PJPV2WM2BZGGAJEKBS4B2TS5S55PSD7WGA2YRH3MTLG5GA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:29.900914740 (17h8m57.059680464s) [upload=14994]: Next returned nil segment Aug 26 09:12:29.900934336 (17h8m57.059700081s) [upload=14994]: Waiting for error group managing segments... Aug 26 09:12:30.221707715 (17h8m57.380473449s) [noise=true , address=77.90.31.18:4806 , piece_id=RRTHOAKZSK6ZKWLXCMODWX5HZ5I62OMUEBB64FS6RSDLMNL2OESA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.225253190 (17h8m57.384018924s) [noise=true , address=77.90.31.12:4592 , piece_id=4RLI6WE2HS6N2QRLJQZXSYG65EIMVROLJVYNW56CSY254ZLREUYA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.228153169 (17h8m57.386918893s) [noise=true , address=45.91.116.4:4937 , piece_id=AZQ6DES5FGD63E56HNPDEOJJUZNKOF3ZYU33OMOUX47L7ZGYXISQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.244451243 (17h8m57.403216977s) [noise=true , address=45.91.116.9:4263 , piece_id=RYI4SAUA6IXKXAAHC62LDOKQUKQNTEG7QCG4QHUGMSREVGWEMNGA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.274597415 (17h8m57.433363149s) [noise=true , address=45.91.116.5:4299 , piece_id=G2JPCAKEMRINSSYZ24B362KA54Q2T6HDEGJQFHVWNEJGGFGRR2KA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.280700783 (17h8m57.439466517s) [noise=true , address=104.36.82.4:4802 , piece_id=6TH5NRIXI5GLRDDZDKZJZWPQYCK7BTMF2U5TDQYOV3SL227M6IZA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.294073090 (17h8m57.452838824s) [noise=true , address=104.36.82.7:4912 , piece_id=OYVJF5VJJMZGE6E2JREPMGIZGWKQQWAHK4WCUHXFATZZGJXFJW2Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.310065069 (17h8m57.468830803s) [noise=true , address=104.36.82.8:4971 , piece_id=UZT2NT7JR4F7NIXPSY2ORFBQVJOXZSPEJCSLFAHPH4BDSLY2W3DA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.310725412 (17h8m57.469491146s) [noise=true , address=45.91.116.10:4081 , piece_id=YYCAJYYQ4MXTVLBHWA6R66TIAHAEJOUQ7BBH6A3PVB56MCXUXCDA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.327312570 (17h8m57.486078304s) [noise=true , address=77.90.31.15:4697 , piece_id=VLJCK73RVDCWWPAC7HUVHLQV2AYUPRYNEA7SNSO7P2ZMRK2FOLSQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.371703187 (17h8m57.530468921s) [noise=true , address=77.90.31.16:4735 , piece_id=F5ZXRAIRT3GGYVDCOHQWEAWDTJ5DN2OF2AW5YB3W3MTHTUUTVJ6Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.427020261 (17h8m57.585785996s) [noise=true , address=45.91.116.11:4119 , piece_id=RRRPLNZBTVHIQTUMONDVTIBCMEBLBM2RPFCOHX7RBX4HFGZUYS3Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.436406982 (17h8m57.595172716s) [noise=true , address=45.91.116.14:4191 , piece_id=YO65KQXJOPP2BVDRQTEURGV2RDY3M36W4JSPPBTM6LKVHZ7UIEXA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.436435246 (17h8m57.59520098s) [seg_pos={0 0}, upload=14994]: Segment reached optimal threshold of 13 pieces. Aug 26 09:12:30.436615631 (17h8m57.595381365s) [noise=true , address=77.90.31.12:4589 , piece_id=L6ZTZ5PJPV2WM2BZGGAJEKBS4B2TS5S55PSD7WGA2YRH3MTLG5GA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv): protocol: expected piece hash; context canceled; EOF Aug 26 09:12:30.436693600 (17h8m57.595459334s) [noise=true , address=45.91.116.9:4262 , piece_id=WRDGDP5TBAYZTRPBYDW4ZESCR7NJJHVBU6WP4UYC4B3V5D7ICOMA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto): protocol: write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection; write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection Aug 26 09:12:30.436700754 (17h8m57.595466488s) [noise=true , address=104.36.82.10:4079 , piece_id=RSWLIXFVVRXKXD6TI4TDKEPW3HY6XU5AUAAH5N3X4UIFNEU3H5CQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF Aug 26 09:12:30.436750138 (17h8m57.595515872s) [seg_pos={0 0}, upload=14994]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 26 09:12:30.436849909 (17h8m57.595615643s) [upload=14994]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 09:12:30.436855740 (17h8m57.595621474s) [upload=14994]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 09:12:30.739827348 (17h8m57.898593082s) [upload=14994]: Done uploading segments... Aug 26 09:12:30.739846063 (17h8m57.898611797s) [upload=14994]: Upload finished. err: <nil> Duration: 5.906847036s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 4.965116164s FAIL (2025-08-26 09:20:14 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 4.96517119s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [............................................X...X...........] duration: 6.747539191s FAIL (2025-08-26 09:19:49 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Aug 26 09:12:27.460801938 (17h8m54.619567672s) [upload=14994]: Starting upload Aug 26 09:12:27.460861261 (17h8m54.619626995s) [upload=14994]: Done starting upload Aug 26 09:12:27.460967244 (17h8m54.619732978s) [upload=14994]: Uploading segments... Aug 26 09:12:27.461061044 (17h8m54.619826768s) [upload=14994]: Got next segment. Inline: false Aug 26 09:12:27.461137420 (17h8m54.619903154s) [upload=14994]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 09:12:27.461142410 (17h8m54.619908144s) [upload=14994]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 09:12:27.911433899 (17h8m55.070199633s) [seg_pos={0 0}, upload=14994]: Begin upload segment... Aug 26 09:12:27.911481470 (17h8m55.070247204s) [seg_pos={0 0}, upload=14994]: Done begin upload segment. Aug 26 09:12:27.911501920 (17h8m55.070267654s) [noise=true , address=104.36.82.7:4912 , piece_id=OYVJF5VJJMZGE6E2JREPMGIZGWKQQWAHK4WCUHXFATZZGJXFJW2Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.911554130 (17h8m55.070319904s) [noise=true , address=45.91.116.14:4191 , piece_id=YO65KQXJOPP2BVDRQTEURGV2RDY3M36W4JSPPBTM6LKVHZ7UIEXA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.911868270 (17h8m55.070634004s) [noise=true , address=45.91.116.11:4119 , piece_id=RRRPLNZBTVHIQTUMONDVTIBCMEBLBM2RPFCOHX7RBX4HFGZUYS3Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912181570 (17h8m55.070947305s) [noise=true , address=45.91.116.10:4081 , piece_id=YYCAJYYQ4MXTVLBHWA6R66TIAHAEJOUQ7BBH6A3PVB56MCXUXCDA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912244641 (17h8m55.071010365s) [noise=true , address=77.90.31.16:4735 , piece_id=F5ZXRAIRT3GGYVDCOHQWEAWDTJ5DN2OF2AW5YB3W3MTHTUUTVJ6Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912475152 (17h8m55.071240886s) [noise=true , address=45.91.116.5:4299 , piece_id=G2JPCAKEMRINSSYZ24B362KA54Q2T6HDEGJQFHVWNEJGGFGRR2KA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912684673 (17h8m55.071450407s) [noise=true , address=45.91.116.9:4262 , piece_id=WRDGDP5TBAYZTRPBYDW4ZESCR7NJJHVBU6WP4UYC4B3V5D7ICOMA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912718718 (17h8m55.071484452s) [noise=true , address=77.90.31.18:4806 , piece_id=RRTHOAKZSK6ZKWLXCMODWX5HZ5I62OMUEBB64FS6RSDLMNL2OESA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912890155 (17h8m55.071655889s) [noise=true , address=45.91.116.4:4937 , piece_id=AZQ6DES5FGD63E56HNPDEOJJUZNKOF3ZYU33OMOUX47L7ZGYXISQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912973765 (17h8m55.071739499s) [noise=true , address=104.36.82.4:4802 , piece_id=6TH5NRIXI5GLRDDZDKZJZWPQYCK7BTMF2U5TDQYOV3SL227M6IZA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913095419 (17h8m55.071861153s) [noise=true , address=104.36.82.10:4079 , piece_id=RSWLIXFVVRXKXD6TI4TDKEPW3HY6XU5AUAAH5N3X4UIFNEU3H5CQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913202434 (17h8m55.071968168s) [noise=true , address=77.90.31.15:4697 , piece_id=VLJCK73RVDCWWPAC7HUVHLQV2AYUPRYNEA7SNSO7P2ZMRK2FOLSQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913320449 (17h8m55.072086183s) [noise=true , address=45.91.116.9:4263 , piece_id=RYI4SAUA6IXKXAAHC62LDOKQUKQNTEG7QCG4QHUGMSREVGWEMNGA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913452622 (17h8m55.072218356s) [noise=true , address=77.90.31.12:4592 , piece_id=4RLI6WE2HS6N2QRLJQZXSYG65EIMVROLJVYNW56CSY254ZLREUYA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913534449 (17h8m55.072300183s) [noise=true , address=104.36.82.8:4971 , piece_id=UZT2NT7JR4F7NIXPSY2ORFBQVJOXZSPEJCSLFAHPH4BDSLY2W3DA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913650701 (17h8m55.072416435s) [noise=true , address=77.90.31.12:4589 , piece_id=L6ZTZ5PJPV2WM2BZGGAJEKBS4B2TS5S55PSD7WGA2YRH3MTLG5GA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:29.900914740 (17h8m57.059680464s) [upload=14994]: Next returned nil segment Aug 26 09:12:29.900934336 (17h8m57.059700081s) [upload=14994]: Waiting for error group managing segments... Aug 26 09:12:30.221707715 (17h8m57.380473449s) [noise=true , address=77.90.31.18:4806 , piece_id=RRTHOAKZSK6ZKWLXCMODWX5HZ5I62OMUEBB64FS6RSDLMNL2OESA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.225253190 (17h8m57.384018924s) [noise=true , address=77.90.31.12:4592 , piece_id=4RLI6WE2HS6N2QRLJQZXSYG65EIMVROLJVYNW56CSY254ZLREUYA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.228153169 (17h8m57.386918893s) [noise=true , address=45.91.116.4:4937 , piece_id=AZQ6DES5FGD63E56HNPDEOJJUZNKOF3ZYU33OMOUX47L7ZGYXISQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.244451243 (17h8m57.403216977s) [noise=true , address=45.91.116.9:4263 , piece_id=RYI4SAUA6IXKXAAHC62LDOKQUKQNTEG7QCG4QHUGMSREVGWEMNGA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.274597415 (17h8m57.433363149s) [noise=true , address=45.91.116.5:4299 , piece_id=G2JPCAKEMRINSSYZ24B362KA54Q2T6HDEGJQFHVWNEJGGFGRR2KA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.280700783 (17h8m57.439466517s) [noise=true , address=104.36.82.4:4802 , piece_id=6TH5NRIXI5GLRDDZDKZJZWPQYCK7BTMF2U5TDQYOV3SL227M6IZA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.294073090 (17h8m57.452838824s) [noise=true , address=104.36.82.7:4912 , piece_id=OYVJF5VJJMZGE6E2JREPMGIZGWKQQWAHK4WCUHXFATZZGJXFJW2Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.310065069 (17h8m57.468830803s) [noise=true , address=104.36.82.8:4971 , piece_id=UZT2NT7JR4F7NIXPSY2ORFBQVJOXZSPEJCSLFAHPH4BDSLY2W3DA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.310725412 (17h8m57.469491146s) [noise=true , address=45.91.116.10:4081 , piece_id=YYCAJYYQ4MXTVLBHWA6R66TIAHAEJOUQ7BBH6A3PVB56MCXUXCDA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.327312570 (17h8m57.486078304s) [noise=true , address=77.90.31.15:4697 , piece_id=VLJCK73RVDCWWPAC7HUVHLQV2AYUPRYNEA7SNSO7P2ZMRK2FOLSQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.371703187 (17h8m57.530468921s) [noise=true , address=77.90.31.16:4735 , piece_id=F5ZXRAIRT3GGYVDCOHQWEAWDTJ5DN2OF2AW5YB3W3MTHTUUTVJ6Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.427020261 (17h8m57.585785996s) [noise=true , address=45.91.116.11:4119 , piece_id=RRRPLNZBTVHIQTUMONDVTIBCMEBLBM2RPFCOHX7RBX4HFGZUYS3Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.436406982 (17h8m57.595172716s) [noise=true , address=45.91.116.14:4191 , piece_id=YO65KQXJOPP2BVDRQTEURGV2RDY3M36W4JSPPBTM6LKVHZ7UIEXA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.436435246 (17h8m57.59520098s) [seg_pos={0 0}, upload=14994]: Segment reached optimal threshold of 13 pieces. Aug 26 09:12:30.436615631 (17h8m57.595381365s) [noise=true , address=77.90.31.12:4589 , piece_id=L6ZTZ5PJPV2WM2BZGGAJEKBS4B2TS5S55PSD7WGA2YRH3MTLG5GA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv): protocol: expected piece hash; context canceled; EOF Aug 26 09:12:30.436693600 (17h8m57.595459334s) [noise=true , address=45.91.116.9:4262 , piece_id=WRDGDP5TBAYZTRPBYDW4ZESCR7NJJHVBU6WP4UYC4B3V5D7ICOMA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto): protocol: write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection; write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection Aug 26 09:12:30.436700754 (17h8m57.595466488s) [noise=true , address=104.36.82.10:4079 , piece_id=RSWLIXFVVRXKXD6TI4TDKEPW3HY6XU5AUAAH5N3X4UIFNEU3H5CQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF Aug 26 09:12:30.436750138 (17h8m57.595515872s) [seg_pos={0 0}, upload=14994]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 26 09:12:30.436849909 (17h8m57.595615643s) [upload=14994]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 09:12:30.436855740 (17h8m57.595621474s) [upload=14994]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 09:12:30.739827348 (17h8m57.898593082s) [upload=14994]: Done uploading segments... Aug 26 09:12:30.739846063 (17h8m57.898611797s) [upload=14994]: Upload finished. err: <nil> Duration: 6.747565662s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 5.028041092s FAIL (2025-08-26 09:19:43 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 5.028063925s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.............................................X...X..........] duration: 6.637187055s FAIL (2025-08-26 09:18:51 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Aug 26 09:12:27.460801938 (17h8m54.619567672s) [upload=14994]: Starting upload Aug 26 09:12:27.460861261 (17h8m54.619626995s) [upload=14994]: Done starting upload Aug 26 09:12:27.460967244 (17h8m54.619732978s) [upload=14994]: Uploading segments... Aug 26 09:12:27.461061044 (17h8m54.619826768s) [upload=14994]: Got next segment. Inline: false Aug 26 09:12:27.461137420 (17h8m54.619903154s) [upload=14994]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 09:12:27.461142410 (17h8m54.619908144s) [upload=14994]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 09:12:27.911433899 (17h8m55.070199633s) [seg_pos={0 0}, upload=14994]: Begin upload segment... Aug 26 09:12:27.911481470 (17h8m55.070247204s) [seg_pos={0 0}, upload=14994]: Done begin upload segment. Aug 26 09:12:27.911501920 (17h8m55.070267654s) [noise=true , address=104.36.82.7:4912 , piece_id=OYVJF5VJJMZGE6E2JREPMGIZGWKQQWAHK4WCUHXFATZZGJXFJW2Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.911554130 (17h8m55.070319904s) [noise=true , address=45.91.116.14:4191 , piece_id=YO65KQXJOPP2BVDRQTEURGV2RDY3M36W4JSPPBTM6LKVHZ7UIEXA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.911868270 (17h8m55.070634004s) [noise=true , address=45.91.116.11:4119 , piece_id=RRRPLNZBTVHIQTUMONDVTIBCMEBLBM2RPFCOHX7RBX4HFGZUYS3Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912181570 (17h8m55.070947305s) [noise=true , address=45.91.116.10:4081 , piece_id=YYCAJYYQ4MXTVLBHWA6R66TIAHAEJOUQ7BBH6A3PVB56MCXUXCDA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912244641 (17h8m55.071010365s) [noise=true , address=77.90.31.16:4735 , piece_id=F5ZXRAIRT3GGYVDCOHQWEAWDTJ5DN2OF2AW5YB3W3MTHTUUTVJ6Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912475152 (17h8m55.071240886s) [noise=true , address=45.91.116.5:4299 , piece_id=G2JPCAKEMRINSSYZ24B362KA54Q2T6HDEGJQFHVWNEJGGFGRR2KA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912684673 (17h8m55.071450407s) [noise=true , address=45.91.116.9:4262 , piece_id=WRDGDP5TBAYZTRPBYDW4ZESCR7NJJHVBU6WP4UYC4B3V5D7ICOMA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912718718 (17h8m55.071484452s) [noise=true , address=77.90.31.18:4806 , piece_id=RRTHOAKZSK6ZKWLXCMODWX5HZ5I62OMUEBB64FS6RSDLMNL2OESA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912890155 (17h8m55.071655889s) [noise=true , address=45.91.116.4:4937 , piece_id=AZQ6DES5FGD63E56HNPDEOJJUZNKOF3ZYU33OMOUX47L7ZGYXISQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912973765 (17h8m55.071739499s) [noise=true , address=104.36.82.4:4802 , piece_id=6TH5NRIXI5GLRDDZDKZJZWPQYCK7BTMF2U5TDQYOV3SL227M6IZA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913095419 (17h8m55.071861153s) [noise=true , address=104.36.82.10:4079 , piece_id=RSWLIXFVVRXKXD6TI4TDKEPW3HY6XU5AUAAH5N3X4UIFNEU3H5CQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913202434 (17h8m55.071968168s) [noise=true , address=77.90.31.15:4697 , piece_id=VLJCK73RVDCWWPAC7HUVHLQV2AYUPRYNEA7SNSO7P2ZMRK2FOLSQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913320449 (17h8m55.072086183s) [noise=true , address=45.91.116.9:4263 , piece_id=RYI4SAUA6IXKXAAHC62LDOKQUKQNTEG7QCG4QHUGMSREVGWEMNGA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913452622 (17h8m55.072218356s) [noise=true , address=77.90.31.12:4592 , piece_id=4RLI6WE2HS6N2QRLJQZXSYG65EIMVROLJVYNW56CSY254ZLREUYA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913534449 (17h8m55.072300183s) [noise=true , address=104.36.82.8:4971 , piece_id=UZT2NT7JR4F7NIXPSY2ORFBQVJOXZSPEJCSLFAHPH4BDSLY2W3DA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913650701 (17h8m55.072416435s) [noise=true , address=77.90.31.12:4589 , piece_id=L6ZTZ5PJPV2WM2BZGGAJEKBS4B2TS5S55PSD7WGA2YRH3MTLG5GA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:29.900914740 (17h8m57.059680464s) [upload=14994]: Next returned nil segment Aug 26 09:12:29.900934336 (17h8m57.059700081s) [upload=14994]: Waiting for error group managing segments... Aug 26 09:12:30.221707715 (17h8m57.380473449s) [noise=true , address=77.90.31.18:4806 , piece_id=RRTHOAKZSK6ZKWLXCMODWX5HZ5I62OMUEBB64FS6RSDLMNL2OESA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.225253190 (17h8m57.384018924s) [noise=true , address=77.90.31.12:4592 , piece_id=4RLI6WE2HS6N2QRLJQZXSYG65EIMVROLJVYNW56CSY254ZLREUYA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.228153169 (17h8m57.386918893s) [noise=true , address=45.91.116.4:4937 , piece_id=AZQ6DES5FGD63E56HNPDEOJJUZNKOF3ZYU33OMOUX47L7ZGYXISQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.244451243 (17h8m57.403216977s) [noise=true , address=45.91.116.9:4263 , piece_id=RYI4SAUA6IXKXAAHC62LDOKQUKQNTEG7QCG4QHUGMSREVGWEMNGA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.274597415 (17h8m57.433363149s) [noise=true , address=45.91.116.5:4299 , piece_id=G2JPCAKEMRINSSYZ24B362KA54Q2T6HDEGJQFHVWNEJGGFGRR2KA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.280700783 (17h8m57.439466517s) [noise=true , address=104.36.82.4:4802 , piece_id=6TH5NRIXI5GLRDDZDKZJZWPQYCK7BTMF2U5TDQYOV3SL227M6IZA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.294073090 (17h8m57.452838824s) [noise=true , address=104.36.82.7:4912 , piece_id=OYVJF5VJJMZGE6E2JREPMGIZGWKQQWAHK4WCUHXFATZZGJXFJW2Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.310065069 (17h8m57.468830803s) [noise=true , address=104.36.82.8:4971 , piece_id=UZT2NT7JR4F7NIXPSY2ORFBQVJOXZSPEJCSLFAHPH4BDSLY2W3DA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.310725412 (17h8m57.469491146s) [noise=true , address=45.91.116.10:4081 , piece_id=YYCAJYYQ4MXTVLBHWA6R66TIAHAEJOUQ7BBH6A3PVB56MCXUXCDA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.327312570 (17h8m57.486078304s) [noise=true , address=77.90.31.15:4697 , piece_id=VLJCK73RVDCWWPAC7HUVHLQV2AYUPRYNEA7SNSO7P2ZMRK2FOLSQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.371703187 (17h8m57.530468921s) [noise=true , address=77.90.31.16:4735 , piece_id=F5ZXRAIRT3GGYVDCOHQWEAWDTJ5DN2OF2AW5YB3W3MTHTUUTVJ6Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.427020261 (17h8m57.585785996s) [noise=true , address=45.91.116.11:4119 , piece_id=RRRPLNZBTVHIQTUMONDVTIBCMEBLBM2RPFCOHX7RBX4HFGZUYS3Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.436406982 (17h8m57.595172716s) [noise=true , address=45.91.116.14:4191 , piece_id=YO65KQXJOPP2BVDRQTEURGV2RDY3M36W4JSPPBTM6LKVHZ7UIEXA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.436435246 (17h8m57.59520098s) [seg_pos={0 0}, upload=14994]: Segment reached optimal threshold of 13 pieces. Aug 26 09:12:30.436615631 (17h8m57.595381365s) [noise=true , address=77.90.31.12:4589 , piece_id=L6ZTZ5PJPV2WM2BZGGAJEKBS4B2TS5S55PSD7WGA2YRH3MTLG5GA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv): protocol: expected piece hash; context canceled; EOF Aug 26 09:12:30.436693600 (17h8m57.595459334s) [noise=true , address=45.91.116.9:4262 , piece_id=WRDGDP5TBAYZTRPBYDW4ZESCR7NJJHVBU6WP4UYC4B3V5D7ICOMA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto): protocol: write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection; write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection Aug 26 09:12:30.436700754 (17h8m57.595466488s) [noise=true , address=104.36.82.10:4079 , piece_id=RSWLIXFVVRXKXD6TI4TDKEPW3HY6XU5AUAAH5N3X4UIFNEU3H5CQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF Aug 26 09:12:30.436750138 (17h8m57.595515872s) [seg_pos={0 0}, upload=14994]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 26 09:12:30.436849909 (17h8m57.595615643s) [upload=14994]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 09:12:30.436855740 (17h8m57.595621474s) [upload=14994]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 09:12:30.739827348 (17h8m57.898593082s) [upload=14994]: Done uploading segments... Aug 26 09:12:30.739846063 (17h8m57.898611797s) [upload=14994]: Upload finished. err: <nil> Duration: 6.637219156s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..............................................X...X.........] duration: 14.173932882s FAIL (2025-08-26 09:18:41 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Aug 26 09:12:27.460801938 (17h8m54.619567672s) [upload=14994]: Starting upload Aug 26 09:12:27.460861261 (17h8m54.619626995s) [upload=14994]: Done starting upload Aug 26 09:12:27.460967244 (17h8m54.619732978s) [upload=14994]: Uploading segments... Aug 26 09:12:27.461061044 (17h8m54.619826768s) [upload=14994]: Got next segment. Inline: false Aug 26 09:12:27.461137420 (17h8m54.619903154s) [upload=14994]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 09:12:27.461142410 (17h8m54.619908144s) [upload=14994]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 09:12:27.911433899 (17h8m55.070199633s) [seg_pos={0 0}, upload=14994]: Begin upload segment... Aug 26 09:12:27.911481470 (17h8m55.070247204s) [seg_pos={0 0}, upload=14994]: Done begin upload segment. Aug 26 09:12:27.911501920 (17h8m55.070267654s) [noise=true , address=104.36.82.7:4912 , piece_id=OYVJF5VJJMZGE6E2JREPMGIZGWKQQWAHK4WCUHXFATZZGJXFJW2Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.911554130 (17h8m55.070319904s) [noise=true , address=45.91.116.14:4191 , piece_id=YO65KQXJOPP2BVDRQTEURGV2RDY3M36W4JSPPBTM6LKVHZ7UIEXA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.911868270 (17h8m55.070634004s) [noise=true , address=45.91.116.11:4119 , piece_id=RRRPLNZBTVHIQTUMONDVTIBCMEBLBM2RPFCOHX7RBX4HFGZUYS3Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912181570 (17h8m55.070947305s) [noise=true , address=45.91.116.10:4081 , piece_id=YYCAJYYQ4MXTVLBHWA6R66TIAHAEJOUQ7BBH6A3PVB56MCXUXCDA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912244641 (17h8m55.071010365s) [noise=true , address=77.90.31.16:4735 , piece_id=F5ZXRAIRT3GGYVDCOHQWEAWDTJ5DN2OF2AW5YB3W3MTHTUUTVJ6Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912475152 (17h8m55.071240886s) [noise=true , address=45.91.116.5:4299 , piece_id=G2JPCAKEMRINSSYZ24B362KA54Q2T6HDEGJQFHVWNEJGGFGRR2KA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912684673 (17h8m55.071450407s) [noise=true , address=45.91.116.9:4262 , piece_id=WRDGDP5TBAYZTRPBYDW4ZESCR7NJJHVBU6WP4UYC4B3V5D7ICOMA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912718718 (17h8m55.071484452s) [noise=true , address=77.90.31.18:4806 , piece_id=RRTHOAKZSK6ZKWLXCMODWX5HZ5I62OMUEBB64FS6RSDLMNL2OESA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912890155 (17h8m55.071655889s) [noise=true , address=45.91.116.4:4937 , piece_id=AZQ6DES5FGD63E56HNPDEOJJUZNKOF3ZYU33OMOUX47L7ZGYXISQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912973765 (17h8m55.071739499s) [noise=true , address=104.36.82.4:4802 , piece_id=6TH5NRIXI5GLRDDZDKZJZWPQYCK7BTMF2U5TDQYOV3SL227M6IZA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913095419 (17h8m55.071861153s) [noise=true , address=104.36.82.10:4079 , piece_id=RSWLIXFVVRXKXD6TI4TDKEPW3HY6XU5AUAAH5N3X4UIFNEU3H5CQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913202434 (17h8m55.071968168s) [noise=true , address=77.90.31.15:4697 , piece_id=VLJCK73RVDCWWPAC7HUVHLQV2AYUPRYNEA7SNSO7P2ZMRK2FOLSQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913320449 (17h8m55.072086183s) [noise=true , address=45.91.116.9:4263 , piece_id=RYI4SAUA6IXKXAAHC62LDOKQUKQNTEG7QCG4QHUGMSREVGWEMNGA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913452622 (17h8m55.072218356s) [noise=true , address=77.90.31.12:4592 , piece_id=4RLI6WE2HS6N2QRLJQZXSYG65EIMVROLJVYNW56CSY254ZLREUYA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913534449 (17h8m55.072300183s) [noise=true , address=104.36.82.8:4971 , piece_id=UZT2NT7JR4F7NIXPSY2ORFBQVJOXZSPEJCSLFAHPH4BDSLY2W3DA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913650701 (17h8m55.072416435s) [noise=true , address=77.90.31.12:4589 , piece_id=L6ZTZ5PJPV2WM2BZGGAJEKBS4B2TS5S55PSD7WGA2YRH3MTLG5GA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:29.900914740 (17h8m57.059680464s) [upload=14994]: Next returned nil segment Aug 26 09:12:29.900934336 (17h8m57.059700081s) [upload=14994]: Waiting for error group managing segments... Aug 26 09:12:30.221707715 (17h8m57.380473449s) [noise=true , address=77.90.31.18:4806 , piece_id=RRTHOAKZSK6ZKWLXCMODWX5HZ5I62OMUEBB64FS6RSDLMNL2OESA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.225253190 (17h8m57.384018924s) [noise=true , address=77.90.31.12:4592 , piece_id=4RLI6WE2HS6N2QRLJQZXSYG65EIMVROLJVYNW56CSY254ZLREUYA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.228153169 (17h8m57.386918893s) [noise=true , address=45.91.116.4:4937 , piece_id=AZQ6DES5FGD63E56HNPDEOJJUZNKOF3ZYU33OMOUX47L7ZGYXISQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.244451243 (17h8m57.403216977s) [noise=true , address=45.91.116.9:4263 , piece_id=RYI4SAUA6IXKXAAHC62LDOKQUKQNTEG7QCG4QHUGMSREVGWEMNGA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.274597415 (17h8m57.433363149s) [noise=true , address=45.91.116.5:4299 , piece_id=G2JPCAKEMRINSSYZ24B362KA54Q2T6HDEGJQFHVWNEJGGFGRR2KA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.280700783 (17h8m57.439466517s) [noise=true , address=104.36.82.4:4802 , piece_id=6TH5NRIXI5GLRDDZDKZJZWPQYCK7BTMF2U5TDQYOV3SL227M6IZA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.294073090 (17h8m57.452838824s) [noise=true , address=104.36.82.7:4912 , piece_id=OYVJF5VJJMZGE6E2JREPMGIZGWKQQWAHK4WCUHXFATZZGJXFJW2Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.310065069 (17h8m57.468830803s) [noise=true , address=104.36.82.8:4971 , piece_id=UZT2NT7JR4F7NIXPSY2ORFBQVJOXZSPEJCSLFAHPH4BDSLY2W3DA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.310725412 (17h8m57.469491146s) [noise=true , address=45.91.116.10:4081 , piece_id=YYCAJYYQ4MXTVLBHWA6R66TIAHAEJOUQ7BBH6A3PVB56MCXUXCDA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.327312570 (17h8m57.486078304s) [noise=true , address=77.90.31.15:4697 , piece_id=VLJCK73RVDCWWPAC7HUVHLQV2AYUPRYNEA7SNSO7P2ZMRK2FOLSQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.371703187 (17h8m57.530468921s) [noise=true , address=77.90.31.16:4735 , piece_id=F5ZXRAIRT3GGYVDCOHQWEAWDTJ5DN2OF2AW5YB3W3MTHTUUTVJ6Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.427020261 (17h8m57.585785996s) [noise=true , address=45.91.116.11:4119 , piece_id=RRRPLNZBTVHIQTUMONDVTIBCMEBLBM2RPFCOHX7RBX4HFGZUYS3Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.436406982 (17h8m57.595172716s) [noise=true , address=45.91.116.14:4191 , piece_id=YO65KQXJOPP2BVDRQTEURGV2RDY3M36W4JSPPBTM6LKVHZ7UIEXA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.436435246 (17h8m57.59520098s) [seg_pos={0 0}, upload=14994]: Segment reached optimal threshold of 13 pieces. Aug 26 09:12:30.436615631 (17h8m57.595381365s) [noise=true , address=77.90.31.12:4589 , piece_id=L6ZTZ5PJPV2WM2BZGGAJEKBS4B2TS5S55PSD7WGA2YRH3MTLG5GA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv): protocol: expected piece hash; context canceled; EOF Aug 26 09:12:30.436693600 (17h8m57.595459334s) [noise=true , address=45.91.116.9:4262 , piece_id=WRDGDP5TBAYZTRPBYDW4ZESCR7NJJHVBU6WP4UYC4B3V5D7ICOMA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto): protocol: write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection; write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection Aug 26 09:12:30.436700754 (17h8m57.595466488s) [noise=true , address=104.36.82.10:4079 , piece_id=RSWLIXFVVRXKXD6TI4TDKEPW3HY6XU5AUAAH5N3X4UIFNEU3H5CQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF Aug 26 09:12:30.436750138 (17h8m57.595515872s) [seg_pos={0 0}, upload=14994]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 26 09:12:30.436849909 (17h8m57.595615643s) [upload=14994]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 09:12:30.436855740 (17h8m57.595621474s) [upload=14994]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 09:12:30.739827348 (17h8m57.898593082s) [upload=14994]: Done uploading segments... Aug 26 09:12:30.739846063 (17h8m57.898611797s) [upload=14994]: Upload finished. err: <nil> Duration: 14.173956807s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 5.091292872s FAIL (2025-08-26 09:18:29 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 5.091341153s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...............................................X...X........] duration: 6.723701823s FAIL (2025-08-26 09:18:11 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Aug 26 09:12:27.460801938 (17h8m54.619567672s) [upload=14994]: Starting upload Aug 26 09:12:27.460861261 (17h8m54.619626995s) [upload=14994]: Done starting upload Aug 26 09:12:27.460967244 (17h8m54.619732978s) [upload=14994]: Uploading segments... Aug 26 09:12:27.461061044 (17h8m54.619826768s) [upload=14994]: Got next segment. Inline: false Aug 26 09:12:27.461137420 (17h8m54.619903154s) [upload=14994]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 09:12:27.461142410 (17h8m54.619908144s) [upload=14994]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 09:12:27.911433899 (17h8m55.070199633s) [seg_pos={0 0}, upload=14994]: Begin upload segment... Aug 26 09:12:27.911481470 (17h8m55.070247204s) [seg_pos={0 0}, upload=14994]: Done begin upload segment. Aug 26 09:12:27.911501920 (17h8m55.070267654s) [noise=true , address=104.36.82.7:4912 , piece_id=OYVJF5VJJMZGE6E2JREPMGIZGWKQQWAHK4WCUHXFATZZGJXFJW2Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.911554130 (17h8m55.070319904s) [noise=true , address=45.91.116.14:4191 , piece_id=YO65KQXJOPP2BVDRQTEURGV2RDY3M36W4JSPPBTM6LKVHZ7UIEXA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.911868270 (17h8m55.070634004s) [noise=true , address=45.91.116.11:4119 , piece_id=RRRPLNZBTVHIQTUMONDVTIBCMEBLBM2RPFCOHX7RBX4HFGZUYS3Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912181570 (17h8m55.070947305s) [noise=true , address=45.91.116.10:4081 , piece_id=YYCAJYYQ4MXTVLBHWA6R66TIAHAEJOUQ7BBH6A3PVB56MCXUXCDA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912244641 (17h8m55.071010365s) [noise=true , address=77.90.31.16:4735 , piece_id=F5ZXRAIRT3GGYVDCOHQWEAWDTJ5DN2OF2AW5YB3W3MTHTUUTVJ6Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912475152 (17h8m55.071240886s) [noise=true , address=45.91.116.5:4299 , piece_id=G2JPCAKEMRINSSYZ24B362KA54Q2T6HDEGJQFHVWNEJGGFGRR2KA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912684673 (17h8m55.071450407s) [noise=true , address=45.91.116.9:4262 , piece_id=WRDGDP5TBAYZTRPBYDW4ZESCR7NJJHVBU6WP4UYC4B3V5D7ICOMA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912718718 (17h8m55.071484452s) [noise=true , address=77.90.31.18:4806 , piece_id=RRTHOAKZSK6ZKWLXCMODWX5HZ5I62OMUEBB64FS6RSDLMNL2OESA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912890155 (17h8m55.071655889s) [noise=true , address=45.91.116.4:4937 , piece_id=AZQ6DES5FGD63E56HNPDEOJJUZNKOF3ZYU33OMOUX47L7ZGYXISQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912973765 (17h8m55.071739499s) [noise=true , address=104.36.82.4:4802 , piece_id=6TH5NRIXI5GLRDDZDKZJZWPQYCK7BTMF2U5TDQYOV3SL227M6IZA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913095419 (17h8m55.071861153s) [noise=true , address=104.36.82.10:4079 , piece_id=RSWLIXFVVRXKXD6TI4TDKEPW3HY6XU5AUAAH5N3X4UIFNEU3H5CQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913202434 (17h8m55.071968168s) [noise=true , address=77.90.31.15:4697 , piece_id=VLJCK73RVDCWWPAC7HUVHLQV2AYUPRYNEA7SNSO7P2ZMRK2FOLSQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913320449 (17h8m55.072086183s) [noise=true , address=45.91.116.9:4263 , piece_id=RYI4SAUA6IXKXAAHC62LDOKQUKQNTEG7QCG4QHUGMSREVGWEMNGA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913452622 (17h8m55.072218356s) [noise=true , address=77.90.31.12:4592 , piece_id=4RLI6WE2HS6N2QRLJQZXSYG65EIMVROLJVYNW56CSY254ZLREUYA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913534449 (17h8m55.072300183s) [noise=true , address=104.36.82.8:4971 , piece_id=UZT2NT7JR4F7NIXPSY2ORFBQVJOXZSPEJCSLFAHPH4BDSLY2W3DA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913650701 (17h8m55.072416435s) [noise=true , address=77.90.31.12:4589 , piece_id=L6ZTZ5PJPV2WM2BZGGAJEKBS4B2TS5S55PSD7WGA2YRH3MTLG5GA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:29.900914740 (17h8m57.059680464s) [upload=14994]: Next returned nil segment Aug 26 09:12:29.900934336 (17h8m57.059700081s) [upload=14994]: Waiting for error group managing segments... Aug 26 09:12:30.221707715 (17h8m57.380473449s) [noise=true , address=77.90.31.18:4806 , piece_id=RRTHOAKZSK6ZKWLXCMODWX5HZ5I62OMUEBB64FS6RSDLMNL2OESA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.225253190 (17h8m57.384018924s) [noise=true , address=77.90.31.12:4592 , piece_id=4RLI6WE2HS6N2QRLJQZXSYG65EIMVROLJVYNW56CSY254ZLREUYA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.228153169 (17h8m57.386918893s) [noise=true , address=45.91.116.4:4937 , piece_id=AZQ6DES5FGD63E56HNPDEOJJUZNKOF3ZYU33OMOUX47L7ZGYXISQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.244451243 (17h8m57.403216977s) [noise=true , address=45.91.116.9:4263 , piece_id=RYI4SAUA6IXKXAAHC62LDOKQUKQNTEG7QCG4QHUGMSREVGWEMNGA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.274597415 (17h8m57.433363149s) [noise=true , address=45.91.116.5:4299 , piece_id=G2JPCAKEMRINSSYZ24B362KA54Q2T6HDEGJQFHVWNEJGGFGRR2KA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.280700783 (17h8m57.439466517s) [noise=true , address=104.36.82.4:4802 , piece_id=6TH5NRIXI5GLRDDZDKZJZWPQYCK7BTMF2U5TDQYOV3SL227M6IZA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.294073090 (17h8m57.452838824s) [noise=true , address=104.36.82.7:4912 , piece_id=OYVJF5VJJMZGE6E2JREPMGIZGWKQQWAHK4WCUHXFATZZGJXFJW2Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.310065069 (17h8m57.468830803s) [noise=true , address=104.36.82.8:4971 , piece_id=UZT2NT7JR4F7NIXPSY2ORFBQVJOXZSPEJCSLFAHPH4BDSLY2W3DA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.310725412 (17h8m57.469491146s) [noise=true , address=45.91.116.10:4081 , piece_id=YYCAJYYQ4MXTVLBHWA6R66TIAHAEJOUQ7BBH6A3PVB56MCXUXCDA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.327312570 (17h8m57.486078304s) [noise=true , address=77.90.31.15:4697 , piece_id=VLJCK73RVDCWWPAC7HUVHLQV2AYUPRYNEA7SNSO7P2ZMRK2FOLSQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.371703187 (17h8m57.530468921s) [noise=true , address=77.90.31.16:4735 , piece_id=F5ZXRAIRT3GGYVDCOHQWEAWDTJ5DN2OF2AW5YB3W3MTHTUUTVJ6Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.427020261 (17h8m57.585785996s) [noise=true , address=45.91.116.11:4119 , piece_id=RRRPLNZBTVHIQTUMONDVTIBCMEBLBM2RPFCOHX7RBX4HFGZUYS3Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.436406982 (17h8m57.595172716s) [noise=true , address=45.91.116.14:4191 , piece_id=YO65KQXJOPP2BVDRQTEURGV2RDY3M36W4JSPPBTM6LKVHZ7UIEXA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.436435246 (17h8m57.59520098s) [seg_pos={0 0}, upload=14994]: Segment reached optimal threshold of 13 pieces. Aug 26 09:12:30.436615631 (17h8m57.595381365s) [noise=true , address=77.90.31.12:4589 , piece_id=L6ZTZ5PJPV2WM2BZGGAJEKBS4B2TS5S55PSD7WGA2YRH3MTLG5GA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv): protocol: expected piece hash; context canceled; EOF Aug 26 09:12:30.436693600 (17h8m57.595459334s) [noise=true , address=45.91.116.9:4262 , piece_id=WRDGDP5TBAYZTRPBYDW4ZESCR7NJJHVBU6WP4UYC4B3V5D7ICOMA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto): protocol: write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection; write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection Aug 26 09:12:30.436700754 (17h8m57.595466488s) [noise=true , address=104.36.82.10:4079 , piece_id=RSWLIXFVVRXKXD6TI4TDKEPW3HY6XU5AUAAH5N3X4UIFNEU3H5CQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF Aug 26 09:12:30.436750138 (17h8m57.595515872s) [seg_pos={0 0}, upload=14994]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 26 09:12:30.436849909 (17h8m57.595615643s) [upload=14994]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 09:12:30.436855740 (17h8m57.595621474s) [upload=14994]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 09:12:30.739827348 (17h8m57.898593082s) [upload=14994]: Done uploading segments... Aug 26 09:12:30.739846063 (17h8m57.898611797s) [upload=14994]: Upload finished. err: <nil> Duration: 6.723724286s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 4.98468644s FAIL (2025-08-26 09:18:11 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 4.984712119s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [................................................X...X.......] duration: 6.469262327s FAIL (2025-08-26 09:17:44 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Aug 26 09:12:27.460801938 (17h8m54.619567672s) [upload=14994]: Starting upload Aug 26 09:12:27.460861261 (17h8m54.619626995s) [upload=14994]: Done starting upload Aug 26 09:12:27.460967244 (17h8m54.619732978s) [upload=14994]: Uploading segments... Aug 26 09:12:27.461061044 (17h8m54.619826768s) [upload=14994]: Got next segment. Inline: false Aug 26 09:12:27.461137420 (17h8m54.619903154s) [upload=14994]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 09:12:27.461142410 (17h8m54.619908144s) [upload=14994]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 09:12:27.911433899 (17h8m55.070199633s) [seg_pos={0 0}, upload=14994]: Begin upload segment... Aug 26 09:12:27.911481470 (17h8m55.070247204s) [seg_pos={0 0}, upload=14994]: Done begin upload segment. Aug 26 09:12:27.911501920 (17h8m55.070267654s) [noise=true , address=104.36.82.7:4912 , piece_id=OYVJF5VJJMZGE6E2JREPMGIZGWKQQWAHK4WCUHXFATZZGJXFJW2Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.911554130 (17h8m55.070319904s) [noise=true , address=45.91.116.14:4191 , piece_id=YO65KQXJOPP2BVDRQTEURGV2RDY3M36W4JSPPBTM6LKVHZ7UIEXA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.911868270 (17h8m55.070634004s) [noise=true , address=45.91.116.11:4119 , piece_id=RRRPLNZBTVHIQTUMONDVTIBCMEBLBM2RPFCOHX7RBX4HFGZUYS3Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912181570 (17h8m55.070947305s) [noise=true , address=45.91.116.10:4081 , piece_id=YYCAJYYQ4MXTVLBHWA6R66TIAHAEJOUQ7BBH6A3PVB56MCXUXCDA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912244641 (17h8m55.071010365s) [noise=true , address=77.90.31.16:4735 , piece_id=F5ZXRAIRT3GGYVDCOHQWEAWDTJ5DN2OF2AW5YB3W3MTHTUUTVJ6Q, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912475152 (17h8m55.071240886s) [noise=true , address=45.91.116.5:4299 , piece_id=G2JPCAKEMRINSSYZ24B362KA54Q2T6HDEGJQFHVWNEJGGFGRR2KA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912684673 (17h8m55.071450407s) [noise=true , address=45.91.116.9:4262 , piece_id=WRDGDP5TBAYZTRPBYDW4ZESCR7NJJHVBU6WP4UYC4B3V5D7ICOMA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912718718 (17h8m55.071484452s) [noise=true , address=77.90.31.18:4806 , piece_id=RRTHOAKZSK6ZKWLXCMODWX5HZ5I62OMUEBB64FS6RSDLMNL2OESA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912890155 (17h8m55.071655889s) [noise=true , address=45.91.116.4:4937 , piece_id=AZQ6DES5FGD63E56HNPDEOJJUZNKOF3ZYU33OMOUX47L7ZGYXISQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.912973765 (17h8m55.071739499s) [noise=true , address=104.36.82.4:4802 , piece_id=6TH5NRIXI5GLRDDZDKZJZWPQYCK7BTMF2U5TDQYOV3SL227M6IZA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913095419 (17h8m55.071861153s) [noise=true , address=104.36.82.10:4079 , piece_id=RSWLIXFVVRXKXD6TI4TDKEPW3HY6XU5AUAAH5N3X4UIFNEU3H5CQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913202434 (17h8m55.071968168s) [noise=true , address=77.90.31.15:4697 , piece_id=VLJCK73RVDCWWPAC7HUVHLQV2AYUPRYNEA7SNSO7P2ZMRK2FOLSQ, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913320449 (17h8m55.072086183s) [noise=true , address=45.91.116.9:4263 , piece_id=RYI4SAUA6IXKXAAHC62LDOKQUKQNTEG7QCG4QHUGMSREVGWEMNGA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913452622 (17h8m55.072218356s) [noise=true , address=77.90.31.12:4592 , piece_id=4RLI6WE2HS6N2QRLJQZXSYG65EIMVROLJVYNW56CSY254ZLREUYA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913534449 (17h8m55.072300183s) [noise=true , address=104.36.82.8:4971 , piece_id=UZT2NT7JR4F7NIXPSY2ORFBQVJOXZSPEJCSLFAHPH4BDSLY2W3DA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:27.913650701 (17h8m55.072416435s) [noise=true , address=77.90.31.12:4589 , piece_id=L6ZTZ5PJPV2WM2BZGGAJEKBS4B2TS5S55PSD7WGA2YRH3MTLG5GA, seg_pos={0 0}, upload=14994]: Uploading piece... Aug 26 09:12:29.900914740 (17h8m57.059680464s) [upload=14994]: Next returned nil segment Aug 26 09:12:29.900934336 (17h8m57.059700081s) [upload=14994]: Waiting for error group managing segments... Aug 26 09:12:30.221707715 (17h8m57.380473449s) [noise=true , address=77.90.31.18:4806 , piece_id=RRTHOAKZSK6ZKWLXCMODWX5HZ5I62OMUEBB64FS6RSDLMNL2OESA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.225253190 (17h8m57.384018924s) [noise=true , address=77.90.31.12:4592 , piece_id=4RLI6WE2HS6N2QRLJQZXSYG65EIMVROLJVYNW56CSY254ZLREUYA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.228153169 (17h8m57.386918893s) [noise=true , address=45.91.116.4:4937 , piece_id=AZQ6DES5FGD63E56HNPDEOJJUZNKOF3ZYU33OMOUX47L7ZGYXISQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.244451243 (17h8m57.403216977s) [noise=true , address=45.91.116.9:4263 , piece_id=RYI4SAUA6IXKXAAHC62LDOKQUKQNTEG7QCG4QHUGMSREVGWEMNGA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.274597415 (17h8m57.433363149s) [noise=true , address=45.91.116.5:4299 , piece_id=G2JPCAKEMRINSSYZ24B362KA54Q2T6HDEGJQFHVWNEJGGFGRR2KA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.280700783 (17h8m57.439466517s) [noise=true , address=104.36.82.4:4802 , piece_id=6TH5NRIXI5GLRDDZDKZJZWPQYCK7BTMF2U5TDQYOV3SL227M6IZA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.294073090 (17h8m57.452838824s) [noise=true , address=104.36.82.7:4912 , piece_id=OYVJF5VJJMZGE6E2JREPMGIZGWKQQWAHK4WCUHXFATZZGJXFJW2Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.310065069 (17h8m57.468830803s) [noise=true , address=104.36.82.8:4971 , piece_id=UZT2NT7JR4F7NIXPSY2ORFBQVJOXZSPEJCSLFAHPH4BDSLY2W3DA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.310725412 (17h8m57.469491146s) [noise=true , address=45.91.116.10:4081 , piece_id=YYCAJYYQ4MXTVLBHWA6R66TIAHAEJOUQ7BBH6A3PVB56MCXUXCDA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.327312570 (17h8m57.486078304s) [noise=true , address=77.90.31.15:4697 , piece_id=VLJCK73RVDCWWPAC7HUVHLQV2AYUPRYNEA7SNSO7P2ZMRK2FOLSQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.371703187 (17h8m57.530468921s) [noise=true , address=77.90.31.16:4735 , piece_id=F5ZXRAIRT3GGYVDCOHQWEAWDTJ5DN2OF2AW5YB3W3MTHTUUTVJ6Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.427020261 (17h8m57.585785996s) [noise=true , address=45.91.116.11:4119 , piece_id=RRRPLNZBTVHIQTUMONDVTIBCMEBLBM2RPFCOHX7RBX4HFGZUYS3Q, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.436406982 (17h8m57.595172716s) [noise=true , address=45.91.116.14:4191 , piece_id=YO65KQXJOPP2BVDRQTEURGV2RDY3M36W4JSPPBTM6LKVHZ7UIEXA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: <nil> Aug 26 09:12:30.436435246 (17h8m57.59520098s) [seg_pos={0 0}, upload=14994]: Segment reached optimal threshold of 13 pieces. Aug 26 09:12:30.436615631 (17h8m57.595381365s) [noise=true , address=77.90.31.12:4589 , piece_id=L6ZTZ5PJPV2WM2BZGGAJEKBS4B2TS5S55PSD7WGA2YRH3MTLG5GA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv): protocol: expected piece hash; context canceled; EOF Aug 26 09:12:30.436693600 (17h8m57.595459334s) [noise=true , address=45.91.116.9:4262 , piece_id=WRDGDP5TBAYZTRPBYDW4ZESCR7NJJHVBU6WP4UYC4B3V5D7ICOMA, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto): protocol: write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection; write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55590->45.91.116.9:4262: use of closed network connection Aug 26 09:12:30.436700754 (17h8m57.595466488s) [noise=true , address=104.36.82.10:4079 , piece_id=RSWLIXFVVRXKXD6TI4TDKEPW3HY6XU5AUAAH5N3X4UIFNEU3H5CQ, seg_pos={0 0}, upload=14994]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF Aug 26 09:12:30.436750138 (17h8m57.595515872s) [seg_pos={0 0}, upload=14994]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 26 09:12:30.436849909 (17h8m57.595615643s) [upload=14994]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 09:12:30.436855740 (17h8m57.595621474s) [upload=14994]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 09:12:30.739827348 (17h8m57.898593082s) [upload=14994]: Done uploading segments... Aug 26 09:12:30.739846063 (17h8m57.898611797s) [upload=14994]: Upload finished. err: <nil> Duration: 6.46930011s core uplink us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)