Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure

Orbiter Check History

Showing 50 of 433006 reports (Page 8342 of 8661)
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [.........................................................X..]
duration: 
4.954891759s
FAIL (2025-07-09 22:04:28 UTC) 
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 4.954919602s core uplink eu1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
6 out of 60 is failed (threshold=3) [......X...............X..X....X........X.........X..........]
duration: 
26.934728841s
FAIL (2025-07-09 22:04:25 UTC) 
orbiter warning: context deadline exceeded
Duration: 26.934742168s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [..........................................................X.]
duration: 
20.684861372s
FAIL (2025-07-09 22:04:24 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 20.684872302s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip: 
9 out of 60 is failed (threshold=3) [....X...............X..X.X...X...X.......X............X.X...]
duration: 
20.981107945s
FAIL (2025-07-09 22:04:17 UTC) 
orbiter warning: 
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
17505]: Done starting upload
Jul  9 22:01:35.031454414 (396h51m9.802095779s) [upload=317505]: Uploading segments...
Jul  9 22:01:35.031760129 (396h51m9.802401504s) [upload=317505]: Got next segment. Inline: false
Jul  9 22:01:35.031826716 (396h51m9.802468081s) [upload=317505]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  9 22:01:35.031834370 (396h51m9.802475725s) [upload=317505]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  9 22:01:35.482978326 (396h51m10.253619662s) [seg_pos={0 0}, upload=317505]: Begin upload segment...
Jul  9 22:01:35.483027780 (396h51m10.253669115s) [seg_pos={0 0}, upload=317505]: Done begin upload segment.
Jul  9 22:01:35.483053139 (396h51m10.253694474s) [noise=true , address=77.90.31.16:4741     , piece_id=XGSTR3METENXDLWEX5V65WJJPVLYCTF5FNN6OWOLNQ35EMYF4YBQ, seg_pos={0 0}, upload=317505]: Uploading piece...
Jul  9 22:01:35.483088858 (396h51m10.253730193s) [noise=true , address=104.36.82.17:4340    , piece_id=7SQQWWMV5Z6JVSOQKHJXCJAECAPNYVSXTNCWH3I2JLF6GEXAUWHQ, seg_pos={0 0}, upload=317505]: Uploading piece...
Jul  9 22:01:35.483512137 (396h51m10.254153472s) [noise=true , address=79.127.219.38:4013   , piece_id=IQPTM37ESAZZJELY4RLPBLBMEFPFYXP63SDVK47P7Y3HN3JKIYEQ, seg_pos={0 0}, upload=317505]: Uploading piece...
Jul  9 22:01:35.483526023 (396h51m10.254167359s) [noise=true , address=45.91.95.3:4018      , piece_id=WEMOWEK3L6A3GLWZBG4BN4JTP6PWPYZ5ATAODXEL6AAJHE2XA7AA, seg_pos={0 0}, upload=317505]: Uploading piece...
Jul  9 22:01:35.483777826 (396h51m10.254419161s) [noise=true , address=104.36.82.38:4709    , piece_id=CB52JNMPPONRIHQXMBCL4NVC23ONSTA2T4ZVYEU67A3VQZXMMLWA, seg_pos={0 0}, upload=317505]: Uploading piece...
Jul  9 22:01:35.483903696 (396h51m10.254545031s) [noise=true , address=77.90.31.17:4789     , piece_id=XS44AT7VLC7G6VVVV4HVZHNT7YTYWLAC2EOPDPDSUQ6BNMXQL2EA, seg_pos={0 0}, upload=317505]: Uploading piece...
Jul  9 22:01:35.484036110 (396h51m10.254677435s) [noise=true , address=45.91.95.5:4033      , piece_id=GOBAVQTDDZOWQHJGUVIKCRNPMEC7WC5GW5BYEQVAYDJKQK7KXAIQ, seg_pos={0 0}, upload=317505]: Uploading piece...
Jul  9 22:01:35.484318500 (396h51m10.254959835s) [noise=true , address=77.90.31.10:4547     , piece_id=GX2EF5YML4GXZ2GH5J54YBV7CGE5JKMC63MECWAMDCZYUA6QUE5A, seg_pos={0 0}, upload=317505]: Uploading piece...
Jul  9 22:01:35.484411849 (396h51m10.255053184s) [noise=true , address=77.90.31.14:4674     , piece_id=6HVO3E5TKEL5JSCA3AKOS3F6NCPD34L3ACAJGCBKDXMJQNBK2Y2Q, seg_pos={0 0}, upload=317505]: Uploading piece...
Jul  9 22:01:35.484600008 (396h51m10.255241343s) [noise=true , address=77.90.31.13:4638     , piece_id=OLHXLVAS74AXSME7T242FXYDRNY3TAASGFWRZG2DQ7Y7TY45M6IQ, seg_pos={0 0}, upload=317505]: Uploading piece...
Jul  9 22:01:35.484754364 (396h51m10.255395699s) [noise=true , address=77.90.31.18:4834     , piece_id=7BABB2K6Z5ROMH7GL4ZS3NMMTCMMKGAK3YQRW45BOQ2YSLVZ6JQQ, seg_pos={0 0}, upload=317505]: Uploading piece...
Jul  9 22:01:35.484809600 (396h51m10.255450935s) [noise=true , address=45.91.95.2:4008      , piece_id=WGWH2DZO6DGMDZBAANIDLWHR6MOCHHUZQREZAZZGGS4SE3ILP74A, seg_pos={0 0}, upload=317505]: Uploading piece...
Jul  9 22:01:35.485011466 (396h51m10.255652791s) [noise=true , address=45.91.95.4:4028      , piece_id=LNOPV7BHCMO3EAEXSYHXMHR4GJ3277WDWMFZMBE6DAP32RV2G26Q, seg_pos={0 0}, upload=317505]: Uploading piece...
Jul  9 22:01:35.485075679 (396h51m10.255717014s) [noise=true , address=79.127.220.98:4416   , piece_id=JMUXH2XXYATER2XYXWQMNOWSMVYVSXKCYGH5MHRIZ2XU2T4WKQZQ, seg_pos={0 0}, upload=317505]: Uploading piece...
Jul  9 22:01:35.485387596 (396h51m10.256028931s) [noise=true , address=77.90.31.21:4912     , piece_id=5ILPD7GX2AGAQXJLQQ5MLKVQOB6I5Q37RQV33EGGSUZIS57WIY2A, seg_pos={0 0}, upload=317505]: Uploading piece...
Jul  9 22:01:35.485694533 (396h51m10.256335868s) [noise=true , address=104.36.82.60:4339    , piece_id=VFM6GGQB3WJ3CWFXPSJN5BL2FQUTLNHURJRFBUT3XAD5CI6H5YYA, seg_pos={0 0}, upload=317505]: Uploading piece...
Jul  9 22:01:35.486011620 (396h51m10.256652955s) [noise=true , address=104.36.82.36:4628    , piece_id=WW4Z3U3GIMLRET2K2KJ4D255ROXIQH5DZBZOJQMGU62YEXKZ6G3A, seg_pos={0 0}, upload=317505]: Uploading piece...
Jul  9 22:01:35.486306593 (396h51m10.256947928s) [noise=true , address=104.36.82.44:4875    , piece_id=NPZIJRT65NIYURDZOEQVZW5EJPCDGPL4RVKRQJ4EURFQDJXQZJMA, seg_pos={0 0}, upload=317505]: Uploading piece...
Jul  9 22:01:36.891865578 (396h51m11.662506913s) [upload=317505]: Next returned nil segment
Jul  9 22:01:36.891886257 (396h51m11.662527582s) [upload=317505]: Waiting for error group managing segments...
Jul  9 22:01:37.305485395 (396h51m12.07612673s) [noise=true , address=79.127.220.98:4416   , piece_id=JMUXH2XXYATER2XYXWQMNOWSMVYVSXKCYGH5MHRIZ2XU2T4WKQZQ, seg_pos={0 0}, upload=317505]: Done uploading piece. err: <nil>
Jul  9 22:01:37.473014492 (396h51m12.243655827s) [noise=true , address=79.127.219.38:4013   , piece_id=IQPTM37ESAZZJELY4RLPBLBMEFPFYXP63SDVK47P7Y3HN3JKIYEQ, seg_pos={0 0}, upload=317505]: Done uploading piece. err: <nil>
Jul  9 22:01:37.476121286 (396h51m12.246762621s) [noise=true , address=77.90.31.10:4547     , piece_id=GX2EF5YML4GXZ2GH5J54YBV7CGE5JKMC63MECWAMDCZYUA6QUE5A, seg_pos={0 0}, upload=317505]: Done uploading piece. err: <nil>
Jul  9 22:01:37.486869289 (396h51m12.257510624s) [noise=true , address=77.90.31.17:4789     , piece_id=XS44AT7VLC7G6VVVV4HVZHNT7YTYWLAC2EOPDPDSUQ6BNMXQL2EA, seg_pos={0 0}, upload=317505]: Done uploading piece. err: <nil>
Jul  9 22:01:37.491485340 (396h51m12.262126695s) [noise=true , address=77.90.31.18:4834     , piece_id=7BABB2K6Z5ROMH7GL4ZS3NMMTCMMKGAK3YQRW45BOQ2YSLVZ6JQQ, seg_pos={0 0}, upload=317505]: Done uploading piece. err: <nil>
Jul  9 22:01:37.491802476 (396h51m12.262443811s) [noise=true , address=77.90.31.16:4741     , piece_id=XGSTR3METENXDLWEX5V65WJJPVLYCTF5FNN6OWOLNQ35EMYF4YBQ, seg_pos={0 0}, upload=317505]: Done uploading piece. err: <nil>
Jul  9 22:01:37.492708459 (396h51m12.263349785s) [noise=true , address=77.90.31.21:4912     , piece_id=5ILPD7GX2AGAQXJLQQ5MLKVQOB6I5Q37RQV33EGGSUZIS57WIY2A, seg_pos={0 0}, upload=317505]: Done uploading piece. err: <nil>
Jul  9 22:01:37.495223731 (396h51m12.265865087s) [noise=true , address=77.90.31.14:4674     , piece_id=6HVO3E5TKEL5JSCA3AKOS3F6NCPD34L3ACAJGCBKDXMJQNBK2Y2Q, seg_pos={0 0}, upload=317505]: Done uploading piece. err: <nil>
Jul  9 22:01:37.496454086 (396h51m12.267095441s) [noise=true , address=77.90.31.13:4638     , piece_id=OLHXLVAS74AXSME7T242FXYDRNY3TAASGFWRZG2DQ7Y7TY45M6IQ, seg_pos={0 0}, upload=317505]: Done uploading piece. err: <nil>
Jul  9 22:02:02.845874616 (396h51m37.616515951s) [noise=true , address=45.91.95.4:4028      , piece_id=LNOPV7BHCMO3EAEXSYHXMHR4GJ3277WDWMFZMBE6DAP32RV2G26Q, seg_pos={0 0}, upload=317505]: Done uploading piece. err: <nil>
Jul  9 22:02:08.932651945 (396h51m43.70329328s) [noise=true , address=104.36.82.44:4875    , piece_id=NPZIJRT65NIYURDZOEQVZW5EJPCDGPL4RVKRQJ4EURFQDJXQZJMA, seg_pos={0 0}, upload=317505]: Done uploading piece. err: <nil>
Jul  9 22:02:17.144956582 (396h51m51.915597917s) [noise=true , address=104.36.82.17:4340    , piece_id=7SQQWWMV5Z6JVSOQKHJXCJAECAPNYVSXTNCWH3I2JLF6GEXAUWHQ, seg_pos={0 0}, upload=317505]: Done uploading piece. err: <nil>
Jul  9 22:02:33.266596631 (396h52m8.037237966s) [noise=true , address=45.91.95.5:4033      , piece_id=GOBAVQTDDZOWQHJGUVIKCRNPMEC7WC5GW5BYEQVAYDJKQK7KXAIQ, seg_pos={0 0}, upload=317505]: Done uploading piece. err: <nil>
Jul  9 22:02:34.385712938 (396h52m9.156354273s) [noise=true , address=104.36.82.36:4628    , piece_id=WW4Z3U3GIMLRET2K2KJ4D255ROXIQH5DZBZOJQMGU62YEXKZ6G3A, seg_pos={0 0}, upload=317505]: Done uploading piece. err: ecclient: upload failed (node:1y9h3t9CQKukCffvjBC6XugNBCHguXyANBSqj6Qr98sqmPiqsp, address:104.36.82.36:4628): protocol: expected piece hash; context deadline exceeded; EOF
Jul  9 22:02:34.385742234 (396h52m9.156383569s) [noise=true , address=104.36.82.38:4709    , piece_id=CB52JNMPPONRIHQXMBCL4NVC23ONSTA2T4ZVYEU67A3VQZXMMLWA, seg_pos={0 0}, upload=317505]: Done uploading piece. err: ecclient: upload failed (node:1Ad77dgyCKuYL8o9Ac1WrMfk7pG1mgkakcVXwZa2QHD6KG5sdH, address:104.36.82.38:4709): protocol: expected piece hash; context deadline exceeded; EOF
Jul  9 22:02:34.385815304 (396h52m9.156456639s) [noise=true , address=45.91.95.3:4018      , piece_id=WEMOWEK3L6A3GLWZBG4BN4JTP6PWPYZ5ATAODXEL6AAJHE2XA7AA, seg_pos={0 0}, upload=317505]: Done uploading piece. err: ecclient: upload failed (node:12qwhpXGKbp4BZ5xTgzYZyw297QcYcrTWo3zUeXVecXsfRqxB6c, address:45.91.95.3:4018): protocol: expected piece hash; context deadline exceeded; EOF
Jul  9 22:02:34.385853136 (396h52m9.156494471s) [noise=true , address=104.36.82.60:4339    , piece_id=VFM6GGQB3WJ3CWFXPSJN5BL2FQUTLNHURJRFBUT3XAD5CI6H5YYA, seg_pos={0 0}, upload=317505]: Done uploading piece. err: ecclient: upload failed (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R, address:104.36.82.60:4339): protocol: expected piece hash; context deadline exceeded; EOF
Jul  9 22:02:34.385905035 (396h52m9.15654637s) [noise=true , address=45.91.95.2:4008      , piece_id=WGWH2DZO6DGMDZBAANIDLWHR6MOCHHUZQREZAZZGGS4SE3ILP74A, seg_pos={0 0}, upload=317505]: Done uploading piece. err: ecclient: upload failed (node:1WTvNJu1X2JaZAT9x58hxgmx849MyJWXWVsbwe8SfQexjdnJAF, address:45.91.95.2:4008): protocol: write tcp 188.166.225.170:52372->45.91.95.2:4008: use of closed network connection; write tcp 188.166.225.170:52372->45.91.95.2:4008: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52372->45.91.95.2:4008: use of closed network connection
Jul  9 22:02:34.385937026 (396h52m9.156578421s) [seg_pos={0 0}, upload=317505]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Jul  9 22:02:34.637872527 (396h52m9.408513862s) [upload=317505]: Done uploading segments...
Jul  9 22:02:34.637897874 (396h52m9.40853921s) [upload=317505]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 20.981127252s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [...........................................................X]
duration: 
30.001305481s
FAIL (2025-07-09 22:04:03 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 30.001319487s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
6 out of 60 is failed (threshold=3) [.......X...............X..X....X........X.........X.........]
duration: 
39.853937186s
FAIL (2025-07-09 22:03:58 UTC) 
orbiter warning: context deadline exceeded
Duration: 39.854027197s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip: 
10 out of 60 is failed (threshold=3) [X....X...............X..X.X...X...X.......X............X.X..]
duration: 
48.689311569s
FAIL (2025-07-09 22:03:56 UTC) 
orbiter warning: 
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
17505]: Done starting upload
Jul  9 22:01:35.031454414 (396h51m9.802095779s) [upload=317505]: Uploading segments...
Jul  9 22:01:35.031760129 (396h51m9.802401504s) [upload=317505]: Got next segment. Inline: false
Jul  9 22:01:35.031826716 (396h51m9.802468081s) [upload=317505]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  9 22:01:35.031834370 (396h51m9.802475725s) [upload=317505]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  9 22:01:35.482978326 (396h51m10.253619662s) [seg_pos={0 0}, upload=317505]: Begin upload segment...
Jul  9 22:01:35.483027780 (396h51m10.253669115s) [seg_pos={0 0}, upload=317505]: Done begin upload segment.
Jul  9 22:01:35.483053139 (396h51m10.253694474s) [noise=true , address=77.90.31.16:4741     , piece_id=XGSTR3METENXDLWEX5V65WJJPVLYCTF5FNN6OWOLNQ35EMYF4YBQ, seg_pos={0 0}, upload=317505]: Uploading piece...
Jul  9 22:01:35.483088858 (396h51m10.253730193s) [noise=true , address=104.36.82.17:4340    , piece_id=7SQQWWMV5Z6JVSOQKHJXCJAECAPNYVSXTNCWH3I2JLF6GEXAUWHQ, seg_pos={0 0}, upload=317505]: Uploading piece...
Jul  9 22:01:35.483512137 (396h51m10.254153472s) [noise=true , address=79.127.219.38:4013   , piece_id=IQPTM37ESAZZJELY4RLPBLBMEFPFYXP63SDVK47P7Y3HN3JKIYEQ, seg_pos={0 0}, upload=317505]: Uploading piece...
Jul  9 22:01:35.483526023 (396h51m10.254167359s) [noise=true , address=45.91.95.3:4018      , piece_id=WEMOWEK3L6A3GLWZBG4BN4JTP6PWPYZ5ATAODXEL6AAJHE2XA7AA, seg_pos={0 0}, upload=317505]: Uploading piece...
Jul  9 22:01:35.483777826 (396h51m10.254419161s) [noise=true , address=104.36.82.38:4709    , piece_id=CB52JNMPPONRIHQXMBCL4NVC23ONSTA2T4ZVYEU67A3VQZXMMLWA, seg_pos={0 0}, upload=317505]: Uploading piece...
Jul  9 22:01:35.483903696 (396h51m10.254545031s) [noise=true , address=77.90.31.17:4789     , piece_id=XS44AT7VLC7G6VVVV4HVZHNT7YTYWLAC2EOPDPDSUQ6BNMXQL2EA, seg_pos={0 0}, upload=317505]: Uploading piece...
Jul  9 22:01:35.484036110 (396h51m10.254677435s) [noise=true , address=45.91.95.5:4033      , piece_id=GOBAVQTDDZOWQHJGUVIKCRNPMEC7WC5GW5BYEQVAYDJKQK7KXAIQ, seg_pos={0 0}, upload=317505]: Uploading piece...
Jul  9 22:01:35.484318500 (396h51m10.254959835s) [noise=true , address=77.90.31.10:4547     , piece_id=GX2EF5YML4GXZ2GH5J54YBV7CGE5JKMC63MECWAMDCZYUA6QUE5A, seg_pos={0 0}, upload=317505]: Uploading piece...
Jul  9 22:01:35.484411849 (396h51m10.255053184s) [noise=true , address=77.90.31.14:4674     , piece_id=6HVO3E5TKEL5JSCA3AKOS3F6NCPD34L3ACAJGCBKDXMJQNBK2Y2Q, seg_pos={0 0}, upload=317505]: Uploading piece...
Jul  9 22:01:35.484600008 (396h51m10.255241343s) [noise=true , address=77.90.31.13:4638     , piece_id=OLHXLVAS74AXSME7T242FXYDRNY3TAASGFWRZG2DQ7Y7TY45M6IQ, seg_pos={0 0}, upload=317505]: Uploading piece...
Jul  9 22:01:35.484754364 (396h51m10.255395699s) [noise=true , address=77.90.31.18:4834     , piece_id=7BABB2K6Z5ROMH7GL4ZS3NMMTCMMKGAK3YQRW45BOQ2YSLVZ6JQQ, seg_pos={0 0}, upload=317505]: Uploading piece...
Jul  9 22:01:35.484809600 (396h51m10.255450935s) [noise=true , address=45.91.95.2:4008      , piece_id=WGWH2DZO6DGMDZBAANIDLWHR6MOCHHUZQREZAZZGGS4SE3ILP74A, seg_pos={0 0}, upload=317505]: Uploading piece...
Jul  9 22:01:35.485011466 (396h51m10.255652791s) [noise=true , address=45.91.95.4:4028      , piece_id=LNOPV7BHCMO3EAEXSYHXMHR4GJ3277WDWMFZMBE6DAP32RV2G26Q, seg_pos={0 0}, upload=317505]: Uploading piece...
Jul  9 22:01:35.485075679 (396h51m10.255717014s) [noise=true , address=79.127.220.98:4416   , piece_id=JMUXH2XXYATER2XYXWQMNOWSMVYVSXKCYGH5MHRIZ2XU2T4WKQZQ, seg_pos={0 0}, upload=317505]: Uploading piece...
Jul  9 22:01:35.485387596 (396h51m10.256028931s) [noise=true , address=77.90.31.21:4912     , piece_id=5ILPD7GX2AGAQXJLQQ5MLKVQOB6I5Q37RQV33EGGSUZIS57WIY2A, seg_pos={0 0}, upload=317505]: Uploading piece...
Jul  9 22:01:35.485694533 (396h51m10.256335868s) [noise=true , address=104.36.82.60:4339    , piece_id=VFM6GGQB3WJ3CWFXPSJN5BL2FQUTLNHURJRFBUT3XAD5CI6H5YYA, seg_pos={0 0}, upload=317505]: Uploading piece...
Jul  9 22:01:35.486011620 (396h51m10.256652955s) [noise=true , address=104.36.82.36:4628    , piece_id=WW4Z3U3GIMLRET2K2KJ4D255ROXIQH5DZBZOJQMGU62YEXKZ6G3A, seg_pos={0 0}, upload=317505]: Uploading piece...
Jul  9 22:01:35.486306593 (396h51m10.256947928s) [noise=true , address=104.36.82.44:4875    , piece_id=NPZIJRT65NIYURDZOEQVZW5EJPCDGPL4RVKRQJ4EURFQDJXQZJMA, seg_pos={0 0}, upload=317505]: Uploading piece...
Jul  9 22:01:36.891865578 (396h51m11.662506913s) [upload=317505]: Next returned nil segment
Jul  9 22:01:36.891886257 (396h51m11.662527582s) [upload=317505]: Waiting for error group managing segments...
Jul  9 22:01:37.305485395 (396h51m12.07612673s) [noise=true , address=79.127.220.98:4416   , piece_id=JMUXH2XXYATER2XYXWQMNOWSMVYVSXKCYGH5MHRIZ2XU2T4WKQZQ, seg_pos={0 0}, upload=317505]: Done uploading piece. err: <nil>
Jul  9 22:01:37.473014492 (396h51m12.243655827s) [noise=true , address=79.127.219.38:4013   , piece_id=IQPTM37ESAZZJELY4RLPBLBMEFPFYXP63SDVK47P7Y3HN3JKIYEQ, seg_pos={0 0}, upload=317505]: Done uploading piece. err: <nil>
Jul  9 22:01:37.476121286 (396h51m12.246762621s) [noise=true , address=77.90.31.10:4547     , piece_id=GX2EF5YML4GXZ2GH5J54YBV7CGE5JKMC63MECWAMDCZYUA6QUE5A, seg_pos={0 0}, upload=317505]: Done uploading piece. err: <nil>
Jul  9 22:01:37.486869289 (396h51m12.257510624s) [noise=true , address=77.90.31.17:4789     , piece_id=XS44AT7VLC7G6VVVV4HVZHNT7YTYWLAC2EOPDPDSUQ6BNMXQL2EA, seg_pos={0 0}, upload=317505]: Done uploading piece. err: <nil>
Jul  9 22:01:37.491485340 (396h51m12.262126695s) [noise=true , address=77.90.31.18:4834     , piece_id=7BABB2K6Z5ROMH7GL4ZS3NMMTCMMKGAK3YQRW45BOQ2YSLVZ6JQQ, seg_pos={0 0}, upload=317505]: Done uploading piece. err: <nil>
Jul  9 22:01:37.491802476 (396h51m12.262443811s) [noise=true , address=77.90.31.16:4741     , piece_id=XGSTR3METENXDLWEX5V65WJJPVLYCTF5FNN6OWOLNQ35EMYF4YBQ, seg_pos={0 0}, upload=317505]: Done uploading piece. err: <nil>
Jul  9 22:01:37.492708459 (396h51m12.263349785s) [noise=true , address=77.90.31.21:4912     , piece_id=5ILPD7GX2AGAQXJLQQ5MLKVQOB6I5Q37RQV33EGGSUZIS57WIY2A, seg_pos={0 0}, upload=317505]: Done uploading piece. err: <nil>
Jul  9 22:01:37.495223731 (396h51m12.265865087s) [noise=true , address=77.90.31.14:4674     , piece_id=6HVO3E5TKEL5JSCA3AKOS3F6NCPD34L3ACAJGCBKDXMJQNBK2Y2Q, seg_pos={0 0}, upload=317505]: Done uploading piece. err: <nil>
Jul  9 22:01:37.496454086 (396h51m12.267095441s) [noise=true , address=77.90.31.13:4638     , piece_id=OLHXLVAS74AXSME7T242FXYDRNY3TAASGFWRZG2DQ7Y7TY45M6IQ, seg_pos={0 0}, upload=317505]: Done uploading piece. err: <nil>
Jul  9 22:02:02.845874616 (396h51m37.616515951s) [noise=true , address=45.91.95.4:4028      , piece_id=LNOPV7BHCMO3EAEXSYHXMHR4GJ3277WDWMFZMBE6DAP32RV2G26Q, seg_pos={0 0}, upload=317505]: Done uploading piece. err: <nil>
Jul  9 22:02:08.932651945 (396h51m43.70329328s) [noise=true , address=104.36.82.44:4875    , piece_id=NPZIJRT65NIYURDZOEQVZW5EJPCDGPL4RVKRQJ4EURFQDJXQZJMA, seg_pos={0 0}, upload=317505]: Done uploading piece. err: <nil>
Jul  9 22:02:17.144956582 (396h51m51.915597917s) [noise=true , address=104.36.82.17:4340    , piece_id=7SQQWWMV5Z6JVSOQKHJXCJAECAPNYVSXTNCWH3I2JLF6GEXAUWHQ, seg_pos={0 0}, upload=317505]: Done uploading piece. err: <nil>
Jul  9 22:02:33.266596631 (396h52m8.037237966s) [noise=true , address=45.91.95.5:4033      , piece_id=GOBAVQTDDZOWQHJGUVIKCRNPMEC7WC5GW5BYEQVAYDJKQK7KXAIQ, seg_pos={0 0}, upload=317505]: Done uploading piece. err: <nil>
Jul  9 22:02:34.385712938 (396h52m9.156354273s) [noise=true , address=104.36.82.36:4628    , piece_id=WW4Z3U3GIMLRET2K2KJ4D255ROXIQH5DZBZOJQMGU62YEXKZ6G3A, seg_pos={0 0}, upload=317505]: Done uploading piece. err: ecclient: upload failed (node:1y9h3t9CQKukCffvjBC6XugNBCHguXyANBSqj6Qr98sqmPiqsp, address:104.36.82.36:4628): protocol: expected piece hash; context deadline exceeded; EOF
Jul  9 22:02:34.385742234 (396h52m9.156383569s) [noise=true , address=104.36.82.38:4709    , piece_id=CB52JNMPPONRIHQXMBCL4NVC23ONSTA2T4ZVYEU67A3VQZXMMLWA, seg_pos={0 0}, upload=317505]: Done uploading piece. err: ecclient: upload failed (node:1Ad77dgyCKuYL8o9Ac1WrMfk7pG1mgkakcVXwZa2QHD6KG5sdH, address:104.36.82.38:4709): protocol: expected piece hash; context deadline exceeded; EOF
Jul  9 22:02:34.385815304 (396h52m9.156456639s) [noise=true , address=45.91.95.3:4018      , piece_id=WEMOWEK3L6A3GLWZBG4BN4JTP6PWPYZ5ATAODXEL6AAJHE2XA7AA, seg_pos={0 0}, upload=317505]: Done uploading piece. err: ecclient: upload failed (node:12qwhpXGKbp4BZ5xTgzYZyw297QcYcrTWo3zUeXVecXsfRqxB6c, address:45.91.95.3:4018): protocol: expected piece hash; context deadline exceeded; EOF
Jul  9 22:02:34.385853136 (396h52m9.156494471s) [noise=true , address=104.36.82.60:4339    , piece_id=VFM6GGQB3WJ3CWFXPSJN5BL2FQUTLNHURJRFBUT3XAD5CI6H5YYA, seg_pos={0 0}, upload=317505]: Done uploading piece. err: ecclient: upload failed (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R, address:104.36.82.60:4339): protocol: expected piece hash; context deadline exceeded; EOF
Jul  9 22:02:34.385905035 (396h52m9.15654637s) [noise=true , address=45.91.95.2:4008      , piece_id=WGWH2DZO6DGMDZBAANIDLWHR6MOCHHUZQREZAZZGGS4SE3ILP74A, seg_pos={0 0}, upload=317505]: Done uploading piece. err: ecclient: upload failed (node:1WTvNJu1X2JaZAT9x58hxgmx849MyJWXWVsbwe8SfQexjdnJAF, address:45.91.95.2:4008): protocol: write tcp 188.166.225.170:52372->45.91.95.2:4008: use of closed network connection; write tcp 188.166.225.170:52372->45.91.95.2:4008: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52372->45.91.95.2:4008: use of closed network connection
Jul  9 22:02:34.385937026 (396h52m9.156578421s) [seg_pos={0 0}, upload=317505]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Jul  9 22:02:34.637872527 (396h52m9.408513862s) [upload=317505]: Done uploading segments...
Jul  9 22:02:34.637897874 (396h52m9.40853921s) [upload=317505]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 48.689337588s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [..........................................................X.]
duration: 
4.891458962s
FAIL (2025-07-09 22:03:37 UTC) 
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 4.891488918s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [...........................................................X]
duration: 
30.000671642s
FAIL (2025-07-09 22:03:27 UTC) 
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 30.00069193s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip: 
10 out of 60 is failed (threshold=3) [.X....X...............X..X.X...X...X.......X............X.X.]
duration: 
23.805029763s
FAIL (2025-07-09 22:02:58 UTC) 
orbiter warning: 
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
17505]: Done starting upload
Jul  9 22:01:35.031454414 (396h51m9.802095779s) [upload=317505]: Uploading segments...
Jul  9 22:01:35.031760129 (396h51m9.802401504s) [upload=317505]: Got next segment. Inline: false
Jul  9 22:01:35.031826716 (396h51m9.802468081s) [upload=317505]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  9 22:01:35.031834370 (396h51m9.802475725s) [upload=317505]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  9 22:01:35.482978326 (396h51m10.253619662s) [seg_pos={0 0}, upload=317505]: Begin upload segment...
Jul  9 22:01:35.483027780 (396h51m10.253669115s) [seg_pos={0 0}, upload=317505]: Done begin upload segment.
Jul  9 22:01:35.483053139 (396h51m10.253694474s) [noise=true , address=77.90.31.16:4741     , piece_id=XGSTR3METENXDLWEX5V65WJJPVLYCTF5FNN6OWOLNQ35EMYF4YBQ, seg_pos={0 0}, upload=317505]: Uploading piece...
Jul  9 22:01:35.483088858 (396h51m10.253730193s) [noise=true , address=104.36.82.17:4340    , piece_id=7SQQWWMV5Z6JVSOQKHJXCJAECAPNYVSXTNCWH3I2JLF6GEXAUWHQ, seg_pos={0 0}, upload=317505]: Uploading piece...
Jul  9 22:01:35.483512137 (396h51m10.254153472s) [noise=true , address=79.127.219.38:4013   , piece_id=IQPTM37ESAZZJELY4RLPBLBMEFPFYXP63SDVK47P7Y3HN3JKIYEQ, seg_pos={0 0}, upload=317505]: Uploading piece...
Jul  9 22:01:35.483526023 (396h51m10.254167359s) [noise=true , address=45.91.95.3:4018      , piece_id=WEMOWEK3L6A3GLWZBG4BN4JTP6PWPYZ5ATAODXEL6AAJHE2XA7AA, seg_pos={0 0}, upload=317505]: Uploading piece...
Jul  9 22:01:35.483777826 (396h51m10.254419161s) [noise=true , address=104.36.82.38:4709    , piece_id=CB52JNMPPONRIHQXMBCL4NVC23ONSTA2T4ZVYEU67A3VQZXMMLWA, seg_pos={0 0}, upload=317505]: Uploading piece...
Jul  9 22:01:35.483903696 (396h51m10.254545031s) [noise=true , address=77.90.31.17:4789     , piece_id=XS44AT7VLC7G6VVVV4HVZHNT7YTYWLAC2EOPDPDSUQ6BNMXQL2EA, seg_pos={0 0}, upload=317505]: Uploading piece...
Jul  9 22:01:35.484036110 (396h51m10.254677435s) [noise=true , address=45.91.95.5:4033      , piece_id=GOBAVQTDDZOWQHJGUVIKCRNPMEC7WC5GW5BYEQVAYDJKQK7KXAIQ, seg_pos={0 0}, upload=317505]: Uploading piece...
Jul  9 22:01:35.484318500 (396h51m10.254959835s) [noise=true , address=77.90.31.10:4547     , piece_id=GX2EF5YML4GXZ2GH5J54YBV7CGE5JKMC63MECWAMDCZYUA6QUE5A, seg_pos={0 0}, upload=317505]: Uploading piece...
Jul  9 22:01:35.484411849 (396h51m10.255053184s) [noise=true , address=77.90.31.14:4674     , piece_id=6HVO3E5TKEL5JSCA3AKOS3F6NCPD34L3ACAJGCBKDXMJQNBK2Y2Q, seg_pos={0 0}, upload=317505]: Uploading piece...
Jul  9 22:01:35.484600008 (396h51m10.255241343s) [noise=true , address=77.90.31.13:4638     , piece_id=OLHXLVAS74AXSME7T242FXYDRNY3TAASGFWRZG2DQ7Y7TY45M6IQ, seg_pos={0 0}, upload=317505]: Uploading piece...
Jul  9 22:01:35.484754364 (396h51m10.255395699s) [noise=true , address=77.90.31.18:4834     , piece_id=7BABB2K6Z5ROMH7GL4ZS3NMMTCMMKGAK3YQRW45BOQ2YSLVZ6JQQ, seg_pos={0 0}, upload=317505]: Uploading piece...
Jul  9 22:01:35.484809600 (396h51m10.255450935s) [noise=true , address=45.91.95.2:4008      , piece_id=WGWH2DZO6DGMDZBAANIDLWHR6MOCHHUZQREZAZZGGS4SE3ILP74A, seg_pos={0 0}, upload=317505]: Uploading piece...
Jul  9 22:01:35.485011466 (396h51m10.255652791s) [noise=true , address=45.91.95.4:4028      , piece_id=LNOPV7BHCMO3EAEXSYHXMHR4GJ3277WDWMFZMBE6DAP32RV2G26Q, seg_pos={0 0}, upload=317505]: Uploading piece...
Jul  9 22:01:35.485075679 (396h51m10.255717014s) [noise=true , address=79.127.220.98:4416   , piece_id=JMUXH2XXYATER2XYXWQMNOWSMVYVSXKCYGH5MHRIZ2XU2T4WKQZQ, seg_pos={0 0}, upload=317505]: Uploading piece...
Jul  9 22:01:35.485387596 (396h51m10.256028931s) [noise=true , address=77.90.31.21:4912     , piece_id=5ILPD7GX2AGAQXJLQQ5MLKVQOB6I5Q37RQV33EGGSUZIS57WIY2A, seg_pos={0 0}, upload=317505]: Uploading piece...
Jul  9 22:01:35.485694533 (396h51m10.256335868s) [noise=true , address=104.36.82.60:4339    , piece_id=VFM6GGQB3WJ3CWFXPSJN5BL2FQUTLNHURJRFBUT3XAD5CI6H5YYA, seg_pos={0 0}, upload=317505]: Uploading piece...
Jul  9 22:01:35.486011620 (396h51m10.256652955s) [noise=true , address=104.36.82.36:4628    , piece_id=WW4Z3U3GIMLRET2K2KJ4D255ROXIQH5DZBZOJQMGU62YEXKZ6G3A, seg_pos={0 0}, upload=317505]: Uploading piece...
Jul  9 22:01:35.486306593 (396h51m10.256947928s) [noise=true , address=104.36.82.44:4875    , piece_id=NPZIJRT65NIYURDZOEQVZW5EJPCDGPL4RVKRQJ4EURFQDJXQZJMA, seg_pos={0 0}, upload=317505]: Uploading piece...
Jul  9 22:01:36.891865578 (396h51m11.662506913s) [upload=317505]: Next returned nil segment
Jul  9 22:01:36.891886257 (396h51m11.662527582s) [upload=317505]: Waiting for error group managing segments...
Jul  9 22:01:37.305485395 (396h51m12.07612673s) [noise=true , address=79.127.220.98:4416   , piece_id=JMUXH2XXYATER2XYXWQMNOWSMVYVSXKCYGH5MHRIZ2XU2T4WKQZQ, seg_pos={0 0}, upload=317505]: Done uploading piece. err: <nil>
Jul  9 22:01:37.473014492 (396h51m12.243655827s) [noise=true , address=79.127.219.38:4013   , piece_id=IQPTM37ESAZZJELY4RLPBLBMEFPFYXP63SDVK47P7Y3HN3JKIYEQ, seg_pos={0 0}, upload=317505]: Done uploading piece. err: <nil>
Jul  9 22:01:37.476121286 (396h51m12.246762621s) [noise=true , address=77.90.31.10:4547     , piece_id=GX2EF5YML4GXZ2GH5J54YBV7CGE5JKMC63MECWAMDCZYUA6QUE5A, seg_pos={0 0}, upload=317505]: Done uploading piece. err: <nil>
Jul  9 22:01:37.486869289 (396h51m12.257510624s) [noise=true , address=77.90.31.17:4789     , piece_id=XS44AT7VLC7G6VVVV4HVZHNT7YTYWLAC2EOPDPDSUQ6BNMXQL2EA, seg_pos={0 0}, upload=317505]: Done uploading piece. err: <nil>
Jul  9 22:01:37.491485340 (396h51m12.262126695s) [noise=true , address=77.90.31.18:4834     , piece_id=7BABB2K6Z5ROMH7GL4ZS3NMMTCMMKGAK3YQRW45BOQ2YSLVZ6JQQ, seg_pos={0 0}, upload=317505]: Done uploading piece. err: <nil>
Jul  9 22:01:37.491802476 (396h51m12.262443811s) [noise=true , address=77.90.31.16:4741     , piece_id=XGSTR3METENXDLWEX5V65WJJPVLYCTF5FNN6OWOLNQ35EMYF4YBQ, seg_pos={0 0}, upload=317505]: Done uploading piece. err: <nil>
Jul  9 22:01:37.492708459 (396h51m12.263349785s) [noise=true , address=77.90.31.21:4912     , piece_id=5ILPD7GX2AGAQXJLQQ5MLKVQOB6I5Q37RQV33EGGSUZIS57WIY2A, seg_pos={0 0}, upload=317505]: Done uploading piece. err: <nil>
Jul  9 22:01:37.495223731 (396h51m12.265865087s) [noise=true , address=77.90.31.14:4674     , piece_id=6HVO3E5TKEL5JSCA3AKOS3F6NCPD34L3ACAJGCBKDXMJQNBK2Y2Q, seg_pos={0 0}, upload=317505]: Done uploading piece. err: <nil>
Jul  9 22:01:37.496454086 (396h51m12.267095441s) [noise=true , address=77.90.31.13:4638     , piece_id=OLHXLVAS74AXSME7T242FXYDRNY3TAASGFWRZG2DQ7Y7TY45M6IQ, seg_pos={0 0}, upload=317505]: Done uploading piece. err: <nil>
Jul  9 22:02:02.845874616 (396h51m37.616515951s) [noise=true , address=45.91.95.4:4028      , piece_id=LNOPV7BHCMO3EAEXSYHXMHR4GJ3277WDWMFZMBE6DAP32RV2G26Q, seg_pos={0 0}, upload=317505]: Done uploading piece. err: <nil>
Jul  9 22:02:08.932651945 (396h51m43.70329328s) [noise=true , address=104.36.82.44:4875    , piece_id=NPZIJRT65NIYURDZOEQVZW5EJPCDGPL4RVKRQJ4EURFQDJXQZJMA, seg_pos={0 0}, upload=317505]: Done uploading piece. err: <nil>
Jul  9 22:02:17.144956582 (396h51m51.915597917s) [noise=true , address=104.36.82.17:4340    , piece_id=7SQQWWMV5Z6JVSOQKHJXCJAECAPNYVSXTNCWH3I2JLF6GEXAUWHQ, seg_pos={0 0}, upload=317505]: Done uploading piece. err: <nil>
Jul  9 22:02:33.266596631 (396h52m8.037237966s) [noise=true , address=45.91.95.5:4033      , piece_id=GOBAVQTDDZOWQHJGUVIKCRNPMEC7WC5GW5BYEQVAYDJKQK7KXAIQ, seg_pos={0 0}, upload=317505]: Done uploading piece. err: <nil>
Jul  9 22:02:34.385712938 (396h52m9.156354273s) [noise=true , address=104.36.82.36:4628    , piece_id=WW4Z3U3GIMLRET2K2KJ4D255ROXIQH5DZBZOJQMGU62YEXKZ6G3A, seg_pos={0 0}, upload=317505]: Done uploading piece. err: ecclient: upload failed (node:1y9h3t9CQKukCffvjBC6XugNBCHguXyANBSqj6Qr98sqmPiqsp, address:104.36.82.36:4628): protocol: expected piece hash; context deadline exceeded; EOF
Jul  9 22:02:34.385742234 (396h52m9.156383569s) [noise=true , address=104.36.82.38:4709    , piece_id=CB52JNMPPONRIHQXMBCL4NVC23ONSTA2T4ZVYEU67A3VQZXMMLWA, seg_pos={0 0}, upload=317505]: Done uploading piece. err: ecclient: upload failed (node:1Ad77dgyCKuYL8o9Ac1WrMfk7pG1mgkakcVXwZa2QHD6KG5sdH, address:104.36.82.38:4709): protocol: expected piece hash; context deadline exceeded; EOF
Jul  9 22:02:34.385815304 (396h52m9.156456639s) [noise=true , address=45.91.95.3:4018      , piece_id=WEMOWEK3L6A3GLWZBG4BN4JTP6PWPYZ5ATAODXEL6AAJHE2XA7AA, seg_pos={0 0}, upload=317505]: Done uploading piece. err: ecclient: upload failed (node:12qwhpXGKbp4BZ5xTgzYZyw297QcYcrTWo3zUeXVecXsfRqxB6c, address:45.91.95.3:4018): protocol: expected piece hash; context deadline exceeded; EOF
Jul  9 22:02:34.385853136 (396h52m9.156494471s) [noise=true , address=104.36.82.60:4339    , piece_id=VFM6GGQB3WJ3CWFXPSJN5BL2FQUTLNHURJRFBUT3XAD5CI6H5YYA, seg_pos={0 0}, upload=317505]: Done uploading piece. err: ecclient: upload failed (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R, address:104.36.82.60:4339): protocol: expected piece hash; context deadline exceeded; EOF
Jul  9 22:02:34.385905035 (396h52m9.15654637s) [noise=true , address=45.91.95.2:4008      , piece_id=WGWH2DZO6DGMDZBAANIDLWHR6MOCHHUZQREZAZZGGS4SE3ILP74A, seg_pos={0 0}, upload=317505]: Done uploading piece. err: ecclient: upload failed (node:1WTvNJu1X2JaZAT9x58hxgmx849MyJWXWVsbwe8SfQexjdnJAF, address:45.91.95.2:4008): protocol: write tcp 188.166.225.170:52372->45.91.95.2:4008: use of closed network connection; write tcp 188.166.225.170:52372->45.91.95.2:4008: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52372->45.91.95.2:4008: use of closed network connection
Jul  9 22:02:34.385937026 (396h52m9.156578421s) [seg_pos={0 0}, upload=317505]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Jul  9 22:02:34.637872527 (396h52m9.408513862s) [upload=317505]: Done uploading segments...
Jul  9 22:02:34.637897874 (396h52m9.40853921s) [upload=317505]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 23.805055983s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
6 out of 60 is failed (threshold=3) [........X...............X..X....X........X.........X........]
duration: 
35.047703939s
FAIL (2025-07-09 22:02:56 UTC) 
orbiter warning: context deadline exceeded
Duration: 35.047860819s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip: 
10 out of 60 is failed (threshold=3) [..X....X...............X..X.X...X...X.......X............X.X]
duration: 
1m0.254013972s
FAIL (2025-07-09 22:02:34 UTC) 
orbiter warning: 
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
17505]: Done starting upload
Jul  9 22:01:35.031454414 (396h51m9.802095779s) [upload=317505]: Uploading segments...
Jul  9 22:01:35.031760129 (396h51m9.802401504s) [upload=317505]: Got next segment. Inline: false
Jul  9 22:01:35.031826716 (396h51m9.802468081s) [upload=317505]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  9 22:01:35.031834370 (396h51m9.802475725s) [upload=317505]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  9 22:01:35.482978326 (396h51m10.253619662s) [seg_pos={0 0}, upload=317505]: Begin upload segment...
Jul  9 22:01:35.483027780 (396h51m10.253669115s) [seg_pos={0 0}, upload=317505]: Done begin upload segment.
Jul  9 22:01:35.483053139 (396h51m10.253694474s) [noise=true , address=77.90.31.16:4741     , piece_id=XGSTR3METENXDLWEX5V65WJJPVLYCTF5FNN6OWOLNQ35EMYF4YBQ, seg_pos={0 0}, upload=317505]: Uploading piece...
Jul  9 22:01:35.483088858 (396h51m10.253730193s) [noise=true , address=104.36.82.17:4340    , piece_id=7SQQWWMV5Z6JVSOQKHJXCJAECAPNYVSXTNCWH3I2JLF6GEXAUWHQ, seg_pos={0 0}, upload=317505]: Uploading piece...
Jul  9 22:01:35.483512137 (396h51m10.254153472s) [noise=true , address=79.127.219.38:4013   , piece_id=IQPTM37ESAZZJELY4RLPBLBMEFPFYXP63SDVK47P7Y3HN3JKIYEQ, seg_pos={0 0}, upload=317505]: Uploading piece...
Jul  9 22:01:35.483526023 (396h51m10.254167359s) [noise=true , address=45.91.95.3:4018      , piece_id=WEMOWEK3L6A3GLWZBG4BN4JTP6PWPYZ5ATAODXEL6AAJHE2XA7AA, seg_pos={0 0}, upload=317505]: Uploading piece...
Jul  9 22:01:35.483777826 (396h51m10.254419161s) [noise=true , address=104.36.82.38:4709    , piece_id=CB52JNMPPONRIHQXMBCL4NVC23ONSTA2T4ZVYEU67A3VQZXMMLWA, seg_pos={0 0}, upload=317505]: Uploading piece...
Jul  9 22:01:35.483903696 (396h51m10.254545031s) [noise=true , address=77.90.31.17:4789     , piece_id=XS44AT7VLC7G6VVVV4HVZHNT7YTYWLAC2EOPDPDSUQ6BNMXQL2EA, seg_pos={0 0}, upload=317505]: Uploading piece...
Jul  9 22:01:35.484036110 (396h51m10.254677435s) [noise=true , address=45.91.95.5:4033      , piece_id=GOBAVQTDDZOWQHJGUVIKCRNPMEC7WC5GW5BYEQVAYDJKQK7KXAIQ, seg_pos={0 0}, upload=317505]: Uploading piece...
Jul  9 22:01:35.484318500 (396h51m10.254959835s) [noise=true , address=77.90.31.10:4547     , piece_id=GX2EF5YML4GXZ2GH5J54YBV7CGE5JKMC63MECWAMDCZYUA6QUE5A, seg_pos={0 0}, upload=317505]: Uploading piece...
Jul  9 22:01:35.484411849 (396h51m10.255053184s) [noise=true , address=77.90.31.14:4674     , piece_id=6HVO3E5TKEL5JSCA3AKOS3F6NCPD34L3ACAJGCBKDXMJQNBK2Y2Q, seg_pos={0 0}, upload=317505]: Uploading piece...
Jul  9 22:01:35.484600008 (396h51m10.255241343s) [noise=true , address=77.90.31.13:4638     , piece_id=OLHXLVAS74AXSME7T242FXYDRNY3TAASGFWRZG2DQ7Y7TY45M6IQ, seg_pos={0 0}, upload=317505]: Uploading piece...
Jul  9 22:01:35.484754364 (396h51m10.255395699s) [noise=true , address=77.90.31.18:4834     , piece_id=7BABB2K6Z5ROMH7GL4ZS3NMMTCMMKGAK3YQRW45BOQ2YSLVZ6JQQ, seg_pos={0 0}, upload=317505]: Uploading piece...
Jul  9 22:01:35.484809600 (396h51m10.255450935s) [noise=true , address=45.91.95.2:4008      , piece_id=WGWH2DZO6DGMDZBAANIDLWHR6MOCHHUZQREZAZZGGS4SE3ILP74A, seg_pos={0 0}, upload=317505]: Uploading piece...
Jul  9 22:01:35.485011466 (396h51m10.255652791s) [noise=true , address=45.91.95.4:4028      , piece_id=LNOPV7BHCMO3EAEXSYHXMHR4GJ3277WDWMFZMBE6DAP32RV2G26Q, seg_pos={0 0}, upload=317505]: Uploading piece...
Jul  9 22:01:35.485075679 (396h51m10.255717014s) [noise=true , address=79.127.220.98:4416   , piece_id=JMUXH2XXYATER2XYXWQMNOWSMVYVSXKCYGH5MHRIZ2XU2T4WKQZQ, seg_pos={0 0}, upload=317505]: Uploading piece...
Jul  9 22:01:35.485387596 (396h51m10.256028931s) [noise=true , address=77.90.31.21:4912     , piece_id=5ILPD7GX2AGAQXJLQQ5MLKVQOB6I5Q37RQV33EGGSUZIS57WIY2A, seg_pos={0 0}, upload=317505]: Uploading piece...
Jul  9 22:01:35.485694533 (396h51m10.256335868s) [noise=true , address=104.36.82.60:4339    , piece_id=VFM6GGQB3WJ3CWFXPSJN5BL2FQUTLNHURJRFBUT3XAD5CI6H5YYA, seg_pos={0 0}, upload=317505]: Uploading piece...
Jul  9 22:01:35.486011620 (396h51m10.256652955s) [noise=true , address=104.36.82.36:4628    , piece_id=WW4Z3U3GIMLRET2K2KJ4D255ROXIQH5DZBZOJQMGU62YEXKZ6G3A, seg_pos={0 0}, upload=317505]: Uploading piece...
Jul  9 22:01:35.486306593 (396h51m10.256947928s) [noise=true , address=104.36.82.44:4875    , piece_id=NPZIJRT65NIYURDZOEQVZW5EJPCDGPL4RVKRQJ4EURFQDJXQZJMA, seg_pos={0 0}, upload=317505]: Uploading piece...
Jul  9 22:01:36.891865578 (396h51m11.662506913s) [upload=317505]: Next returned nil segment
Jul  9 22:01:36.891886257 (396h51m11.662527582s) [upload=317505]: Waiting for error group managing segments...
Jul  9 22:01:37.305485395 (396h51m12.07612673s) [noise=true , address=79.127.220.98:4416   , piece_id=JMUXH2XXYATER2XYXWQMNOWSMVYVSXKCYGH5MHRIZ2XU2T4WKQZQ, seg_pos={0 0}, upload=317505]: Done uploading piece. err: <nil>
Jul  9 22:01:37.473014492 (396h51m12.243655827s) [noise=true , address=79.127.219.38:4013   , piece_id=IQPTM37ESAZZJELY4RLPBLBMEFPFYXP63SDVK47P7Y3HN3JKIYEQ, seg_pos={0 0}, upload=317505]: Done uploading piece. err: <nil>
Jul  9 22:01:37.476121286 (396h51m12.246762621s) [noise=true , address=77.90.31.10:4547     , piece_id=GX2EF5YML4GXZ2GH5J54YBV7CGE5JKMC63MECWAMDCZYUA6QUE5A, seg_pos={0 0}, upload=317505]: Done uploading piece. err: <nil>
Jul  9 22:01:37.486869289 (396h51m12.257510624s) [noise=true , address=77.90.31.17:4789     , piece_id=XS44AT7VLC7G6VVVV4HVZHNT7YTYWLAC2EOPDPDSUQ6BNMXQL2EA, seg_pos={0 0}, upload=317505]: Done uploading piece. err: <nil>
Jul  9 22:01:37.491485340 (396h51m12.262126695s) [noise=true , address=77.90.31.18:4834     , piece_id=7BABB2K6Z5ROMH7GL4ZS3NMMTCMMKGAK3YQRW45BOQ2YSLVZ6JQQ, seg_pos={0 0}, upload=317505]: Done uploading piece. err: <nil>
Jul  9 22:01:37.491802476 (396h51m12.262443811s) [noise=true , address=77.90.31.16:4741     , piece_id=XGSTR3METENXDLWEX5V65WJJPVLYCTF5FNN6OWOLNQ35EMYF4YBQ, seg_pos={0 0}, upload=317505]: Done uploading piece. err: <nil>
Jul  9 22:01:37.492708459 (396h51m12.263349785s) [noise=true , address=77.90.31.21:4912     , piece_id=5ILPD7GX2AGAQXJLQQ5MLKVQOB6I5Q37RQV33EGGSUZIS57WIY2A, seg_pos={0 0}, upload=317505]: Done uploading piece. err: <nil>
Jul  9 22:01:37.495223731 (396h51m12.265865087s) [noise=true , address=77.90.31.14:4674     , piece_id=6HVO3E5TKEL5JSCA3AKOS3F6NCPD34L3ACAJGCBKDXMJQNBK2Y2Q, seg_pos={0 0}, upload=317505]: Done uploading piece. err: <nil>
Jul  9 22:01:37.496454086 (396h51m12.267095441s) [noise=true , address=77.90.31.13:4638     , piece_id=OLHXLVAS74AXSME7T242FXYDRNY3TAASGFWRZG2DQ7Y7TY45M6IQ, seg_pos={0 0}, upload=317505]: Done uploading piece. err: <nil>
Jul  9 22:02:02.845874616 (396h51m37.616515951s) [noise=true , address=45.91.95.4:4028      , piece_id=LNOPV7BHCMO3EAEXSYHXMHR4GJ3277WDWMFZMBE6DAP32RV2G26Q, seg_pos={0 0}, upload=317505]: Done uploading piece. err: <nil>
Jul  9 22:02:08.932651945 (396h51m43.70329328s) [noise=true , address=104.36.82.44:4875    , piece_id=NPZIJRT65NIYURDZOEQVZW5EJPCDGPL4RVKRQJ4EURFQDJXQZJMA, seg_pos={0 0}, upload=317505]: Done uploading piece. err: <nil>
Jul  9 22:02:17.144956582 (396h51m51.915597917s) [noise=true , address=104.36.82.17:4340    , piece_id=7SQQWWMV5Z6JVSOQKHJXCJAECAPNYVSXTNCWH3I2JLF6GEXAUWHQ, seg_pos={0 0}, upload=317505]: Done uploading piece. err: <nil>
Jul  9 22:02:33.266596631 (396h52m8.037237966s) [noise=true , address=45.91.95.5:4033      , piece_id=GOBAVQTDDZOWQHJGUVIKCRNPMEC7WC5GW5BYEQVAYDJKQK7KXAIQ, seg_pos={0 0}, upload=317505]: Done uploading piece. err: <nil>
Jul  9 22:02:34.385712938 (396h52m9.156354273s) [noise=true , address=104.36.82.36:4628    , piece_id=WW4Z3U3GIMLRET2K2KJ4D255ROXIQH5DZBZOJQMGU62YEXKZ6G3A, seg_pos={0 0}, upload=317505]: Done uploading piece. err: ecclient: upload failed (node:1y9h3t9CQKukCffvjBC6XugNBCHguXyANBSqj6Qr98sqmPiqsp, address:104.36.82.36:4628): protocol: expected piece hash; context deadline exceeded; EOF
Jul  9 22:02:34.385742234 (396h52m9.156383569s) [noise=true , address=104.36.82.38:4709    , piece_id=CB52JNMPPONRIHQXMBCL4NVC23ONSTA2T4ZVYEU67A3VQZXMMLWA, seg_pos={0 0}, upload=317505]: Done uploading piece. err: ecclient: upload failed (node:1Ad77dgyCKuYL8o9Ac1WrMfk7pG1mgkakcVXwZa2QHD6KG5sdH, address:104.36.82.38:4709): protocol: expected piece hash; context deadline exceeded; EOF
Jul  9 22:02:34.385815304 (396h52m9.156456639s) [noise=true , address=45.91.95.3:4018      , piece_id=WEMOWEK3L6A3GLWZBG4BN4JTP6PWPYZ5ATAODXEL6AAJHE2XA7AA, seg_pos={0 0}, upload=317505]: Done uploading piece. err: ecclient: upload failed (node:12qwhpXGKbp4BZ5xTgzYZyw297QcYcrTWo3zUeXVecXsfRqxB6c, address:45.91.95.3:4018): protocol: expected piece hash; context deadline exceeded; EOF
Jul  9 22:02:34.385853136 (396h52m9.156494471s) [noise=true , address=104.36.82.60:4339    , piece_id=VFM6GGQB3WJ3CWFXPSJN5BL2FQUTLNHURJRFBUT3XAD5CI6H5YYA, seg_pos={0 0}, upload=317505]: Done uploading piece. err: ecclient: upload failed (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R, address:104.36.82.60:4339): protocol: expected piece hash; context deadline exceeded; EOF
Jul  9 22:02:34.385905035 (396h52m9.15654637s) [noise=true , address=45.91.95.2:4008      , piece_id=WGWH2DZO6DGMDZBAANIDLWHR6MOCHHUZQREZAZZGGS4SE3ILP74A, seg_pos={0 0}, upload=317505]: Done uploading piece. err: ecclient: upload failed (node:1WTvNJu1X2JaZAT9x58hxgmx849MyJWXWVsbwe8SfQexjdnJAF, address:45.91.95.2:4008): protocol: write tcp 188.166.225.170:52372->45.91.95.2:4008: use of closed network connection; write tcp 188.166.225.170:52372->45.91.95.2:4008: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52372->45.91.95.2:4008: use of closed network connection
Jul  9 22:02:34.385937026 (396h52m9.156578421s) [seg_pos={0 0}, upload=317505]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Jul  9 22:02:34.637872527 (396h52m9.408513862s) [upload=317505]: Done uploading segments...
Jul  9 22:02:34.637897874 (396h52m9.40853921s) [upload=317505]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 1m0.25403967s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
6 out of 60 is failed (threshold=3) [.........X...............X..X....X........X.........X.......]
duration: 
31.352242993s
FAIL (2025-07-09 22:02:14 UTC) 
orbiter warning: context deadline exceeded
Duration: 31.352261248s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip: 
9 out of 60 is failed (threshold=3) [...X....X...............X..X.X...X...X.......X............X.]
duration: 
28.466150367s
FAIL (2025-07-09 22:01:24 UTC) 
orbiter warning: 
======ERROR======
uplink: context deadline exceeded
======LOGS======
sh batch item: *pb.BatchRequestItem_SegmentBegin
Jul  9 21:59:57.365491004 (396h49m32.136132339s) [seg_pos={0 0}, upload=317485]: Begin upload segment...
Jul  9 21:59:57.365538214 (396h49m32.136179549s) [seg_pos={0 0}, upload=317485]: Done begin upload segment.
Jul  9 21:59:57.365554856 (396h49m32.136196191s) [noise=true , address=45.91.95.4:4001      , piece_id=CQ6ELD424VMDVRVC6J3CVSGWCGZD3WPYTKVLANXASZ25OYBD2PDQ, seg_pos={0 0}, upload=317485]: Uploading piece...
Jul  9 21:59:57.365563883 (396h49m32.136205218s) [noise=true , address=77.90.31.21:4887     , piece_id=EOI5DVL4X2GBSUKXSYUECS3QNFDA2NMLWLHLSTGOBCVHJIPIALDQ, seg_pos={0 0}, upload=317485]: Uploading piece...
Jul  9 21:59:57.365620953 (396h49m32.136262288s) [noise=true , address=104.36.82.38:4710    , piece_id=F2THYGFPVUQJMDLOBZQHVDSMZJN5CPVEGNMBI5VZ2W4KLYWLOJCQ, seg_pos={0 0}, upload=317485]: Uploading piece...
Jul  9 21:59:57.365982464 (396h49m32.136623799s) [noise=true , address=77.90.31.14:4677     , piece_id=B34QFJFGT6P3F3FLTCUCGRNN77QYK3CDZ63MG6NL2NTSVGFM4ZXA, seg_pos={0 0}, upload=317485]: Uploading piece...
Jul  9 21:59:57.366266678 (396h49m32.136908013s) [noise=true , address=104.36.82.40:4969    , piece_id=E4TFISU72AEYCLQOW44S3VAX6PNYNI6UFNVVEB2IZ2NNCDBZT27Q, seg_pos={0 0}, upload=317485]: Uploading piece...
Jul  9 21:59:57.366371769 (396h49m32.137013104s) [noise=true , address=45.91.95.2:4035      , piece_id=IJZZVC5X6CLDTMMQBJEYG4KFFSWWESCEDC36NRLHDHTDT5XU6ZCA, seg_pos={0 0}, upload=317485]: Uploading piece...
Jul  9 21:59:57.366643349 (396h49m32.137284674s) [noise=true , address=77.90.31.19:4858     , piece_id=DW2QOKG3LEGUDVMSPMN2DXLYZGUAFU2JRH5R7MLWL4OSLHKBAMXA, seg_pos={0 0}, upload=317485]: Uploading piece...
Jul  9 21:59:57.366911571 (396h49m32.137552906s) [noise=true , address=79.127.220.97:4368   , piece_id=5BXO5TDDG72YTM6S3SHXF5MIBYZ6MRMOXFS337NVEKKAGUYVLE6A, seg_pos={0 0}, upload=317485]: Uploading piece...
Jul  9 21:59:57.367116163 (396h49m32.137757488s) [noise=true , address=77.90.31.14:4682     , piece_id=7BZTN2CTBAAIRSAX4WGZ3YHJ75NCVS4HZXAGEGTSRGJQQJDJ26TA, seg_pos={0 0}, upload=317485]: Uploading piece...
Jul  9 21:59:57.367329601 (396h49m32.137970926s) [noise=true , address=104.36.82.18:4396    , piece_id=NOF4ILCK6CSTCVRNN3EYNWFNVYX2KU5ESFCADU6P3GSXV7ZPPXCQ, seg_pos={0 0}, upload=317485]: Uploading piece...
Jul  9 21:59:57.367566244 (396h49m32.138207579s) [noise=true , address=77.90.31.10:4544     , piece_id=TRYZDQ4XRBKX5TTJTFHASIXVMWUSXFD7ASZ3CSBIUQIEICF6WMWQ, seg_pos={0 0}, upload=317485]: Uploading piece...
Jul  9 21:59:57.367639785 (396h49m32.13828112s) [noise=true , address=77.90.31.16:4736     , piece_id=LR6X3G74LHHQJCARXWM2DQUME57BBDDHU377PLNXXVE43R3RLUUQ, seg_pos={0 0}, upload=317485]: Uploading piece...
Jul  9 21:59:57.367886267 (396h49m32.138527602s) [noise=true , address=104.36.82.36:4651    , piece_id=ULRXB4QI3YQM66SYSI7VJ2ZZJX5R5UK7LPUVDQCZK6YKL32QI57A, seg_pos={0 0}, upload=317485]: Uploading piece...
Jul  9 21:59:57.368109754 (396h49m32.138751089s) [noise=true , address=79.127.220.101:4041  , piece_id=PTCRPQZPNCCFH4XSMVGMPFZQAWUZBJG7JIYPFQUAVE6F52D6RPEA, seg_pos={0 0}, upload=317485]: Uploading piece...
Jul  9 21:59:57.368339253 (396h49m32.138980588s) [noise=true , address=77.90.31.13:4652     , piece_id=EEUPGMZ5MMQOXKJJ74QQ4B5ILZUZV2TADEK2PPWIVCIP7L35YH4A, seg_pos={0 0}, upload=317485]: Uploading piece...
Jul  9 21:59:57.368472368 (396h49m32.139113703s) [noise=true , address=45.91.95.3:4022      , piece_id=RGE5B3IDAZAAQ5BJ3INCJBJVVL2NJN737ADZZNAU5A3BKME7RWHQ, seg_pos={0 0}, upload=317485]: Uploading piece...
Jul  9 21:59:57.368690305 (396h49m32.13933164s) [noise=true , address=79.127.219.38:4023   , piece_id=5JZEDEGXA6RHRL7OOMGZU6ICTOXDD6NF2XVRZK6XWQ7VKK6LWYOA, seg_pos={0 0}, upload=317485]: Uploading piece...
Jul  9 21:59:57.368909765 (396h49m32.1395511s) [noise=true , address=45.91.95.5:4006      , piece_id=SEIVP7IDEJW6VPN5A7O2VKNCPNNF7NTGJTMDBI2NBBFN5ORNTKSA, seg_pos={0 0}, upload=317485]: Uploading piece...
Jul  9 21:59:58.313353166 (396h49m33.083994491s) [noise=true , address=45.91.95.4:4001      , piece_id=CQ6ELD424VMDVRVC6J3CVSGWCGZD3WPYTKVLANXASZ25OYBD2PDQ, seg_pos={0 0}, upload=317485]: Done uploading piece. err: ecclient: upload failed (node:12PdimTdB4ysD3SQ8hKMAGAXkzzC71irLv6rW9FArf5qmrvZ5MY, address:45.91.95.4:4001): protocol: storage node overloaded, request limit: 2000
Jul  9 21:59:58.756065621 (396h49m33.526706956s) [upload=317485]: Next returned nil segment
Jul  9 21:59:58.756084979 (396h49m33.526726314s) [upload=317485]: Waiting for error group managing segments...
Jul  9 21:59:59.268055194 (396h49m34.038696529s) [noise=true , address=79.127.220.101:4041  , piece_id=PTCRPQZPNCCFH4XSMVGMPFZQAWUZBJG7JIYPFQUAVE6F52D6RPEA, seg_pos={0 0}, upload=317485]: Done uploading piece. err: <nil>
Jul  9 21:59:59.345248446 (396h49m34.115889781s) [noise=true , address=79.127.220.97:4368   , piece_id=5BXO5TDDG72YTM6S3SHXF5MIBYZ6MRMOXFS337NVEKKAGUYVLE6A, seg_pos={0 0}, upload=317485]: Done uploading piece. err: <nil>
Jul  9 21:59:59.371176971 (396h49m34.141818306s) [noise=true , address=77.90.31.19:4858     , piece_id=DW2QOKG3LEGUDVMSPMN2DXLYZGUAFU2JRH5R7MLWL4OSLHKBAMXA, seg_pos={0 0}, upload=317485]: Done uploading piece. err: <nil>
Jul  9 21:59:59.373114388 (396h49m34.143755723s) [noise=true , address=77.90.31.14:4677     , piece_id=B34QFJFGT6P3F3FLTCUCGRNN77QYK3CDZ63MG6NL2NTSVGFM4ZXA, seg_pos={0 0}, upload=317485]: Done uploading piece. err: <nil>
Jul  9 21:59:59.373343305 (396h49m34.14398464s) [noise=true , address=77.90.31.16:4736     , piece_id=LR6X3G74LHHQJCARXWM2DQUME57BBDDHU377PLNXXVE43R3RLUUQ, seg_pos={0 0}, upload=317485]: Done uploading piece. err: <nil>
Jul  9 21:59:59.373440552 (396h49m34.144081887s) [noise=true , address=77.90.31.14:4682     , piece_id=7BZTN2CTBAAIRSAX4WGZ3YHJ75NCVS4HZXAGEGTSRGJQQJDJ26TA, seg_pos={0 0}, upload=317485]: Done uploading piece. err: <nil>
Jul  9 21:59:59.389060125 (396h49m34.15970146s) [noise=true , address=77.90.31.13:4652     , piece_id=EEUPGMZ5MMQOXKJJ74QQ4B5ILZUZV2TADEK2PPWIVCIP7L35YH4A, seg_pos={0 0}, upload=317485]: Done uploading piece. err: <nil>
Jul  9 21:59:59.391450517 (396h49m34.162091852s) [noise=true , address=77.90.31.10:4544     , piece_id=TRYZDQ4XRBKX5TTJTFHASIXVMWUSXFD7ASZ3CSBIUQIEICF6WMWQ, seg_pos={0 0}, upload=317485]: Done uploading piece. err: <nil>
Jul  9 21:59:59.397080999 (396h49m34.167722364s) [noise=true , address=77.90.31.21:4887     , piece_id=EOI5DVL4X2GBSUKXSYUECS3QNFDA2NMLWLHLSTGOBCVHJIPIALDQ, seg_pos={0 0}, upload=317485]: Done uploading piece. err: <nil>
Jul  9 22:00:05.441156519 (396h49m40.211797864s) [noise=true , address=79.127.219.38:4023   , piece_id=5JZEDEGXA6RHRL7OOMGZU6ICTOXDD6NF2XVRZK6XWQ7VKK6LWYOA, seg_pos={0 0}, upload=317485]: Done uploading piece. err: <nil>
Jul  9 22:00:19.865539301 (396h49m54.636180637s) [noise=true , address=104.36.82.36:4651    , piece_id=ULRXB4QI3YQM66SYSI7VJ2ZZJX5R5UK7LPUVDQCZK6YKL32QI57A, seg_pos={0 0}, upload=317485]: Done uploading piece. err: <nil>
Jul  9 22:00:20.403167714 (396h49m55.173809049s) [noise=true , address=104.36.82.40:4969    , piece_id=E4TFISU72AEYCLQOW44S3VAX6PNYNI6UFNVVEB2IZ2NNCDBZT27Q, seg_pos={0 0}, upload=317485]: Done uploading piece. err: <nil>
Jul  9 22:00:22.586466101 (396h49m57.357107436s) [noise=true , address=45.91.95.5:4006      , piece_id=SEIVP7IDEJW6VPN5A7O2VKNCPNNF7NTGJTMDBI2NBBFN5ORNTKSA, seg_pos={0 0}, upload=317485]: Done uploading piece. err: <nil>
Jul  9 22:00:54.843272588 (396h50m29.613913924s) [noise=true , address=104.36.82.38:4710    , piece_id=F2THYGFPVUQJMDLOBZQHVDSMZJN5CPVEGNMBI5VZ2W4KLYWLOJCQ, seg_pos={0 0}, upload=317485]: Done uploading piece. err: <nil>
Jul  9 22:00:54.843345257 (396h50m29.613986602s) [seg_pos={0 0}, upload=317485]: Segment reached optimal threshold of 14 pieces.
Jul  9 22:00:54.843532926 (396h50m29.614174261s) [noise=true , address=45.91.95.2:4035      , piece_id=IJZZVC5X6CLDTMMQBJEYG4KFFSWWESCEDC36NRLHDHTDT5XU6ZCA, seg_pos={0 0}, upload=317485]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121Xa3rvgKQhHc5NBufs57Ybnw3fYKUjgRyK32TTwWoi4E8m57o): protocol: write tcp 188.166.225.170:36034->45.91.95.2:4035: use of closed network connection; write tcp 188.166.225.170:36034->45.91.95.2:4035: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36034->45.91.95.2:4035: use of closed network connection
Jul  9 22:00:54.843550400 (396h50m29.614191725s) [noise=true , address=104.36.82.18:4396    , piece_id=NOF4ILCK6CSTCVRNN3EYNWFNVYX2KU5ESFCADU6P3GSXV7ZPPXCQ, seg_pos={0 0}, upload=317485]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1k5gzJBGWhpARcfiynburgfTqJ2t7sVNs1mAkUfToMG5saxPqx): protocol: expected piece hash; context canceled; EOF
Jul  9 22:00:54.843569696 (396h50m29.614211051s) [noise=true , address=45.91.95.3:4022      , piece_id=RGE5B3IDAZAAQ5BJ3INCJBJVVL2NJN737ADZZNAU5A3BKME7RWHQ, seg_pos={0 0}, upload=317485]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16NrDYdTZZYsjkpZhTHuv8ug9bnioi4sg5KNsfM3ocrre8kA1B): protocol: write tcp 188.166.225.170:51474->45.91.95.3:4022: use of closed network connection; write tcp 188.166.225.170:51474->45.91.95.3:4022: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51474->45.91.95.3:4022: use of closed network connection
Jul  9 22:00:54.843584315 (396h50m29.61422565s) [seg_pos={0 0}, upload=317485]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul  9 22:00:54.843661002 (396h50m29.614302337s) [upload=317485]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  9 22:00:54.843684806 (396h50m29.614326141s) [upload=317485]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  9 22:00:55.149989764 (396h50m29.920631099s) [upload=317485]: Done uploading segments...
Jul  9 22:00:55.150006736 (396h50m29.920648072s) [upload=317485]: Upload finished. err: <nil>
Duration: 28.466170486s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
7 out of 60 is failed (threshold=3) [X.........X...............X..X....X........X.........X......]
duration: 
26.475677545s
FAIL (2025-07-09 22:01:06 UTC) 
orbiter warning: context deadline exceeded
Duration: 26.475699056s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip: 
9 out of 60 is failed (threshold=3) [....X....X...............X..X.X...X...X.......X............X]
duration: 
1m0.002123126s
FAIL (2025-07-09 22:00:56 UTC) 
orbiter warning: 
======ERROR======
uplink: context deadline exceeded
======LOGS======
sh batch item: *pb.BatchRequestItem_SegmentBegin
Jul  9 21:59:57.365491004 (396h49m32.136132339s) [seg_pos={0 0}, upload=317485]: Begin upload segment...
Jul  9 21:59:57.365538214 (396h49m32.136179549s) [seg_pos={0 0}, upload=317485]: Done begin upload segment.
Jul  9 21:59:57.365554856 (396h49m32.136196191s) [noise=true , address=45.91.95.4:4001      , piece_id=CQ6ELD424VMDVRVC6J3CVSGWCGZD3WPYTKVLANXASZ25OYBD2PDQ, seg_pos={0 0}, upload=317485]: Uploading piece...
Jul  9 21:59:57.365563883 (396h49m32.136205218s) [noise=true , address=77.90.31.21:4887     , piece_id=EOI5DVL4X2GBSUKXSYUECS3QNFDA2NMLWLHLSTGOBCVHJIPIALDQ, seg_pos={0 0}, upload=317485]: Uploading piece...
Jul  9 21:59:57.365620953 (396h49m32.136262288s) [noise=true , address=104.36.82.38:4710    , piece_id=F2THYGFPVUQJMDLOBZQHVDSMZJN5CPVEGNMBI5VZ2W4KLYWLOJCQ, seg_pos={0 0}, upload=317485]: Uploading piece...
Jul  9 21:59:57.365982464 (396h49m32.136623799s) [noise=true , address=77.90.31.14:4677     , piece_id=B34QFJFGT6P3F3FLTCUCGRNN77QYK3CDZ63MG6NL2NTSVGFM4ZXA, seg_pos={0 0}, upload=317485]: Uploading piece...
Jul  9 21:59:57.366266678 (396h49m32.136908013s) [noise=true , address=104.36.82.40:4969    , piece_id=E4TFISU72AEYCLQOW44S3VAX6PNYNI6UFNVVEB2IZ2NNCDBZT27Q, seg_pos={0 0}, upload=317485]: Uploading piece...
Jul  9 21:59:57.366371769 (396h49m32.137013104s) [noise=true , address=45.91.95.2:4035      , piece_id=IJZZVC5X6CLDTMMQBJEYG4KFFSWWESCEDC36NRLHDHTDT5XU6ZCA, seg_pos={0 0}, upload=317485]: Uploading piece...
Jul  9 21:59:57.366643349 (396h49m32.137284674s) [noise=true , address=77.90.31.19:4858     , piece_id=DW2QOKG3LEGUDVMSPMN2DXLYZGUAFU2JRH5R7MLWL4OSLHKBAMXA, seg_pos={0 0}, upload=317485]: Uploading piece...
Jul  9 21:59:57.366911571 (396h49m32.137552906s) [noise=true , address=79.127.220.97:4368   , piece_id=5BXO5TDDG72YTM6S3SHXF5MIBYZ6MRMOXFS337NVEKKAGUYVLE6A, seg_pos={0 0}, upload=317485]: Uploading piece...
Jul  9 21:59:57.367116163 (396h49m32.137757488s) [noise=true , address=77.90.31.14:4682     , piece_id=7BZTN2CTBAAIRSAX4WGZ3YHJ75NCVS4HZXAGEGTSRGJQQJDJ26TA, seg_pos={0 0}, upload=317485]: Uploading piece...
Jul  9 21:59:57.367329601 (396h49m32.137970926s) [noise=true , address=104.36.82.18:4396    , piece_id=NOF4ILCK6CSTCVRNN3EYNWFNVYX2KU5ESFCADU6P3GSXV7ZPPXCQ, seg_pos={0 0}, upload=317485]: Uploading piece...
Jul  9 21:59:57.367566244 (396h49m32.138207579s) [noise=true , address=77.90.31.10:4544     , piece_id=TRYZDQ4XRBKX5TTJTFHASIXVMWUSXFD7ASZ3CSBIUQIEICF6WMWQ, seg_pos={0 0}, upload=317485]: Uploading piece...
Jul  9 21:59:57.367639785 (396h49m32.13828112s) [noise=true , address=77.90.31.16:4736     , piece_id=LR6X3G74LHHQJCARXWM2DQUME57BBDDHU377PLNXXVE43R3RLUUQ, seg_pos={0 0}, upload=317485]: Uploading piece...
Jul  9 21:59:57.367886267 (396h49m32.138527602s) [noise=true , address=104.36.82.36:4651    , piece_id=ULRXB4QI3YQM66SYSI7VJ2ZZJX5R5UK7LPUVDQCZK6YKL32QI57A, seg_pos={0 0}, upload=317485]: Uploading piece...
Jul  9 21:59:57.368109754 (396h49m32.138751089s) [noise=true , address=79.127.220.101:4041  , piece_id=PTCRPQZPNCCFH4XSMVGMPFZQAWUZBJG7JIYPFQUAVE6F52D6RPEA, seg_pos={0 0}, upload=317485]: Uploading piece...
Jul  9 21:59:57.368339253 (396h49m32.138980588s) [noise=true , address=77.90.31.13:4652     , piece_id=EEUPGMZ5MMQOXKJJ74QQ4B5ILZUZV2TADEK2PPWIVCIP7L35YH4A, seg_pos={0 0}, upload=317485]: Uploading piece...
Jul  9 21:59:57.368472368 (396h49m32.139113703s) [noise=true , address=45.91.95.3:4022      , piece_id=RGE5B3IDAZAAQ5BJ3INCJBJVVL2NJN737ADZZNAU5A3BKME7RWHQ, seg_pos={0 0}, upload=317485]: Uploading piece...
Jul  9 21:59:57.368690305 (396h49m32.13933164s) [noise=true , address=79.127.219.38:4023   , piece_id=5JZEDEGXA6RHRL7OOMGZU6ICTOXDD6NF2XVRZK6XWQ7VKK6LWYOA, seg_pos={0 0}, upload=317485]: Uploading piece...
Jul  9 21:59:57.368909765 (396h49m32.1395511s) [noise=true , address=45.91.95.5:4006      , piece_id=SEIVP7IDEJW6VPN5A7O2VKNCPNNF7NTGJTMDBI2NBBFN5ORNTKSA, seg_pos={0 0}, upload=317485]: Uploading piece...
Jul  9 21:59:58.313353166 (396h49m33.083994491s) [noise=true , address=45.91.95.4:4001      , piece_id=CQ6ELD424VMDVRVC6J3CVSGWCGZD3WPYTKVLANXASZ25OYBD2PDQ, seg_pos={0 0}, upload=317485]: Done uploading piece. err: ecclient: upload failed (node:12PdimTdB4ysD3SQ8hKMAGAXkzzC71irLv6rW9FArf5qmrvZ5MY, address:45.91.95.4:4001): protocol: storage node overloaded, request limit: 2000
Jul  9 21:59:58.756065621 (396h49m33.526706956s) [upload=317485]: Next returned nil segment
Jul  9 21:59:58.756084979 (396h49m33.526726314s) [upload=317485]: Waiting for error group managing segments...
Jul  9 21:59:59.268055194 (396h49m34.038696529s) [noise=true , address=79.127.220.101:4041  , piece_id=PTCRPQZPNCCFH4XSMVGMPFZQAWUZBJG7JIYPFQUAVE6F52D6RPEA, seg_pos={0 0}, upload=317485]: Done uploading piece. err: <nil>
Jul  9 21:59:59.345248446 (396h49m34.115889781s) [noise=true , address=79.127.220.97:4368   , piece_id=5BXO5TDDG72YTM6S3SHXF5MIBYZ6MRMOXFS337NVEKKAGUYVLE6A, seg_pos={0 0}, upload=317485]: Done uploading piece. err: <nil>
Jul  9 21:59:59.371176971 (396h49m34.141818306s) [noise=true , address=77.90.31.19:4858     , piece_id=DW2QOKG3LEGUDVMSPMN2DXLYZGUAFU2JRH5R7MLWL4OSLHKBAMXA, seg_pos={0 0}, upload=317485]: Done uploading piece. err: <nil>
Jul  9 21:59:59.373114388 (396h49m34.143755723s) [noise=true , address=77.90.31.14:4677     , piece_id=B34QFJFGT6P3F3FLTCUCGRNN77QYK3CDZ63MG6NL2NTSVGFM4ZXA, seg_pos={0 0}, upload=317485]: Done uploading piece. err: <nil>
Jul  9 21:59:59.373343305 (396h49m34.14398464s) [noise=true , address=77.90.31.16:4736     , piece_id=LR6X3G74LHHQJCARXWM2DQUME57BBDDHU377PLNXXVE43R3RLUUQ, seg_pos={0 0}, upload=317485]: Done uploading piece. err: <nil>
Jul  9 21:59:59.373440552 (396h49m34.144081887s) [noise=true , address=77.90.31.14:4682     , piece_id=7BZTN2CTBAAIRSAX4WGZ3YHJ75NCVS4HZXAGEGTSRGJQQJDJ26TA, seg_pos={0 0}, upload=317485]: Done uploading piece. err: <nil>
Jul  9 21:59:59.389060125 (396h49m34.15970146s) [noise=true , address=77.90.31.13:4652     , piece_id=EEUPGMZ5MMQOXKJJ74QQ4B5ILZUZV2TADEK2PPWIVCIP7L35YH4A, seg_pos={0 0}, upload=317485]: Done uploading piece. err: <nil>
Jul  9 21:59:59.391450517 (396h49m34.162091852s) [noise=true , address=77.90.31.10:4544     , piece_id=TRYZDQ4XRBKX5TTJTFHASIXVMWUSXFD7ASZ3CSBIUQIEICF6WMWQ, seg_pos={0 0}, upload=317485]: Done uploading piece. err: <nil>
Jul  9 21:59:59.397080999 (396h49m34.167722364s) [noise=true , address=77.90.31.21:4887     , piece_id=EOI5DVL4X2GBSUKXSYUECS3QNFDA2NMLWLHLSTGOBCVHJIPIALDQ, seg_pos={0 0}, upload=317485]: Done uploading piece. err: <nil>
Jul  9 22:00:05.441156519 (396h49m40.211797864s) [noise=true , address=79.127.219.38:4023   , piece_id=5JZEDEGXA6RHRL7OOMGZU6ICTOXDD6NF2XVRZK6XWQ7VKK6LWYOA, seg_pos={0 0}, upload=317485]: Done uploading piece. err: <nil>
Jul  9 22:00:19.865539301 (396h49m54.636180637s) [noise=true , address=104.36.82.36:4651    , piece_id=ULRXB4QI3YQM66SYSI7VJ2ZZJX5R5UK7LPUVDQCZK6YKL32QI57A, seg_pos={0 0}, upload=317485]: Done uploading piece. err: <nil>
Jul  9 22:00:20.403167714 (396h49m55.173809049s) [noise=true , address=104.36.82.40:4969    , piece_id=E4TFISU72AEYCLQOW44S3VAX6PNYNI6UFNVVEB2IZ2NNCDBZT27Q, seg_pos={0 0}, upload=317485]: Done uploading piece. err: <nil>
Jul  9 22:00:22.586466101 (396h49m57.357107436s) [noise=true , address=45.91.95.5:4006      , piece_id=SEIVP7IDEJW6VPN5A7O2VKNCPNNF7NTGJTMDBI2NBBFN5ORNTKSA, seg_pos={0 0}, upload=317485]: Done uploading piece. err: <nil>
Jul  9 22:00:54.843272588 (396h50m29.613913924s) [noise=true , address=104.36.82.38:4710    , piece_id=F2THYGFPVUQJMDLOBZQHVDSMZJN5CPVEGNMBI5VZ2W4KLYWLOJCQ, seg_pos={0 0}, upload=317485]: Done uploading piece. err: <nil>
Jul  9 22:00:54.843345257 (396h50m29.613986602s) [seg_pos={0 0}, upload=317485]: Segment reached optimal threshold of 14 pieces.
Jul  9 22:00:54.843532926 (396h50m29.614174261s) [noise=true , address=45.91.95.2:4035      , piece_id=IJZZVC5X6CLDTMMQBJEYG4KFFSWWESCEDC36NRLHDHTDT5XU6ZCA, seg_pos={0 0}, upload=317485]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121Xa3rvgKQhHc5NBufs57Ybnw3fYKUjgRyK32TTwWoi4E8m57o): protocol: write tcp 188.166.225.170:36034->45.91.95.2:4035: use of closed network connection; write tcp 188.166.225.170:36034->45.91.95.2:4035: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36034->45.91.95.2:4035: use of closed network connection
Jul  9 22:00:54.843550400 (396h50m29.614191725s) [noise=true , address=104.36.82.18:4396    , piece_id=NOF4ILCK6CSTCVRNN3EYNWFNVYX2KU5ESFCADU6P3GSXV7ZPPXCQ, seg_pos={0 0}, upload=317485]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1k5gzJBGWhpARcfiynburgfTqJ2t7sVNs1mAkUfToMG5saxPqx): protocol: expected piece hash; context canceled; EOF
Jul  9 22:00:54.843569696 (396h50m29.614211051s) [noise=true , address=45.91.95.3:4022      , piece_id=RGE5B3IDAZAAQ5BJ3INCJBJVVL2NJN737ADZZNAU5A3BKME7RWHQ, seg_pos={0 0}, upload=317485]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16NrDYdTZZYsjkpZhTHuv8ug9bnioi4sg5KNsfM3ocrre8kA1B): protocol: write tcp 188.166.225.170:51474->45.91.95.3:4022: use of closed network connection; write tcp 188.166.225.170:51474->45.91.95.3:4022: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51474->45.91.95.3:4022: use of closed network connection
Jul  9 22:00:54.843584315 (396h50m29.61422565s) [seg_pos={0 0}, upload=317485]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul  9 22:00:54.843661002 (396h50m29.614302337s) [upload=317485]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  9 22:00:54.843684806 (396h50m29.614326141s) [upload=317485]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  9 22:00:55.149989764 (396h50m29.920631099s) [upload=317485]: Done uploading segments...
Jul  9 22:00:55.150006736 (396h50m29.920648072s) [upload=317485]: Upload finished. err: <nil>
Duration: 1m0.002142474s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
7 out of 60 is failed (threshold=3) [.X.........X...............X..X....X........X.........X.....]
duration: 
40.04031995s
FAIL (2025-07-09 22:00:36 UTC) 
orbiter warning: context deadline exceeded
Duration: 40.040339416s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
7 out of 60 is failed (threshold=3) [..X.........X...............X..X....X........X.........X....]
duration: 
28.399532303s
FAIL (2025-07-09 21:59:38 UTC) 
orbiter warning: context deadline exceeded
Duration: 28.399555397s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip: 
8 out of 60 is failed (threshold=3) [.....X....X...............X..X.X...X...X.......X............]
duration: 
21.079567835s
FAIL (2025-07-09 21:59:34 UTC) 
orbiter warning: 
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 12)
======LOGS======
SegmentBegin
Jul  9 21:49:40.272144307 (396h39m15.042785642s) [seg_pos={0 0}, upload=317350]: Begin upload segment...
Jul  9 21:49:40.272207637 (396h39m15.042848972s) [seg_pos={0 0}, upload=317350]: Done begin upload segment.
Jul  9 21:49:40.272228447 (396h39m15.042869772s) [noise=true , address=45.91.116.8:4072     , piece_id=2THWBWLISKLKJFVUAESYPDVBGOSZ2M6AVHMUN2C22S46FYBNE5RA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.272260418 (396h39m15.042901743s) [noise=true , address=104.36.82.20:4451    , piece_id=CVO53ZISRV2ON542CVCHUAUDVZQI2L5KGCRCMZLP4POOBKLZNVFA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.272657718 (396h39m15.043299043s) [noise=true , address=104.36.82.34:4564    , piece_id=CXLC3UUVVIGKA2OP2BQXE7XH7HNHXOJ3O6BQVUNS5NVY4KRPUWIA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.272906815 (396h39m15.04354815s) [noise=true , address=104.36.82.45:4905    , piece_id=YQWZK3R425VYYPSXLTBCNZQUN2IPWYZTNU7NNR5EW5ONIOH7BG3A, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273256314 (396h39m15.043897649s) [noise=true , address=45.91.95.3:4021      , piece_id=W7TAKLK7PEUHTITB74T7HJGOU6WTBPRTFHPQF6VTVM4OTPNYTRWA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273291210 (396h39m15.043932535s) [noise=true , address=45.91.95.2:4017      , piece_id=W52X6YGCDZBSRQEB63HLCQV6CN5JL6JYC2SML5QIRBO5W7CIKDRQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273553742 (396h39m15.044195077s) [noise=true , address=79.127.219.38:4022   , piece_id=72QFHVOHWUNOSLO65KGIXMA7BYR4DTRPVLVAD4EHHZKXX3GAQMFQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273793651 (396h39m15.044434986s) [noise=true , address=104.36.82.44:4885    , piece_id=OZVJDJJLCK46MBKO6TGGHQFSW2QUDQ6GDUHTBZLI7Y5LWBXVPJCQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273834831 (396h39m15.044476156s) [noise=true , address=77.90.31.11:4573     , piece_id=G76LQFRBIKPUKF7CI7DXGL6JRYJOOZJ6SLPAM4Z64CXYJVPW42DA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273869627 (396h39m15.044510962s) [noise=true , address=77.90.31.18:4827     , piece_id=MQJMN3CW2AEP5T74I7WUUBIHFZOLMMKCIN7IOBWZT2VYQARYLIIQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274155423 (396h39m15.044796758s) [noise=true , address=77.90.31.19:4876     , piece_id=ROM6VJDIDOEUEGP3PMEHKEDM5POGHMFNKPYRC3LCIAWIVRUGVBUQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274314117 (396h39m15.044955452s) [noise=true , address=79.127.220.97:4371   , piece_id=XNPEHYQWPTFHLU5TJEO7HZC3MLOLE26GQWI4PI2CUCIL6QTAO7TQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274414660 (396h39m15.045055995s) [noise=true , address=45.91.95.5:4006      , piece_id=JGKTT6OVQ7T2C22UOWG5HPQ67DBF3NPA3OAMALDLQGATY5LT63PA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274653466 (396h39m15.045294791s) [noise=true , address=77.90.31.10:4528     , piece_id=XA7ZR76AK6TYNZDCMKPWNMZELNRGXFUU53L34IFMDWRB4LN3W4RA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274681149 (396h39m15.045322484s) [noise=true , address=45.91.95.4:4021      , piece_id=PFQ3VSEQPTNB4DERVNGT4BCSMZGY3C3OWWJJHVLQTTOCB6TWCMIA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274898425 (396h39m15.04553976s) [noise=true , address=77.90.31.21:4903     , piece_id=LYVWE3A5IAAEZNHB6DZ63XGBH2UQRJRYMJDMRBOJ2BIN3WESS6RQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.275008706 (396h39m15.045650041s) [noise=true , address=77.90.31.13:4652     , piece_id=IVLFU33BFOUXWJEYUUS2AEOZLAVTOKDMEK7RDPEBPOWF34SWNR6Q, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.275332215 (396h39m15.04597355s) [noise=true , address=45.91.116.7:4041     , piece_id=5JXKDZGV2EPLVSDUVP5LDFOGQ66FXPR2GXYEBFF5KWQXUPJNKPMA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:41.657764345 (396h39m16.42840568s) [upload=317350]: Next returned nil segment
Jul  9 21:49:41.657771018 (396h39m16.428412353s) [upload=317350]: Waiting for error group managing segments...
Jul  9 21:49:41.690644980 (396h39m16.461286315s) [noise=true , address=104.36.82.45:4905    , piece_id=YQWZK3R425VYYPSXLTBCNZQUN2IPWYZTNU7NNR5EW5ONIOH7BG3A, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:12ffKESNSVpXQzbwJinP6vvgE6zoF3RFz2NRUuuJHvd7bvk1gc9, address:104.36.82.45:4905): protocol: untrusted: invalid order limit signature: rpcpeer: drpc transport does not have required methods
Jul  9 21:49:42.092098451 (396h39m16.862739786s) [noise=true , address=79.127.220.97:4371   , piece_id=XNPEHYQWPTFHLU5TJEO7HZC3MLOLE26GQWI4PI2CUCIL6QTAO7TQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.266002837 (396h39m17.036644172s) [noise=true , address=77.90.31.19:4876     , piece_id=ROM6VJDIDOEUEGP3PMEHKEDM5POGHMFNKPYRC3LCIAWIVRUGVBUQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.269167210 (396h39m17.039808535s) [noise=true , address=77.90.31.13:4652     , piece_id=IVLFU33BFOUXWJEYUUS2AEOZLAVTOKDMEK7RDPEBPOWF34SWNR6Q, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.278551023 (396h39m17.049192358s) [noise=true , address=77.90.31.10:4528     , piece_id=XA7ZR76AK6TYNZDCMKPWNMZELNRGXFUU53L34IFMDWRB4LN3W4RA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.280070640 (396h39m17.050711975s) [noise=true , address=77.90.31.21:4903     , piece_id=LYVWE3A5IAAEZNHB6DZ63XGBH2UQRJRYMJDMRBOJ2BIN3WESS6RQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.296867786 (396h39m17.067509111s) [noise=true , address=77.90.31.11:4573     , piece_id=G76LQFRBIKPUKF7CI7DXGL6JRYJOOZJ6SLPAM4Z64CXYJVPW42DA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.303116681 (396h39m17.073758016s) [noise=true , address=77.90.31.18:4827     , piece_id=MQJMN3CW2AEP5T74I7WUUBIHFZOLMMKCIN7IOBWZT2VYQARYLIIQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:44.408881294 (396h39m19.179522629s) [noise=true , address=45.91.116.7:4041     , piece_id=5JXKDZGV2EPLVSDUVP5LDFOGQ66FXPR2GXYEBFF5KWQXUPJNKPMA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:44.871597160 (396h39m19.642238495s) [noise=true , address=45.91.95.5:4006      , piece_id=JGKTT6OVQ7T2C22UOWG5HPQ67DBF3NPA3OAMALDLQGATY5LT63PA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:12ViW64JDJxzvRU39MsLp5JZKAmHZmxCAJuLVGi2E1E1r9gfc9A, address:45.91.95.5:4006): protocol: storage node overloaded, request limit: 2000
Jul  9 21:49:51.702994736 (396h39m26.473636071s) [noise=true , address=45.91.116.8:4072     , piece_id=2THWBWLISKLKJFVUAESYPDVBGOSZ2M6AVHMUN2C22S46FYBNE5RA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:55.468073925 (396h39m30.23871526s) [noise=true , address=79.127.219.38:4022   , piece_id=72QFHVOHWUNOSLO65KGIXMA7BYR4DTRPVLVAD4EHHZKXX3GAQMFQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:50:22.315419748 (396h39m57.086061083s) [noise=true , address=104.36.82.34:4564    , piece_id=CXLC3UUVVIGKA2OP2BQXE7XH7HNHXOJ3O6BQVUNS5NVY4KRPUWIA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:50:32.620803316 (396h40m7.391444651s) [noise=true , address=104.36.82.20:4451    , piece_id=CVO53ZISRV2ON542CVCHUAUDVZQI2L5KGCRCMZLP4POOBKLZNVFA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:50:39.176702995 (396h40m13.94734433s) [noise=true , address=45.91.95.4:4021      , piece_id=PFQ3VSEQPTNB4DERVNGT4BCSMZGY3C3OWWJJHVLQTTOCB6TWCMIA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:1dXfFE3nY9ZSEixFePGxdptsrybf38kYjYgV61MzV8kHtc12w, address:45.91.95.4:4021): protocol: expected piece hash; context deadline exceeded; EOF
Jul  9 21:50:39.176724405 (396h40m13.94736573s) [noise=true , address=104.36.82.44:4885    , piece_id=OZVJDJJLCK46MBKO6TGGHQFSW2QUDQ6GDUHTBZLI7Y5LWBXVPJCQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:118qGQLFSNbsYsvFrKjTXXWbFYu2sRaRHrUNkKNCrNVpzVQRtG, address:104.36.82.44:4885): protocol: expected piece hash; context deadline exceeded; EOF
Jul  9 21:50:39.176800822 (396h40m13.947442157s) [noise=true , address=45.91.95.3:4021      , piece_id=W7TAKLK7PEUHTITB74T7HJGOU6WTBPRTFHPQF6VTVM4OTPNYTRWA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:131LBDdhw5s1dsLF2CnAPWaL3Amwm4kvfjyqfTvjkrHSQUjJ2q, address:45.91.95.3:4021): protocol: write tcp 188.166.225.170:52410->45.91.95.3:4021: use of closed network connection; write tcp 188.166.225.170:52410->45.91.95.3:4021: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52410->45.91.95.3:4021: use of closed network connection
Jul  9 21:50:39.176914419 (396h40m13.947555744s) [noise=true , address=45.91.95.2:4017      , piece_id=W52X6YGCDZBSRQEB63HLCQV6CN5JL6JYC2SML5QIRBO5W7CIKDRQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:1vtusfmiftx4cbYbLEzPEpgvmaGQAD9wsJGBCk8r4f1MkY1RL6, address:45.91.95.2:4017): protocol: write tcp 188.166.225.170:33416->45.91.95.2:4017: use of closed network connection; write tcp 188.166.225.170:33416->45.91.95.2:4017: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33416->45.91.95.2:4017: use of closed network connection
Jul  9 21:50:39.176950669 (396h40m13.947591994s) [seg_pos={0 0}, upload=317350]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil>
Jul  9 21:50:39.412544674 (396h40m14.183186009s) [upload=317350]: Done uploading segments...
Jul  9 21:50:39.412568239 (396h40m14.183209574s) [upload=317350]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12)
Duration: 21.07959088s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
8 out of 60 is failed (threshold=3) [X..X.........X...............X..X....X........X.........X...]
duration: 
29.674673542s
FAIL (2025-07-09 21:58:49 UTC) 
orbiter warning: context deadline exceeded
Duration: 29.674685485s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip: 
8 out of 60 is failed (threshold=3) [......X....X...............X..X.X...X...X.......X...........]
duration: 
29.033953878s
FAIL (2025-07-09 21:58:35 UTC) 
orbiter warning: 
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 12)
======LOGS======
SegmentBegin
Jul  9 21:49:40.272144307 (396h39m15.042785642s) [seg_pos={0 0}, upload=317350]: Begin upload segment...
Jul  9 21:49:40.272207637 (396h39m15.042848972s) [seg_pos={0 0}, upload=317350]: Done begin upload segment.
Jul  9 21:49:40.272228447 (396h39m15.042869772s) [noise=true , address=45.91.116.8:4072     , piece_id=2THWBWLISKLKJFVUAESYPDVBGOSZ2M6AVHMUN2C22S46FYBNE5RA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.272260418 (396h39m15.042901743s) [noise=true , address=104.36.82.20:4451    , piece_id=CVO53ZISRV2ON542CVCHUAUDVZQI2L5KGCRCMZLP4POOBKLZNVFA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.272657718 (396h39m15.043299043s) [noise=true , address=104.36.82.34:4564    , piece_id=CXLC3UUVVIGKA2OP2BQXE7XH7HNHXOJ3O6BQVUNS5NVY4KRPUWIA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.272906815 (396h39m15.04354815s) [noise=true , address=104.36.82.45:4905    , piece_id=YQWZK3R425VYYPSXLTBCNZQUN2IPWYZTNU7NNR5EW5ONIOH7BG3A, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273256314 (396h39m15.043897649s) [noise=true , address=45.91.95.3:4021      , piece_id=W7TAKLK7PEUHTITB74T7HJGOU6WTBPRTFHPQF6VTVM4OTPNYTRWA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273291210 (396h39m15.043932535s) [noise=true , address=45.91.95.2:4017      , piece_id=W52X6YGCDZBSRQEB63HLCQV6CN5JL6JYC2SML5QIRBO5W7CIKDRQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273553742 (396h39m15.044195077s) [noise=true , address=79.127.219.38:4022   , piece_id=72QFHVOHWUNOSLO65KGIXMA7BYR4DTRPVLVAD4EHHZKXX3GAQMFQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273793651 (396h39m15.044434986s) [noise=true , address=104.36.82.44:4885    , piece_id=OZVJDJJLCK46MBKO6TGGHQFSW2QUDQ6GDUHTBZLI7Y5LWBXVPJCQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273834831 (396h39m15.044476156s) [noise=true , address=77.90.31.11:4573     , piece_id=G76LQFRBIKPUKF7CI7DXGL6JRYJOOZJ6SLPAM4Z64CXYJVPW42DA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273869627 (396h39m15.044510962s) [noise=true , address=77.90.31.18:4827     , piece_id=MQJMN3CW2AEP5T74I7WUUBIHFZOLMMKCIN7IOBWZT2VYQARYLIIQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274155423 (396h39m15.044796758s) [noise=true , address=77.90.31.19:4876     , piece_id=ROM6VJDIDOEUEGP3PMEHKEDM5POGHMFNKPYRC3LCIAWIVRUGVBUQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274314117 (396h39m15.044955452s) [noise=true , address=79.127.220.97:4371   , piece_id=XNPEHYQWPTFHLU5TJEO7HZC3MLOLE26GQWI4PI2CUCIL6QTAO7TQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274414660 (396h39m15.045055995s) [noise=true , address=45.91.95.5:4006      , piece_id=JGKTT6OVQ7T2C22UOWG5HPQ67DBF3NPA3OAMALDLQGATY5LT63PA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274653466 (396h39m15.045294791s) [noise=true , address=77.90.31.10:4528     , piece_id=XA7ZR76AK6TYNZDCMKPWNMZELNRGXFUU53L34IFMDWRB4LN3W4RA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274681149 (396h39m15.045322484s) [noise=true , address=45.91.95.4:4021      , piece_id=PFQ3VSEQPTNB4DERVNGT4BCSMZGY3C3OWWJJHVLQTTOCB6TWCMIA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274898425 (396h39m15.04553976s) [noise=true , address=77.90.31.21:4903     , piece_id=LYVWE3A5IAAEZNHB6DZ63XGBH2UQRJRYMJDMRBOJ2BIN3WESS6RQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.275008706 (396h39m15.045650041s) [noise=true , address=77.90.31.13:4652     , piece_id=IVLFU33BFOUXWJEYUUS2AEOZLAVTOKDMEK7RDPEBPOWF34SWNR6Q, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.275332215 (396h39m15.04597355s) [noise=true , address=45.91.116.7:4041     , piece_id=5JXKDZGV2EPLVSDUVP5LDFOGQ66FXPR2GXYEBFF5KWQXUPJNKPMA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:41.657764345 (396h39m16.42840568s) [upload=317350]: Next returned nil segment
Jul  9 21:49:41.657771018 (396h39m16.428412353s) [upload=317350]: Waiting for error group managing segments...
Jul  9 21:49:41.690644980 (396h39m16.461286315s) [noise=true , address=104.36.82.45:4905    , piece_id=YQWZK3R425VYYPSXLTBCNZQUN2IPWYZTNU7NNR5EW5ONIOH7BG3A, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:12ffKESNSVpXQzbwJinP6vvgE6zoF3RFz2NRUuuJHvd7bvk1gc9, address:104.36.82.45:4905): protocol: untrusted: invalid order limit signature: rpcpeer: drpc transport does not have required methods
Jul  9 21:49:42.092098451 (396h39m16.862739786s) [noise=true , address=79.127.220.97:4371   , piece_id=XNPEHYQWPTFHLU5TJEO7HZC3MLOLE26GQWI4PI2CUCIL6QTAO7TQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.266002837 (396h39m17.036644172s) [noise=true , address=77.90.31.19:4876     , piece_id=ROM6VJDIDOEUEGP3PMEHKEDM5POGHMFNKPYRC3LCIAWIVRUGVBUQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.269167210 (396h39m17.039808535s) [noise=true , address=77.90.31.13:4652     , piece_id=IVLFU33BFOUXWJEYUUS2AEOZLAVTOKDMEK7RDPEBPOWF34SWNR6Q, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.278551023 (396h39m17.049192358s) [noise=true , address=77.90.31.10:4528     , piece_id=XA7ZR76AK6TYNZDCMKPWNMZELNRGXFUU53L34IFMDWRB4LN3W4RA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.280070640 (396h39m17.050711975s) [noise=true , address=77.90.31.21:4903     , piece_id=LYVWE3A5IAAEZNHB6DZ63XGBH2UQRJRYMJDMRBOJ2BIN3WESS6RQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.296867786 (396h39m17.067509111s) [noise=true , address=77.90.31.11:4573     , piece_id=G76LQFRBIKPUKF7CI7DXGL6JRYJOOZJ6SLPAM4Z64CXYJVPW42DA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.303116681 (396h39m17.073758016s) [noise=true , address=77.90.31.18:4827     , piece_id=MQJMN3CW2AEP5T74I7WUUBIHFZOLMMKCIN7IOBWZT2VYQARYLIIQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:44.408881294 (396h39m19.179522629s) [noise=true , address=45.91.116.7:4041     , piece_id=5JXKDZGV2EPLVSDUVP5LDFOGQ66FXPR2GXYEBFF5KWQXUPJNKPMA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:44.871597160 (396h39m19.642238495s) [noise=true , address=45.91.95.5:4006      , piece_id=JGKTT6OVQ7T2C22UOWG5HPQ67DBF3NPA3OAMALDLQGATY5LT63PA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:12ViW64JDJxzvRU39MsLp5JZKAmHZmxCAJuLVGi2E1E1r9gfc9A, address:45.91.95.5:4006): protocol: storage node overloaded, request limit: 2000
Jul  9 21:49:51.702994736 (396h39m26.473636071s) [noise=true , address=45.91.116.8:4072     , piece_id=2THWBWLISKLKJFVUAESYPDVBGOSZ2M6AVHMUN2C22S46FYBNE5RA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:55.468073925 (396h39m30.23871526s) [noise=true , address=79.127.219.38:4022   , piece_id=72QFHVOHWUNOSLO65KGIXMA7BYR4DTRPVLVAD4EHHZKXX3GAQMFQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:50:22.315419748 (396h39m57.086061083s) [noise=true , address=104.36.82.34:4564    , piece_id=CXLC3UUVVIGKA2OP2BQXE7XH7HNHXOJ3O6BQVUNS5NVY4KRPUWIA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:50:32.620803316 (396h40m7.391444651s) [noise=true , address=104.36.82.20:4451    , piece_id=CVO53ZISRV2ON542CVCHUAUDVZQI2L5KGCRCMZLP4POOBKLZNVFA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:50:39.176702995 (396h40m13.94734433s) [noise=true , address=45.91.95.4:4021      , piece_id=PFQ3VSEQPTNB4DERVNGT4BCSMZGY3C3OWWJJHVLQTTOCB6TWCMIA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:1dXfFE3nY9ZSEixFePGxdptsrybf38kYjYgV61MzV8kHtc12w, address:45.91.95.4:4021): protocol: expected piece hash; context deadline exceeded; EOF
Jul  9 21:50:39.176724405 (396h40m13.94736573s) [noise=true , address=104.36.82.44:4885    , piece_id=OZVJDJJLCK46MBKO6TGGHQFSW2QUDQ6GDUHTBZLI7Y5LWBXVPJCQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:118qGQLFSNbsYsvFrKjTXXWbFYu2sRaRHrUNkKNCrNVpzVQRtG, address:104.36.82.44:4885): protocol: expected piece hash; context deadline exceeded; EOF
Jul  9 21:50:39.176800822 (396h40m13.947442157s) [noise=true , address=45.91.95.3:4021      , piece_id=W7TAKLK7PEUHTITB74T7HJGOU6WTBPRTFHPQF6VTVM4OTPNYTRWA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:131LBDdhw5s1dsLF2CnAPWaL3Amwm4kvfjyqfTvjkrHSQUjJ2q, address:45.91.95.3:4021): protocol: write tcp 188.166.225.170:52410->45.91.95.3:4021: use of closed network connection; write tcp 188.166.225.170:52410->45.91.95.3:4021: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52410->45.91.95.3:4021: use of closed network connection
Jul  9 21:50:39.176914419 (396h40m13.947555744s) [noise=true , address=45.91.95.2:4017      , piece_id=W52X6YGCDZBSRQEB63HLCQV6CN5JL6JYC2SML5QIRBO5W7CIKDRQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:1vtusfmiftx4cbYbLEzPEpgvmaGQAD9wsJGBCk8r4f1MkY1RL6, address:45.91.95.2:4017): protocol: write tcp 188.166.225.170:33416->45.91.95.2:4017: use of closed network connection; write tcp 188.166.225.170:33416->45.91.95.2:4017: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33416->45.91.95.2:4017: use of closed network connection
Jul  9 21:50:39.176950669 (396h40m13.947591994s) [seg_pos={0 0}, upload=317350]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil>
Jul  9 21:50:39.412544674 (396h40m14.183186009s) [upload=317350]: Done uploading segments...
Jul  9 21:50:39.412568239 (396h40m14.183209574s) [upload=317350]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12)
Duration: 29.033968697s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
8 out of 60 is failed (threshold=3) [.X..X.........X...............X..X....X........X.........X..]
duration: 
34.655072486s
FAIL (2025-07-09 21:58:19 UTC) 
orbiter warning: context deadline exceeded
Duration: 34.655092394s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip: 
8 out of 60 is failed (threshold=3) [.......X....X...............X..X.X...X...X.......X..........]
duration: 
30.58316184s
FAIL (2025-07-09 21:58:06 UTC) 
orbiter warning: 
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 12)
======LOGS======
SegmentBegin
Jul  9 21:49:40.272144307 (396h39m15.042785642s) [seg_pos={0 0}, upload=317350]: Begin upload segment...
Jul  9 21:49:40.272207637 (396h39m15.042848972s) [seg_pos={0 0}, upload=317350]: Done begin upload segment.
Jul  9 21:49:40.272228447 (396h39m15.042869772s) [noise=true , address=45.91.116.8:4072     , piece_id=2THWBWLISKLKJFVUAESYPDVBGOSZ2M6AVHMUN2C22S46FYBNE5RA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.272260418 (396h39m15.042901743s) [noise=true , address=104.36.82.20:4451    , piece_id=CVO53ZISRV2ON542CVCHUAUDVZQI2L5KGCRCMZLP4POOBKLZNVFA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.272657718 (396h39m15.043299043s) [noise=true , address=104.36.82.34:4564    , piece_id=CXLC3UUVVIGKA2OP2BQXE7XH7HNHXOJ3O6BQVUNS5NVY4KRPUWIA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.272906815 (396h39m15.04354815s) [noise=true , address=104.36.82.45:4905    , piece_id=YQWZK3R425VYYPSXLTBCNZQUN2IPWYZTNU7NNR5EW5ONIOH7BG3A, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273256314 (396h39m15.043897649s) [noise=true , address=45.91.95.3:4021      , piece_id=W7TAKLK7PEUHTITB74T7HJGOU6WTBPRTFHPQF6VTVM4OTPNYTRWA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273291210 (396h39m15.043932535s) [noise=true , address=45.91.95.2:4017      , piece_id=W52X6YGCDZBSRQEB63HLCQV6CN5JL6JYC2SML5QIRBO5W7CIKDRQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273553742 (396h39m15.044195077s) [noise=true , address=79.127.219.38:4022   , piece_id=72QFHVOHWUNOSLO65KGIXMA7BYR4DTRPVLVAD4EHHZKXX3GAQMFQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273793651 (396h39m15.044434986s) [noise=true , address=104.36.82.44:4885    , piece_id=OZVJDJJLCK46MBKO6TGGHQFSW2QUDQ6GDUHTBZLI7Y5LWBXVPJCQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273834831 (396h39m15.044476156s) [noise=true , address=77.90.31.11:4573     , piece_id=G76LQFRBIKPUKF7CI7DXGL6JRYJOOZJ6SLPAM4Z64CXYJVPW42DA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273869627 (396h39m15.044510962s) [noise=true , address=77.90.31.18:4827     , piece_id=MQJMN3CW2AEP5T74I7WUUBIHFZOLMMKCIN7IOBWZT2VYQARYLIIQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274155423 (396h39m15.044796758s) [noise=true , address=77.90.31.19:4876     , piece_id=ROM6VJDIDOEUEGP3PMEHKEDM5POGHMFNKPYRC3LCIAWIVRUGVBUQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274314117 (396h39m15.044955452s) [noise=true , address=79.127.220.97:4371   , piece_id=XNPEHYQWPTFHLU5TJEO7HZC3MLOLE26GQWI4PI2CUCIL6QTAO7TQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274414660 (396h39m15.045055995s) [noise=true , address=45.91.95.5:4006      , piece_id=JGKTT6OVQ7T2C22UOWG5HPQ67DBF3NPA3OAMALDLQGATY5LT63PA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274653466 (396h39m15.045294791s) [noise=true , address=77.90.31.10:4528     , piece_id=XA7ZR76AK6TYNZDCMKPWNMZELNRGXFUU53L34IFMDWRB4LN3W4RA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274681149 (396h39m15.045322484s) [noise=true , address=45.91.95.4:4021      , piece_id=PFQ3VSEQPTNB4DERVNGT4BCSMZGY3C3OWWJJHVLQTTOCB6TWCMIA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274898425 (396h39m15.04553976s) [noise=true , address=77.90.31.21:4903     , piece_id=LYVWE3A5IAAEZNHB6DZ63XGBH2UQRJRYMJDMRBOJ2BIN3WESS6RQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.275008706 (396h39m15.045650041s) [noise=true , address=77.90.31.13:4652     , piece_id=IVLFU33BFOUXWJEYUUS2AEOZLAVTOKDMEK7RDPEBPOWF34SWNR6Q, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.275332215 (396h39m15.04597355s) [noise=true , address=45.91.116.7:4041     , piece_id=5JXKDZGV2EPLVSDUVP5LDFOGQ66FXPR2GXYEBFF5KWQXUPJNKPMA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:41.657764345 (396h39m16.42840568s) [upload=317350]: Next returned nil segment
Jul  9 21:49:41.657771018 (396h39m16.428412353s) [upload=317350]: Waiting for error group managing segments...
Jul  9 21:49:41.690644980 (396h39m16.461286315s) [noise=true , address=104.36.82.45:4905    , piece_id=YQWZK3R425VYYPSXLTBCNZQUN2IPWYZTNU7NNR5EW5ONIOH7BG3A, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:12ffKESNSVpXQzbwJinP6vvgE6zoF3RFz2NRUuuJHvd7bvk1gc9, address:104.36.82.45:4905): protocol: untrusted: invalid order limit signature: rpcpeer: drpc transport does not have required methods
Jul  9 21:49:42.092098451 (396h39m16.862739786s) [noise=true , address=79.127.220.97:4371   , piece_id=XNPEHYQWPTFHLU5TJEO7HZC3MLOLE26GQWI4PI2CUCIL6QTAO7TQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.266002837 (396h39m17.036644172s) [noise=true , address=77.90.31.19:4876     , piece_id=ROM6VJDIDOEUEGP3PMEHKEDM5POGHMFNKPYRC3LCIAWIVRUGVBUQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.269167210 (396h39m17.039808535s) [noise=true , address=77.90.31.13:4652     , piece_id=IVLFU33BFOUXWJEYUUS2AEOZLAVTOKDMEK7RDPEBPOWF34SWNR6Q, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.278551023 (396h39m17.049192358s) [noise=true , address=77.90.31.10:4528     , piece_id=XA7ZR76AK6TYNZDCMKPWNMZELNRGXFUU53L34IFMDWRB4LN3W4RA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.280070640 (396h39m17.050711975s) [noise=true , address=77.90.31.21:4903     , piece_id=LYVWE3A5IAAEZNHB6DZ63XGBH2UQRJRYMJDMRBOJ2BIN3WESS6RQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.296867786 (396h39m17.067509111s) [noise=true , address=77.90.31.11:4573     , piece_id=G76LQFRBIKPUKF7CI7DXGL6JRYJOOZJ6SLPAM4Z64CXYJVPW42DA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.303116681 (396h39m17.073758016s) [noise=true , address=77.90.31.18:4827     , piece_id=MQJMN3CW2AEP5T74I7WUUBIHFZOLMMKCIN7IOBWZT2VYQARYLIIQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:44.408881294 (396h39m19.179522629s) [noise=true , address=45.91.116.7:4041     , piece_id=5JXKDZGV2EPLVSDUVP5LDFOGQ66FXPR2GXYEBFF5KWQXUPJNKPMA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:44.871597160 (396h39m19.642238495s) [noise=true , address=45.91.95.5:4006      , piece_id=JGKTT6OVQ7T2C22UOWG5HPQ67DBF3NPA3OAMALDLQGATY5LT63PA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:12ViW64JDJxzvRU39MsLp5JZKAmHZmxCAJuLVGi2E1E1r9gfc9A, address:45.91.95.5:4006): protocol: storage node overloaded, request limit: 2000
Jul  9 21:49:51.702994736 (396h39m26.473636071s) [noise=true , address=45.91.116.8:4072     , piece_id=2THWBWLISKLKJFVUAESYPDVBGOSZ2M6AVHMUN2C22S46FYBNE5RA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:55.468073925 (396h39m30.23871526s) [noise=true , address=79.127.219.38:4022   , piece_id=72QFHVOHWUNOSLO65KGIXMA7BYR4DTRPVLVAD4EHHZKXX3GAQMFQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:50:22.315419748 (396h39m57.086061083s) [noise=true , address=104.36.82.34:4564    , piece_id=CXLC3UUVVIGKA2OP2BQXE7XH7HNHXOJ3O6BQVUNS5NVY4KRPUWIA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:50:32.620803316 (396h40m7.391444651s) [noise=true , address=104.36.82.20:4451    , piece_id=CVO53ZISRV2ON542CVCHUAUDVZQI2L5KGCRCMZLP4POOBKLZNVFA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:50:39.176702995 (396h40m13.94734433s) [noise=true , address=45.91.95.4:4021      , piece_id=PFQ3VSEQPTNB4DERVNGT4BCSMZGY3C3OWWJJHVLQTTOCB6TWCMIA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:1dXfFE3nY9ZSEixFePGxdptsrybf38kYjYgV61MzV8kHtc12w, address:45.91.95.4:4021): protocol: expected piece hash; context deadline exceeded; EOF
Jul  9 21:50:39.176724405 (396h40m13.94736573s) [noise=true , address=104.36.82.44:4885    , piece_id=OZVJDJJLCK46MBKO6TGGHQFSW2QUDQ6GDUHTBZLI7Y5LWBXVPJCQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:118qGQLFSNbsYsvFrKjTXXWbFYu2sRaRHrUNkKNCrNVpzVQRtG, address:104.36.82.44:4885): protocol: expected piece hash; context deadline exceeded; EOF
Jul  9 21:50:39.176800822 (396h40m13.947442157s) [noise=true , address=45.91.95.3:4021      , piece_id=W7TAKLK7PEUHTITB74T7HJGOU6WTBPRTFHPQF6VTVM4OTPNYTRWA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:131LBDdhw5s1dsLF2CnAPWaL3Amwm4kvfjyqfTvjkrHSQUjJ2q, address:45.91.95.3:4021): protocol: write tcp 188.166.225.170:52410->45.91.95.3:4021: use of closed network connection; write tcp 188.166.225.170:52410->45.91.95.3:4021: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52410->45.91.95.3:4021: use of closed network connection
Jul  9 21:50:39.176914419 (396h40m13.947555744s) [noise=true , address=45.91.95.2:4017      , piece_id=W52X6YGCDZBSRQEB63HLCQV6CN5JL6JYC2SML5QIRBO5W7CIKDRQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:1vtusfmiftx4cbYbLEzPEpgvmaGQAD9wsJGBCk8r4f1MkY1RL6, address:45.91.95.2:4017): protocol: write tcp 188.166.225.170:33416->45.91.95.2:4017: use of closed network connection; write tcp 188.166.225.170:33416->45.91.95.2:4017: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33416->45.91.95.2:4017: use of closed network connection
Jul  9 21:50:39.176950669 (396h40m13.947591994s) [seg_pos={0 0}, upload=317350]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil>
Jul  9 21:50:39.412544674 (396h40m14.183186009s) [upload=317350]: Done uploading segments...
Jul  9 21:50:39.412568239 (396h40m14.183209574s) [upload=317350]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12)
Duration: 30.583194363s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
8 out of 60 is failed (threshold=3) [..X..X.........X...............X..X....X........X.........X.]
duration: 
11.733277232s
FAIL (2025-07-09 21:57:34 UTC) 
orbiter warning: context deadline exceeded
Duration: 11.733290537s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
8 out of 60 is failed (threshold=3) [...X..X.........X...............X..X....X........X.........X]
duration: 
1m0.001257183s
FAIL (2025-07-09 21:57:22 UTC) 
orbiter warning: context deadline exceeded
Duration: 1m0.001280819s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip: 
8 out of 60 is failed (threshold=3) [........X....X...............X..X.X...X...X.......X.........]
duration: 
56.348564762s
FAIL (2025-07-09 21:57:20 UTC) 
orbiter warning: 
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 12)
======LOGS======
SegmentBegin
Jul  9 21:49:40.272144307 (396h39m15.042785642s) [seg_pos={0 0}, upload=317350]: Begin upload segment...
Jul  9 21:49:40.272207637 (396h39m15.042848972s) [seg_pos={0 0}, upload=317350]: Done begin upload segment.
Jul  9 21:49:40.272228447 (396h39m15.042869772s) [noise=true , address=45.91.116.8:4072     , piece_id=2THWBWLISKLKJFVUAESYPDVBGOSZ2M6AVHMUN2C22S46FYBNE5RA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.272260418 (396h39m15.042901743s) [noise=true , address=104.36.82.20:4451    , piece_id=CVO53ZISRV2ON542CVCHUAUDVZQI2L5KGCRCMZLP4POOBKLZNVFA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.272657718 (396h39m15.043299043s) [noise=true , address=104.36.82.34:4564    , piece_id=CXLC3UUVVIGKA2OP2BQXE7XH7HNHXOJ3O6BQVUNS5NVY4KRPUWIA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.272906815 (396h39m15.04354815s) [noise=true , address=104.36.82.45:4905    , piece_id=YQWZK3R425VYYPSXLTBCNZQUN2IPWYZTNU7NNR5EW5ONIOH7BG3A, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273256314 (396h39m15.043897649s) [noise=true , address=45.91.95.3:4021      , piece_id=W7TAKLK7PEUHTITB74T7HJGOU6WTBPRTFHPQF6VTVM4OTPNYTRWA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273291210 (396h39m15.043932535s) [noise=true , address=45.91.95.2:4017      , piece_id=W52X6YGCDZBSRQEB63HLCQV6CN5JL6JYC2SML5QIRBO5W7CIKDRQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273553742 (396h39m15.044195077s) [noise=true , address=79.127.219.38:4022   , piece_id=72QFHVOHWUNOSLO65KGIXMA7BYR4DTRPVLVAD4EHHZKXX3GAQMFQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273793651 (396h39m15.044434986s) [noise=true , address=104.36.82.44:4885    , piece_id=OZVJDJJLCK46MBKO6TGGHQFSW2QUDQ6GDUHTBZLI7Y5LWBXVPJCQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273834831 (396h39m15.044476156s) [noise=true , address=77.90.31.11:4573     , piece_id=G76LQFRBIKPUKF7CI7DXGL6JRYJOOZJ6SLPAM4Z64CXYJVPW42DA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273869627 (396h39m15.044510962s) [noise=true , address=77.90.31.18:4827     , piece_id=MQJMN3CW2AEP5T74I7WUUBIHFZOLMMKCIN7IOBWZT2VYQARYLIIQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274155423 (396h39m15.044796758s) [noise=true , address=77.90.31.19:4876     , piece_id=ROM6VJDIDOEUEGP3PMEHKEDM5POGHMFNKPYRC3LCIAWIVRUGVBUQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274314117 (396h39m15.044955452s) [noise=true , address=79.127.220.97:4371   , piece_id=XNPEHYQWPTFHLU5TJEO7HZC3MLOLE26GQWI4PI2CUCIL6QTAO7TQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274414660 (396h39m15.045055995s) [noise=true , address=45.91.95.5:4006      , piece_id=JGKTT6OVQ7T2C22UOWG5HPQ67DBF3NPA3OAMALDLQGATY5LT63PA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274653466 (396h39m15.045294791s) [noise=true , address=77.90.31.10:4528     , piece_id=XA7ZR76AK6TYNZDCMKPWNMZELNRGXFUU53L34IFMDWRB4LN3W4RA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274681149 (396h39m15.045322484s) [noise=true , address=45.91.95.4:4021      , piece_id=PFQ3VSEQPTNB4DERVNGT4BCSMZGY3C3OWWJJHVLQTTOCB6TWCMIA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274898425 (396h39m15.04553976s) [noise=true , address=77.90.31.21:4903     , piece_id=LYVWE3A5IAAEZNHB6DZ63XGBH2UQRJRYMJDMRBOJ2BIN3WESS6RQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.275008706 (396h39m15.045650041s) [noise=true , address=77.90.31.13:4652     , piece_id=IVLFU33BFOUXWJEYUUS2AEOZLAVTOKDMEK7RDPEBPOWF34SWNR6Q, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.275332215 (396h39m15.04597355s) [noise=true , address=45.91.116.7:4041     , piece_id=5JXKDZGV2EPLVSDUVP5LDFOGQ66FXPR2GXYEBFF5KWQXUPJNKPMA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:41.657764345 (396h39m16.42840568s) [upload=317350]: Next returned nil segment
Jul  9 21:49:41.657771018 (396h39m16.428412353s) [upload=317350]: Waiting for error group managing segments...
Jul  9 21:49:41.690644980 (396h39m16.461286315s) [noise=true , address=104.36.82.45:4905    , piece_id=YQWZK3R425VYYPSXLTBCNZQUN2IPWYZTNU7NNR5EW5ONIOH7BG3A, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:12ffKESNSVpXQzbwJinP6vvgE6zoF3RFz2NRUuuJHvd7bvk1gc9, address:104.36.82.45:4905): protocol: untrusted: invalid order limit signature: rpcpeer: drpc transport does not have required methods
Jul  9 21:49:42.092098451 (396h39m16.862739786s) [noise=true , address=79.127.220.97:4371   , piece_id=XNPEHYQWPTFHLU5TJEO7HZC3MLOLE26GQWI4PI2CUCIL6QTAO7TQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.266002837 (396h39m17.036644172s) [noise=true , address=77.90.31.19:4876     , piece_id=ROM6VJDIDOEUEGP3PMEHKEDM5POGHMFNKPYRC3LCIAWIVRUGVBUQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.269167210 (396h39m17.039808535s) [noise=true , address=77.90.31.13:4652     , piece_id=IVLFU33BFOUXWJEYUUS2AEOZLAVTOKDMEK7RDPEBPOWF34SWNR6Q, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.278551023 (396h39m17.049192358s) [noise=true , address=77.90.31.10:4528     , piece_id=XA7ZR76AK6TYNZDCMKPWNMZELNRGXFUU53L34IFMDWRB4LN3W4RA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.280070640 (396h39m17.050711975s) [noise=true , address=77.90.31.21:4903     , piece_id=LYVWE3A5IAAEZNHB6DZ63XGBH2UQRJRYMJDMRBOJ2BIN3WESS6RQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.296867786 (396h39m17.067509111s) [noise=true , address=77.90.31.11:4573     , piece_id=G76LQFRBIKPUKF7CI7DXGL6JRYJOOZJ6SLPAM4Z64CXYJVPW42DA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.303116681 (396h39m17.073758016s) [noise=true , address=77.90.31.18:4827     , piece_id=MQJMN3CW2AEP5T74I7WUUBIHFZOLMMKCIN7IOBWZT2VYQARYLIIQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:44.408881294 (396h39m19.179522629s) [noise=true , address=45.91.116.7:4041     , piece_id=5JXKDZGV2EPLVSDUVP5LDFOGQ66FXPR2GXYEBFF5KWQXUPJNKPMA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:44.871597160 (396h39m19.642238495s) [noise=true , address=45.91.95.5:4006      , piece_id=JGKTT6OVQ7T2C22UOWG5HPQ67DBF3NPA3OAMALDLQGATY5LT63PA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:12ViW64JDJxzvRU39MsLp5JZKAmHZmxCAJuLVGi2E1E1r9gfc9A, address:45.91.95.5:4006): protocol: storage node overloaded, request limit: 2000
Jul  9 21:49:51.702994736 (396h39m26.473636071s) [noise=true , address=45.91.116.8:4072     , piece_id=2THWBWLISKLKJFVUAESYPDVBGOSZ2M6AVHMUN2C22S46FYBNE5RA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:55.468073925 (396h39m30.23871526s) [noise=true , address=79.127.219.38:4022   , piece_id=72QFHVOHWUNOSLO65KGIXMA7BYR4DTRPVLVAD4EHHZKXX3GAQMFQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:50:22.315419748 (396h39m57.086061083s) [noise=true , address=104.36.82.34:4564    , piece_id=CXLC3UUVVIGKA2OP2BQXE7XH7HNHXOJ3O6BQVUNS5NVY4KRPUWIA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:50:32.620803316 (396h40m7.391444651s) [noise=true , address=104.36.82.20:4451    , piece_id=CVO53ZISRV2ON542CVCHUAUDVZQI2L5KGCRCMZLP4POOBKLZNVFA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:50:39.176702995 (396h40m13.94734433s) [noise=true , address=45.91.95.4:4021      , piece_id=PFQ3VSEQPTNB4DERVNGT4BCSMZGY3C3OWWJJHVLQTTOCB6TWCMIA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:1dXfFE3nY9ZSEixFePGxdptsrybf38kYjYgV61MzV8kHtc12w, address:45.91.95.4:4021): protocol: expected piece hash; context deadline exceeded; EOF
Jul  9 21:50:39.176724405 (396h40m13.94736573s) [noise=true , address=104.36.82.44:4885    , piece_id=OZVJDJJLCK46MBKO6TGGHQFSW2QUDQ6GDUHTBZLI7Y5LWBXVPJCQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:118qGQLFSNbsYsvFrKjTXXWbFYu2sRaRHrUNkKNCrNVpzVQRtG, address:104.36.82.44:4885): protocol: expected piece hash; context deadline exceeded; EOF
Jul  9 21:50:39.176800822 (396h40m13.947442157s) [noise=true , address=45.91.95.3:4021      , piece_id=W7TAKLK7PEUHTITB74T7HJGOU6WTBPRTFHPQF6VTVM4OTPNYTRWA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:131LBDdhw5s1dsLF2CnAPWaL3Amwm4kvfjyqfTvjkrHSQUjJ2q, address:45.91.95.3:4021): protocol: write tcp 188.166.225.170:52410->45.91.95.3:4021: use of closed network connection; write tcp 188.166.225.170:52410->45.91.95.3:4021: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52410->45.91.95.3:4021: use of closed network connection
Jul  9 21:50:39.176914419 (396h40m13.947555744s) [noise=true , address=45.91.95.2:4017      , piece_id=W52X6YGCDZBSRQEB63HLCQV6CN5JL6JYC2SML5QIRBO5W7CIKDRQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:1vtusfmiftx4cbYbLEzPEpgvmaGQAD9wsJGBCk8r4f1MkY1RL6, address:45.91.95.2:4017): protocol: write tcp 188.166.225.170:33416->45.91.95.2:4017: use of closed network connection; write tcp 188.166.225.170:33416->45.91.95.2:4017: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33416->45.91.95.2:4017: use of closed network connection
Jul  9 21:50:39.176950669 (396h40m13.947591994s) [seg_pos={0 0}, upload=317350]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil>
Jul  9 21:50:39.412544674 (396h40m14.183186009s) [upload=317350]: Done uploading segments...
Jul  9 21:50:39.412568239 (396h40m14.183209574s) [upload=317350]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12)
Duration: 56.348588397s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
7 out of 60 is failed (threshold=3) [....X..X.........X...............X..X....X........X.........]
duration: 
35.981217445s
FAIL (2025-07-09 21:56:06 UTC) 
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 35.981235619s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip: 
8 out of 60 is failed (threshold=3) [.........X....X...............X..X.X...X...X.......X........]
duration: 
18.802521784s
FAIL (2025-07-09 21:55:40 UTC) 
orbiter warning: 
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 12)
======LOGS======
SegmentBegin
Jul  9 21:49:40.272144307 (396h39m15.042785642s) [seg_pos={0 0}, upload=317350]: Begin upload segment...
Jul  9 21:49:40.272207637 (396h39m15.042848972s) [seg_pos={0 0}, upload=317350]: Done begin upload segment.
Jul  9 21:49:40.272228447 (396h39m15.042869772s) [noise=true , address=45.91.116.8:4072     , piece_id=2THWBWLISKLKJFVUAESYPDVBGOSZ2M6AVHMUN2C22S46FYBNE5RA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.272260418 (396h39m15.042901743s) [noise=true , address=104.36.82.20:4451    , piece_id=CVO53ZISRV2ON542CVCHUAUDVZQI2L5KGCRCMZLP4POOBKLZNVFA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.272657718 (396h39m15.043299043s) [noise=true , address=104.36.82.34:4564    , piece_id=CXLC3UUVVIGKA2OP2BQXE7XH7HNHXOJ3O6BQVUNS5NVY4KRPUWIA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.272906815 (396h39m15.04354815s) [noise=true , address=104.36.82.45:4905    , piece_id=YQWZK3R425VYYPSXLTBCNZQUN2IPWYZTNU7NNR5EW5ONIOH7BG3A, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273256314 (396h39m15.043897649s) [noise=true , address=45.91.95.3:4021      , piece_id=W7TAKLK7PEUHTITB74T7HJGOU6WTBPRTFHPQF6VTVM4OTPNYTRWA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273291210 (396h39m15.043932535s) [noise=true , address=45.91.95.2:4017      , piece_id=W52X6YGCDZBSRQEB63HLCQV6CN5JL6JYC2SML5QIRBO5W7CIKDRQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273553742 (396h39m15.044195077s) [noise=true , address=79.127.219.38:4022   , piece_id=72QFHVOHWUNOSLO65KGIXMA7BYR4DTRPVLVAD4EHHZKXX3GAQMFQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273793651 (396h39m15.044434986s) [noise=true , address=104.36.82.44:4885    , piece_id=OZVJDJJLCK46MBKO6TGGHQFSW2QUDQ6GDUHTBZLI7Y5LWBXVPJCQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273834831 (396h39m15.044476156s) [noise=true , address=77.90.31.11:4573     , piece_id=G76LQFRBIKPUKF7CI7DXGL6JRYJOOZJ6SLPAM4Z64CXYJVPW42DA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273869627 (396h39m15.044510962s) [noise=true , address=77.90.31.18:4827     , piece_id=MQJMN3CW2AEP5T74I7WUUBIHFZOLMMKCIN7IOBWZT2VYQARYLIIQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274155423 (396h39m15.044796758s) [noise=true , address=77.90.31.19:4876     , piece_id=ROM6VJDIDOEUEGP3PMEHKEDM5POGHMFNKPYRC3LCIAWIVRUGVBUQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274314117 (396h39m15.044955452s) [noise=true , address=79.127.220.97:4371   , piece_id=XNPEHYQWPTFHLU5TJEO7HZC3MLOLE26GQWI4PI2CUCIL6QTAO7TQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274414660 (396h39m15.045055995s) [noise=true , address=45.91.95.5:4006      , piece_id=JGKTT6OVQ7T2C22UOWG5HPQ67DBF3NPA3OAMALDLQGATY5LT63PA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274653466 (396h39m15.045294791s) [noise=true , address=77.90.31.10:4528     , piece_id=XA7ZR76AK6TYNZDCMKPWNMZELNRGXFUU53L34IFMDWRB4LN3W4RA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274681149 (396h39m15.045322484s) [noise=true , address=45.91.95.4:4021      , piece_id=PFQ3VSEQPTNB4DERVNGT4BCSMZGY3C3OWWJJHVLQTTOCB6TWCMIA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274898425 (396h39m15.04553976s) [noise=true , address=77.90.31.21:4903     , piece_id=LYVWE3A5IAAEZNHB6DZ63XGBH2UQRJRYMJDMRBOJ2BIN3WESS6RQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.275008706 (396h39m15.045650041s) [noise=true , address=77.90.31.13:4652     , piece_id=IVLFU33BFOUXWJEYUUS2AEOZLAVTOKDMEK7RDPEBPOWF34SWNR6Q, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.275332215 (396h39m15.04597355s) [noise=true , address=45.91.116.7:4041     , piece_id=5JXKDZGV2EPLVSDUVP5LDFOGQ66FXPR2GXYEBFF5KWQXUPJNKPMA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:41.657764345 (396h39m16.42840568s) [upload=317350]: Next returned nil segment
Jul  9 21:49:41.657771018 (396h39m16.428412353s) [upload=317350]: Waiting for error group managing segments...
Jul  9 21:49:41.690644980 (396h39m16.461286315s) [noise=true , address=104.36.82.45:4905    , piece_id=YQWZK3R425VYYPSXLTBCNZQUN2IPWYZTNU7NNR5EW5ONIOH7BG3A, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:12ffKESNSVpXQzbwJinP6vvgE6zoF3RFz2NRUuuJHvd7bvk1gc9, address:104.36.82.45:4905): protocol: untrusted: invalid order limit signature: rpcpeer: drpc transport does not have required methods
Jul  9 21:49:42.092098451 (396h39m16.862739786s) [noise=true , address=79.127.220.97:4371   , piece_id=XNPEHYQWPTFHLU5TJEO7HZC3MLOLE26GQWI4PI2CUCIL6QTAO7TQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.266002837 (396h39m17.036644172s) [noise=true , address=77.90.31.19:4876     , piece_id=ROM6VJDIDOEUEGP3PMEHKEDM5POGHMFNKPYRC3LCIAWIVRUGVBUQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.269167210 (396h39m17.039808535s) [noise=true , address=77.90.31.13:4652     , piece_id=IVLFU33BFOUXWJEYUUS2AEOZLAVTOKDMEK7RDPEBPOWF34SWNR6Q, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.278551023 (396h39m17.049192358s) [noise=true , address=77.90.31.10:4528     , piece_id=XA7ZR76AK6TYNZDCMKPWNMZELNRGXFUU53L34IFMDWRB4LN3W4RA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.280070640 (396h39m17.050711975s) [noise=true , address=77.90.31.21:4903     , piece_id=LYVWE3A5IAAEZNHB6DZ63XGBH2UQRJRYMJDMRBOJ2BIN3WESS6RQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.296867786 (396h39m17.067509111s) [noise=true , address=77.90.31.11:4573     , piece_id=G76LQFRBIKPUKF7CI7DXGL6JRYJOOZJ6SLPAM4Z64CXYJVPW42DA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.303116681 (396h39m17.073758016s) [noise=true , address=77.90.31.18:4827     , piece_id=MQJMN3CW2AEP5T74I7WUUBIHFZOLMMKCIN7IOBWZT2VYQARYLIIQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:44.408881294 (396h39m19.179522629s) [noise=true , address=45.91.116.7:4041     , piece_id=5JXKDZGV2EPLVSDUVP5LDFOGQ66FXPR2GXYEBFF5KWQXUPJNKPMA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:44.871597160 (396h39m19.642238495s) [noise=true , address=45.91.95.5:4006      , piece_id=JGKTT6OVQ7T2C22UOWG5HPQ67DBF3NPA3OAMALDLQGATY5LT63PA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:12ViW64JDJxzvRU39MsLp5JZKAmHZmxCAJuLVGi2E1E1r9gfc9A, address:45.91.95.5:4006): protocol: storage node overloaded, request limit: 2000
Jul  9 21:49:51.702994736 (396h39m26.473636071s) [noise=true , address=45.91.116.8:4072     , piece_id=2THWBWLISKLKJFVUAESYPDVBGOSZ2M6AVHMUN2C22S46FYBNE5RA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:55.468073925 (396h39m30.23871526s) [noise=true , address=79.127.219.38:4022   , piece_id=72QFHVOHWUNOSLO65KGIXMA7BYR4DTRPVLVAD4EHHZKXX3GAQMFQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:50:22.315419748 (396h39m57.086061083s) [noise=true , address=104.36.82.34:4564    , piece_id=CXLC3UUVVIGKA2OP2BQXE7XH7HNHXOJ3O6BQVUNS5NVY4KRPUWIA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:50:32.620803316 (396h40m7.391444651s) [noise=true , address=104.36.82.20:4451    , piece_id=CVO53ZISRV2ON542CVCHUAUDVZQI2L5KGCRCMZLP4POOBKLZNVFA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:50:39.176702995 (396h40m13.94734433s) [noise=true , address=45.91.95.4:4021      , piece_id=PFQ3VSEQPTNB4DERVNGT4BCSMZGY3C3OWWJJHVLQTTOCB6TWCMIA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:1dXfFE3nY9ZSEixFePGxdptsrybf38kYjYgV61MzV8kHtc12w, address:45.91.95.4:4021): protocol: expected piece hash; context deadline exceeded; EOF
Jul  9 21:50:39.176724405 (396h40m13.94736573s) [noise=true , address=104.36.82.44:4885    , piece_id=OZVJDJJLCK46MBKO6TGGHQFSW2QUDQ6GDUHTBZLI7Y5LWBXVPJCQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:118qGQLFSNbsYsvFrKjTXXWbFYu2sRaRHrUNkKNCrNVpzVQRtG, address:104.36.82.44:4885): protocol: expected piece hash; context deadline exceeded; EOF
Jul  9 21:50:39.176800822 (396h40m13.947442157s) [noise=true , address=45.91.95.3:4021      , piece_id=W7TAKLK7PEUHTITB74T7HJGOU6WTBPRTFHPQF6VTVM4OTPNYTRWA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:131LBDdhw5s1dsLF2CnAPWaL3Amwm4kvfjyqfTvjkrHSQUjJ2q, address:45.91.95.3:4021): protocol: write tcp 188.166.225.170:52410->45.91.95.3:4021: use of closed network connection; write tcp 188.166.225.170:52410->45.91.95.3:4021: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52410->45.91.95.3:4021: use of closed network connection
Jul  9 21:50:39.176914419 (396h40m13.947555744s) [noise=true , address=45.91.95.2:4017      , piece_id=W52X6YGCDZBSRQEB63HLCQV6CN5JL6JYC2SML5QIRBO5W7CIKDRQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:1vtusfmiftx4cbYbLEzPEpgvmaGQAD9wsJGBCk8r4f1MkY1RL6, address:45.91.95.2:4017): protocol: write tcp 188.166.225.170:33416->45.91.95.2:4017: use of closed network connection; write tcp 188.166.225.170:33416->45.91.95.2:4017: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33416->45.91.95.2:4017: use of closed network connection
Jul  9 21:50:39.176950669 (396h40m13.947591994s) [seg_pos={0 0}, upload=317350]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil>
Jul  9 21:50:39.412544674 (396h40m14.183186009s) [upload=317350]: Done uploading segments...
Jul  9 21:50:39.412568239 (396h40m14.183209574s) [upload=317350]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12)
Duration: 18.802547955s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip: 
8 out of 60 is failed (threshold=3) [..........X....X...............X..X.X...X...X.......X.......]
duration: 
35.690779773s
FAIL (2025-07-09 21:55:18 UTC) 
orbiter warning: 
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 12)
======LOGS======
SegmentBegin
Jul  9 21:49:40.272144307 (396h39m15.042785642s) [seg_pos={0 0}, upload=317350]: Begin upload segment...
Jul  9 21:49:40.272207637 (396h39m15.042848972s) [seg_pos={0 0}, upload=317350]: Done begin upload segment.
Jul  9 21:49:40.272228447 (396h39m15.042869772s) [noise=true , address=45.91.116.8:4072     , piece_id=2THWBWLISKLKJFVUAESYPDVBGOSZ2M6AVHMUN2C22S46FYBNE5RA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.272260418 (396h39m15.042901743s) [noise=true , address=104.36.82.20:4451    , piece_id=CVO53ZISRV2ON542CVCHUAUDVZQI2L5KGCRCMZLP4POOBKLZNVFA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.272657718 (396h39m15.043299043s) [noise=true , address=104.36.82.34:4564    , piece_id=CXLC3UUVVIGKA2OP2BQXE7XH7HNHXOJ3O6BQVUNS5NVY4KRPUWIA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.272906815 (396h39m15.04354815s) [noise=true , address=104.36.82.45:4905    , piece_id=YQWZK3R425VYYPSXLTBCNZQUN2IPWYZTNU7NNR5EW5ONIOH7BG3A, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273256314 (396h39m15.043897649s) [noise=true , address=45.91.95.3:4021      , piece_id=W7TAKLK7PEUHTITB74T7HJGOU6WTBPRTFHPQF6VTVM4OTPNYTRWA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273291210 (396h39m15.043932535s) [noise=true , address=45.91.95.2:4017      , piece_id=W52X6YGCDZBSRQEB63HLCQV6CN5JL6JYC2SML5QIRBO5W7CIKDRQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273553742 (396h39m15.044195077s) [noise=true , address=79.127.219.38:4022   , piece_id=72QFHVOHWUNOSLO65KGIXMA7BYR4DTRPVLVAD4EHHZKXX3GAQMFQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273793651 (396h39m15.044434986s) [noise=true , address=104.36.82.44:4885    , piece_id=OZVJDJJLCK46MBKO6TGGHQFSW2QUDQ6GDUHTBZLI7Y5LWBXVPJCQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273834831 (396h39m15.044476156s) [noise=true , address=77.90.31.11:4573     , piece_id=G76LQFRBIKPUKF7CI7DXGL6JRYJOOZJ6SLPAM4Z64CXYJVPW42DA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273869627 (396h39m15.044510962s) [noise=true , address=77.90.31.18:4827     , piece_id=MQJMN3CW2AEP5T74I7WUUBIHFZOLMMKCIN7IOBWZT2VYQARYLIIQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274155423 (396h39m15.044796758s) [noise=true , address=77.90.31.19:4876     , piece_id=ROM6VJDIDOEUEGP3PMEHKEDM5POGHMFNKPYRC3LCIAWIVRUGVBUQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274314117 (396h39m15.044955452s) [noise=true , address=79.127.220.97:4371   , piece_id=XNPEHYQWPTFHLU5TJEO7HZC3MLOLE26GQWI4PI2CUCIL6QTAO7TQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274414660 (396h39m15.045055995s) [noise=true , address=45.91.95.5:4006      , piece_id=JGKTT6OVQ7T2C22UOWG5HPQ67DBF3NPA3OAMALDLQGATY5LT63PA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274653466 (396h39m15.045294791s) [noise=true , address=77.90.31.10:4528     , piece_id=XA7ZR76AK6TYNZDCMKPWNMZELNRGXFUU53L34IFMDWRB4LN3W4RA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274681149 (396h39m15.045322484s) [noise=true , address=45.91.95.4:4021      , piece_id=PFQ3VSEQPTNB4DERVNGT4BCSMZGY3C3OWWJJHVLQTTOCB6TWCMIA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274898425 (396h39m15.04553976s) [noise=true , address=77.90.31.21:4903     , piece_id=LYVWE3A5IAAEZNHB6DZ63XGBH2UQRJRYMJDMRBOJ2BIN3WESS6RQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.275008706 (396h39m15.045650041s) [noise=true , address=77.90.31.13:4652     , piece_id=IVLFU33BFOUXWJEYUUS2AEOZLAVTOKDMEK7RDPEBPOWF34SWNR6Q, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.275332215 (396h39m15.04597355s) [noise=true , address=45.91.116.7:4041     , piece_id=5JXKDZGV2EPLVSDUVP5LDFOGQ66FXPR2GXYEBFF5KWQXUPJNKPMA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:41.657764345 (396h39m16.42840568s) [upload=317350]: Next returned nil segment
Jul  9 21:49:41.657771018 (396h39m16.428412353s) [upload=317350]: Waiting for error group managing segments...
Jul  9 21:49:41.690644980 (396h39m16.461286315s) [noise=true , address=104.36.82.45:4905    , piece_id=YQWZK3R425VYYPSXLTBCNZQUN2IPWYZTNU7NNR5EW5ONIOH7BG3A, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:12ffKESNSVpXQzbwJinP6vvgE6zoF3RFz2NRUuuJHvd7bvk1gc9, address:104.36.82.45:4905): protocol: untrusted: invalid order limit signature: rpcpeer: drpc transport does not have required methods
Jul  9 21:49:42.092098451 (396h39m16.862739786s) [noise=true , address=79.127.220.97:4371   , piece_id=XNPEHYQWPTFHLU5TJEO7HZC3MLOLE26GQWI4PI2CUCIL6QTAO7TQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.266002837 (396h39m17.036644172s) [noise=true , address=77.90.31.19:4876     , piece_id=ROM6VJDIDOEUEGP3PMEHKEDM5POGHMFNKPYRC3LCIAWIVRUGVBUQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.269167210 (396h39m17.039808535s) [noise=true , address=77.90.31.13:4652     , piece_id=IVLFU33BFOUXWJEYUUS2AEOZLAVTOKDMEK7RDPEBPOWF34SWNR6Q, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.278551023 (396h39m17.049192358s) [noise=true , address=77.90.31.10:4528     , piece_id=XA7ZR76AK6TYNZDCMKPWNMZELNRGXFUU53L34IFMDWRB4LN3W4RA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.280070640 (396h39m17.050711975s) [noise=true , address=77.90.31.21:4903     , piece_id=LYVWE3A5IAAEZNHB6DZ63XGBH2UQRJRYMJDMRBOJ2BIN3WESS6RQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.296867786 (396h39m17.067509111s) [noise=true , address=77.90.31.11:4573     , piece_id=G76LQFRBIKPUKF7CI7DXGL6JRYJOOZJ6SLPAM4Z64CXYJVPW42DA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.303116681 (396h39m17.073758016s) [noise=true , address=77.90.31.18:4827     , piece_id=MQJMN3CW2AEP5T74I7WUUBIHFZOLMMKCIN7IOBWZT2VYQARYLIIQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:44.408881294 (396h39m19.179522629s) [noise=true , address=45.91.116.7:4041     , piece_id=5JXKDZGV2EPLVSDUVP5LDFOGQ66FXPR2GXYEBFF5KWQXUPJNKPMA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:44.871597160 (396h39m19.642238495s) [noise=true , address=45.91.95.5:4006      , piece_id=JGKTT6OVQ7T2C22UOWG5HPQ67DBF3NPA3OAMALDLQGATY5LT63PA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:12ViW64JDJxzvRU39MsLp5JZKAmHZmxCAJuLVGi2E1E1r9gfc9A, address:45.91.95.5:4006): protocol: storage node overloaded, request limit: 2000
Jul  9 21:49:51.702994736 (396h39m26.473636071s) [noise=true , address=45.91.116.8:4072     , piece_id=2THWBWLISKLKJFVUAESYPDVBGOSZ2M6AVHMUN2C22S46FYBNE5RA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:55.468073925 (396h39m30.23871526s) [noise=true , address=79.127.219.38:4022   , piece_id=72QFHVOHWUNOSLO65KGIXMA7BYR4DTRPVLVAD4EHHZKXX3GAQMFQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:50:22.315419748 (396h39m57.086061083s) [noise=true , address=104.36.82.34:4564    , piece_id=CXLC3UUVVIGKA2OP2BQXE7XH7HNHXOJ3O6BQVUNS5NVY4KRPUWIA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:50:32.620803316 (396h40m7.391444651s) [noise=true , address=104.36.82.20:4451    , piece_id=CVO53ZISRV2ON542CVCHUAUDVZQI2L5KGCRCMZLP4POOBKLZNVFA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:50:39.176702995 (396h40m13.94734433s) [noise=true , address=45.91.95.4:4021      , piece_id=PFQ3VSEQPTNB4DERVNGT4BCSMZGY3C3OWWJJHVLQTTOCB6TWCMIA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:1dXfFE3nY9ZSEixFePGxdptsrybf38kYjYgV61MzV8kHtc12w, address:45.91.95.4:4021): protocol: expected piece hash; context deadline exceeded; EOF
Jul  9 21:50:39.176724405 (396h40m13.94736573s) [noise=true , address=104.36.82.44:4885    , piece_id=OZVJDJJLCK46MBKO6TGGHQFSW2QUDQ6GDUHTBZLI7Y5LWBXVPJCQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:118qGQLFSNbsYsvFrKjTXXWbFYu2sRaRHrUNkKNCrNVpzVQRtG, address:104.36.82.44:4885): protocol: expected piece hash; context deadline exceeded; EOF
Jul  9 21:50:39.176800822 (396h40m13.947442157s) [noise=true , address=45.91.95.3:4021      , piece_id=W7TAKLK7PEUHTITB74T7HJGOU6WTBPRTFHPQF6VTVM4OTPNYTRWA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:131LBDdhw5s1dsLF2CnAPWaL3Amwm4kvfjyqfTvjkrHSQUjJ2q, address:45.91.95.3:4021): protocol: write tcp 188.166.225.170:52410->45.91.95.3:4021: use of closed network connection; write tcp 188.166.225.170:52410->45.91.95.3:4021: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52410->45.91.95.3:4021: use of closed network connection
Jul  9 21:50:39.176914419 (396h40m13.947555744s) [noise=true , address=45.91.95.2:4017      , piece_id=W52X6YGCDZBSRQEB63HLCQV6CN5JL6JYC2SML5QIRBO5W7CIKDRQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:1vtusfmiftx4cbYbLEzPEpgvmaGQAD9wsJGBCk8r4f1MkY1RL6, address:45.91.95.2:4017): protocol: write tcp 188.166.225.170:33416->45.91.95.2:4017: use of closed network connection; write tcp 188.166.225.170:33416->45.91.95.2:4017: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33416->45.91.95.2:4017: use of closed network connection
Jul  9 21:50:39.176950669 (396h40m13.947591994s) [seg_pos={0 0}, upload=317350]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil>
Jul  9 21:50:39.412544674 (396h40m14.183186009s) [upload=317350]: Done uploading segments...
Jul  9 21:50:39.412568239 (396h40m14.183209574s) [upload=317350]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12)
Duration: 35.690798158s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
8 out of 60 is failed (threshold=3) [X....X..X.........X...............X..X....X........X........]
duration: 
28.473549891s
FAIL (2025-07-09 21:55:10 UTC) 
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 28.473605397s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip: 
8 out of 60 is failed (threshold=3) [...........X....X...............X..X.X...X...X.......X......]
duration: 
33.865917148s
FAIL (2025-07-09 21:54:42 UTC) 
orbiter warning: 
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 12)
======LOGS======
SegmentBegin
Jul  9 21:49:40.272144307 (396h39m15.042785642s) [seg_pos={0 0}, upload=317350]: Begin upload segment...
Jul  9 21:49:40.272207637 (396h39m15.042848972s) [seg_pos={0 0}, upload=317350]: Done begin upload segment.
Jul  9 21:49:40.272228447 (396h39m15.042869772s) [noise=true , address=45.91.116.8:4072     , piece_id=2THWBWLISKLKJFVUAESYPDVBGOSZ2M6AVHMUN2C22S46FYBNE5RA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.272260418 (396h39m15.042901743s) [noise=true , address=104.36.82.20:4451    , piece_id=CVO53ZISRV2ON542CVCHUAUDVZQI2L5KGCRCMZLP4POOBKLZNVFA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.272657718 (396h39m15.043299043s) [noise=true , address=104.36.82.34:4564    , piece_id=CXLC3UUVVIGKA2OP2BQXE7XH7HNHXOJ3O6BQVUNS5NVY4KRPUWIA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.272906815 (396h39m15.04354815s) [noise=true , address=104.36.82.45:4905    , piece_id=YQWZK3R425VYYPSXLTBCNZQUN2IPWYZTNU7NNR5EW5ONIOH7BG3A, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273256314 (396h39m15.043897649s) [noise=true , address=45.91.95.3:4021      , piece_id=W7TAKLK7PEUHTITB74T7HJGOU6WTBPRTFHPQF6VTVM4OTPNYTRWA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273291210 (396h39m15.043932535s) [noise=true , address=45.91.95.2:4017      , piece_id=W52X6YGCDZBSRQEB63HLCQV6CN5JL6JYC2SML5QIRBO5W7CIKDRQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273553742 (396h39m15.044195077s) [noise=true , address=79.127.219.38:4022   , piece_id=72QFHVOHWUNOSLO65KGIXMA7BYR4DTRPVLVAD4EHHZKXX3GAQMFQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273793651 (396h39m15.044434986s) [noise=true , address=104.36.82.44:4885    , piece_id=OZVJDJJLCK46MBKO6TGGHQFSW2QUDQ6GDUHTBZLI7Y5LWBXVPJCQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273834831 (396h39m15.044476156s) [noise=true , address=77.90.31.11:4573     , piece_id=G76LQFRBIKPUKF7CI7DXGL6JRYJOOZJ6SLPAM4Z64CXYJVPW42DA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273869627 (396h39m15.044510962s) [noise=true , address=77.90.31.18:4827     , piece_id=MQJMN3CW2AEP5T74I7WUUBIHFZOLMMKCIN7IOBWZT2VYQARYLIIQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274155423 (396h39m15.044796758s) [noise=true , address=77.90.31.19:4876     , piece_id=ROM6VJDIDOEUEGP3PMEHKEDM5POGHMFNKPYRC3LCIAWIVRUGVBUQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274314117 (396h39m15.044955452s) [noise=true , address=79.127.220.97:4371   , piece_id=XNPEHYQWPTFHLU5TJEO7HZC3MLOLE26GQWI4PI2CUCIL6QTAO7TQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274414660 (396h39m15.045055995s) [noise=true , address=45.91.95.5:4006      , piece_id=JGKTT6OVQ7T2C22UOWG5HPQ67DBF3NPA3OAMALDLQGATY5LT63PA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274653466 (396h39m15.045294791s) [noise=true , address=77.90.31.10:4528     , piece_id=XA7ZR76AK6TYNZDCMKPWNMZELNRGXFUU53L34IFMDWRB4LN3W4RA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274681149 (396h39m15.045322484s) [noise=true , address=45.91.95.4:4021      , piece_id=PFQ3VSEQPTNB4DERVNGT4BCSMZGY3C3OWWJJHVLQTTOCB6TWCMIA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274898425 (396h39m15.04553976s) [noise=true , address=77.90.31.21:4903     , piece_id=LYVWE3A5IAAEZNHB6DZ63XGBH2UQRJRYMJDMRBOJ2BIN3WESS6RQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.275008706 (396h39m15.045650041s) [noise=true , address=77.90.31.13:4652     , piece_id=IVLFU33BFOUXWJEYUUS2AEOZLAVTOKDMEK7RDPEBPOWF34SWNR6Q, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.275332215 (396h39m15.04597355s) [noise=true , address=45.91.116.7:4041     , piece_id=5JXKDZGV2EPLVSDUVP5LDFOGQ66FXPR2GXYEBFF5KWQXUPJNKPMA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:41.657764345 (396h39m16.42840568s) [upload=317350]: Next returned nil segment
Jul  9 21:49:41.657771018 (396h39m16.428412353s) [upload=317350]: Waiting for error group managing segments...
Jul  9 21:49:41.690644980 (396h39m16.461286315s) [noise=true , address=104.36.82.45:4905    , piece_id=YQWZK3R425VYYPSXLTBCNZQUN2IPWYZTNU7NNR5EW5ONIOH7BG3A, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:12ffKESNSVpXQzbwJinP6vvgE6zoF3RFz2NRUuuJHvd7bvk1gc9, address:104.36.82.45:4905): protocol: untrusted: invalid order limit signature: rpcpeer: drpc transport does not have required methods
Jul  9 21:49:42.092098451 (396h39m16.862739786s) [noise=true , address=79.127.220.97:4371   , piece_id=XNPEHYQWPTFHLU5TJEO7HZC3MLOLE26GQWI4PI2CUCIL6QTAO7TQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.266002837 (396h39m17.036644172s) [noise=true , address=77.90.31.19:4876     , piece_id=ROM6VJDIDOEUEGP3PMEHKEDM5POGHMFNKPYRC3LCIAWIVRUGVBUQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.269167210 (396h39m17.039808535s) [noise=true , address=77.90.31.13:4652     , piece_id=IVLFU33BFOUXWJEYUUS2AEOZLAVTOKDMEK7RDPEBPOWF34SWNR6Q, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.278551023 (396h39m17.049192358s) [noise=true , address=77.90.31.10:4528     , piece_id=XA7ZR76AK6TYNZDCMKPWNMZELNRGXFUU53L34IFMDWRB4LN3W4RA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.280070640 (396h39m17.050711975s) [noise=true , address=77.90.31.21:4903     , piece_id=LYVWE3A5IAAEZNHB6DZ63XGBH2UQRJRYMJDMRBOJ2BIN3WESS6RQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.296867786 (396h39m17.067509111s) [noise=true , address=77.90.31.11:4573     , piece_id=G76LQFRBIKPUKF7CI7DXGL6JRYJOOZJ6SLPAM4Z64CXYJVPW42DA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.303116681 (396h39m17.073758016s) [noise=true , address=77.90.31.18:4827     , piece_id=MQJMN3CW2AEP5T74I7WUUBIHFZOLMMKCIN7IOBWZT2VYQARYLIIQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:44.408881294 (396h39m19.179522629s) [noise=true , address=45.91.116.7:4041     , piece_id=5JXKDZGV2EPLVSDUVP5LDFOGQ66FXPR2GXYEBFF5KWQXUPJNKPMA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:44.871597160 (396h39m19.642238495s) [noise=true , address=45.91.95.5:4006      , piece_id=JGKTT6OVQ7T2C22UOWG5HPQ67DBF3NPA3OAMALDLQGATY5LT63PA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:12ViW64JDJxzvRU39MsLp5JZKAmHZmxCAJuLVGi2E1E1r9gfc9A, address:45.91.95.5:4006): protocol: storage node overloaded, request limit: 2000
Jul  9 21:49:51.702994736 (396h39m26.473636071s) [noise=true , address=45.91.116.8:4072     , piece_id=2THWBWLISKLKJFVUAESYPDVBGOSZ2M6AVHMUN2C22S46FYBNE5RA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:55.468073925 (396h39m30.23871526s) [noise=true , address=79.127.219.38:4022   , piece_id=72QFHVOHWUNOSLO65KGIXMA7BYR4DTRPVLVAD4EHHZKXX3GAQMFQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:50:22.315419748 (396h39m57.086061083s) [noise=true , address=104.36.82.34:4564    , piece_id=CXLC3UUVVIGKA2OP2BQXE7XH7HNHXOJ3O6BQVUNS5NVY4KRPUWIA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:50:32.620803316 (396h40m7.391444651s) [noise=true , address=104.36.82.20:4451    , piece_id=CVO53ZISRV2ON542CVCHUAUDVZQI2L5KGCRCMZLP4POOBKLZNVFA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:50:39.176702995 (396h40m13.94734433s) [noise=true , address=45.91.95.4:4021      , piece_id=PFQ3VSEQPTNB4DERVNGT4BCSMZGY3C3OWWJJHVLQTTOCB6TWCMIA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:1dXfFE3nY9ZSEixFePGxdptsrybf38kYjYgV61MzV8kHtc12w, address:45.91.95.4:4021): protocol: expected piece hash; context deadline exceeded; EOF
Jul  9 21:50:39.176724405 (396h40m13.94736573s) [noise=true , address=104.36.82.44:4885    , piece_id=OZVJDJJLCK46MBKO6TGGHQFSW2QUDQ6GDUHTBZLI7Y5LWBXVPJCQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:118qGQLFSNbsYsvFrKjTXXWbFYu2sRaRHrUNkKNCrNVpzVQRtG, address:104.36.82.44:4885): protocol: expected piece hash; context deadline exceeded; EOF
Jul  9 21:50:39.176800822 (396h40m13.947442157s) [noise=true , address=45.91.95.3:4021      , piece_id=W7TAKLK7PEUHTITB74T7HJGOU6WTBPRTFHPQF6VTVM4OTPNYTRWA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:131LBDdhw5s1dsLF2CnAPWaL3Amwm4kvfjyqfTvjkrHSQUjJ2q, address:45.91.95.3:4021): protocol: write tcp 188.166.225.170:52410->45.91.95.3:4021: use of closed network connection; write tcp 188.166.225.170:52410->45.91.95.3:4021: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52410->45.91.95.3:4021: use of closed network connection
Jul  9 21:50:39.176914419 (396h40m13.947555744s) [noise=true , address=45.91.95.2:4017      , piece_id=W52X6YGCDZBSRQEB63HLCQV6CN5JL6JYC2SML5QIRBO5W7CIKDRQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:1vtusfmiftx4cbYbLEzPEpgvmaGQAD9wsJGBCk8r4f1MkY1RL6, address:45.91.95.2:4017): protocol: write tcp 188.166.225.170:33416->45.91.95.2:4017: use of closed network connection; write tcp 188.166.225.170:33416->45.91.95.2:4017: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33416->45.91.95.2:4017: use of closed network connection
Jul  9 21:50:39.176950669 (396h40m13.947591994s) [seg_pos={0 0}, upload=317350]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil>
Jul  9 21:50:39.412544674 (396h40m14.183186009s) [upload=317350]: Done uploading segments...
Jul  9 21:50:39.412568239 (396h40m14.183209574s) [upload=317350]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12)
Duration: 33.865931416s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
8 out of 60 is failed (threshold=3) [.X....X..X.........X...............X..X....X........X.......]
duration: 
30.105733304s
FAIL (2025-07-09 21:54:11 UTC) 
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 30.105744105s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip: 
8 out of 60 is failed (threshold=3) [............X....X...............X..X.X...X...X.......X.....]
duration: 
24.175672911s
FAIL (2025-07-09 21:54:08 UTC) 
orbiter warning: 
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 12)
======LOGS======
SegmentBegin
Jul  9 21:49:40.272144307 (396h39m15.042785642s) [seg_pos={0 0}, upload=317350]: Begin upload segment...
Jul  9 21:49:40.272207637 (396h39m15.042848972s) [seg_pos={0 0}, upload=317350]: Done begin upload segment.
Jul  9 21:49:40.272228447 (396h39m15.042869772s) [noise=true , address=45.91.116.8:4072     , piece_id=2THWBWLISKLKJFVUAESYPDVBGOSZ2M6AVHMUN2C22S46FYBNE5RA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.272260418 (396h39m15.042901743s) [noise=true , address=104.36.82.20:4451    , piece_id=CVO53ZISRV2ON542CVCHUAUDVZQI2L5KGCRCMZLP4POOBKLZNVFA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.272657718 (396h39m15.043299043s) [noise=true , address=104.36.82.34:4564    , piece_id=CXLC3UUVVIGKA2OP2BQXE7XH7HNHXOJ3O6BQVUNS5NVY4KRPUWIA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.272906815 (396h39m15.04354815s) [noise=true , address=104.36.82.45:4905    , piece_id=YQWZK3R425VYYPSXLTBCNZQUN2IPWYZTNU7NNR5EW5ONIOH7BG3A, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273256314 (396h39m15.043897649s) [noise=true , address=45.91.95.3:4021      , piece_id=W7TAKLK7PEUHTITB74T7HJGOU6WTBPRTFHPQF6VTVM4OTPNYTRWA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273291210 (396h39m15.043932535s) [noise=true , address=45.91.95.2:4017      , piece_id=W52X6YGCDZBSRQEB63HLCQV6CN5JL6JYC2SML5QIRBO5W7CIKDRQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273553742 (396h39m15.044195077s) [noise=true , address=79.127.219.38:4022   , piece_id=72QFHVOHWUNOSLO65KGIXMA7BYR4DTRPVLVAD4EHHZKXX3GAQMFQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273793651 (396h39m15.044434986s) [noise=true , address=104.36.82.44:4885    , piece_id=OZVJDJJLCK46MBKO6TGGHQFSW2QUDQ6GDUHTBZLI7Y5LWBXVPJCQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273834831 (396h39m15.044476156s) [noise=true , address=77.90.31.11:4573     , piece_id=G76LQFRBIKPUKF7CI7DXGL6JRYJOOZJ6SLPAM4Z64CXYJVPW42DA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273869627 (396h39m15.044510962s) [noise=true , address=77.90.31.18:4827     , piece_id=MQJMN3CW2AEP5T74I7WUUBIHFZOLMMKCIN7IOBWZT2VYQARYLIIQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274155423 (396h39m15.044796758s) [noise=true , address=77.90.31.19:4876     , piece_id=ROM6VJDIDOEUEGP3PMEHKEDM5POGHMFNKPYRC3LCIAWIVRUGVBUQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274314117 (396h39m15.044955452s) [noise=true , address=79.127.220.97:4371   , piece_id=XNPEHYQWPTFHLU5TJEO7HZC3MLOLE26GQWI4PI2CUCIL6QTAO7TQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274414660 (396h39m15.045055995s) [noise=true , address=45.91.95.5:4006      , piece_id=JGKTT6OVQ7T2C22UOWG5HPQ67DBF3NPA3OAMALDLQGATY5LT63PA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274653466 (396h39m15.045294791s) [noise=true , address=77.90.31.10:4528     , piece_id=XA7ZR76AK6TYNZDCMKPWNMZELNRGXFUU53L34IFMDWRB4LN3W4RA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274681149 (396h39m15.045322484s) [noise=true , address=45.91.95.4:4021      , piece_id=PFQ3VSEQPTNB4DERVNGT4BCSMZGY3C3OWWJJHVLQTTOCB6TWCMIA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274898425 (396h39m15.04553976s) [noise=true , address=77.90.31.21:4903     , piece_id=LYVWE3A5IAAEZNHB6DZ63XGBH2UQRJRYMJDMRBOJ2BIN3WESS6RQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.275008706 (396h39m15.045650041s) [noise=true , address=77.90.31.13:4652     , piece_id=IVLFU33BFOUXWJEYUUS2AEOZLAVTOKDMEK7RDPEBPOWF34SWNR6Q, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.275332215 (396h39m15.04597355s) [noise=true , address=45.91.116.7:4041     , piece_id=5JXKDZGV2EPLVSDUVP5LDFOGQ66FXPR2GXYEBFF5KWQXUPJNKPMA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:41.657764345 (396h39m16.42840568s) [upload=317350]: Next returned nil segment
Jul  9 21:49:41.657771018 (396h39m16.428412353s) [upload=317350]: Waiting for error group managing segments...
Jul  9 21:49:41.690644980 (396h39m16.461286315s) [noise=true , address=104.36.82.45:4905    , piece_id=YQWZK3R425VYYPSXLTBCNZQUN2IPWYZTNU7NNR5EW5ONIOH7BG3A, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:12ffKESNSVpXQzbwJinP6vvgE6zoF3RFz2NRUuuJHvd7bvk1gc9, address:104.36.82.45:4905): protocol: untrusted: invalid order limit signature: rpcpeer: drpc transport does not have required methods
Jul  9 21:49:42.092098451 (396h39m16.862739786s) [noise=true , address=79.127.220.97:4371   , piece_id=XNPEHYQWPTFHLU5TJEO7HZC3MLOLE26GQWI4PI2CUCIL6QTAO7TQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.266002837 (396h39m17.036644172s) [noise=true , address=77.90.31.19:4876     , piece_id=ROM6VJDIDOEUEGP3PMEHKEDM5POGHMFNKPYRC3LCIAWIVRUGVBUQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.269167210 (396h39m17.039808535s) [noise=true , address=77.90.31.13:4652     , piece_id=IVLFU33BFOUXWJEYUUS2AEOZLAVTOKDMEK7RDPEBPOWF34SWNR6Q, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.278551023 (396h39m17.049192358s) [noise=true , address=77.90.31.10:4528     , piece_id=XA7ZR76AK6TYNZDCMKPWNMZELNRGXFUU53L34IFMDWRB4LN3W4RA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.280070640 (396h39m17.050711975s) [noise=true , address=77.90.31.21:4903     , piece_id=LYVWE3A5IAAEZNHB6DZ63XGBH2UQRJRYMJDMRBOJ2BIN3WESS6RQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.296867786 (396h39m17.067509111s) [noise=true , address=77.90.31.11:4573     , piece_id=G76LQFRBIKPUKF7CI7DXGL6JRYJOOZJ6SLPAM4Z64CXYJVPW42DA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.303116681 (396h39m17.073758016s) [noise=true , address=77.90.31.18:4827     , piece_id=MQJMN3CW2AEP5T74I7WUUBIHFZOLMMKCIN7IOBWZT2VYQARYLIIQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:44.408881294 (396h39m19.179522629s) [noise=true , address=45.91.116.7:4041     , piece_id=5JXKDZGV2EPLVSDUVP5LDFOGQ66FXPR2GXYEBFF5KWQXUPJNKPMA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:44.871597160 (396h39m19.642238495s) [noise=true , address=45.91.95.5:4006      , piece_id=JGKTT6OVQ7T2C22UOWG5HPQ67DBF3NPA3OAMALDLQGATY5LT63PA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:12ViW64JDJxzvRU39MsLp5JZKAmHZmxCAJuLVGi2E1E1r9gfc9A, address:45.91.95.5:4006): protocol: storage node overloaded, request limit: 2000
Jul  9 21:49:51.702994736 (396h39m26.473636071s) [noise=true , address=45.91.116.8:4072     , piece_id=2THWBWLISKLKJFVUAESYPDVBGOSZ2M6AVHMUN2C22S46FYBNE5RA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:55.468073925 (396h39m30.23871526s) [noise=true , address=79.127.219.38:4022   , piece_id=72QFHVOHWUNOSLO65KGIXMA7BYR4DTRPVLVAD4EHHZKXX3GAQMFQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:50:22.315419748 (396h39m57.086061083s) [noise=true , address=104.36.82.34:4564    , piece_id=CXLC3UUVVIGKA2OP2BQXE7XH7HNHXOJ3O6BQVUNS5NVY4KRPUWIA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:50:32.620803316 (396h40m7.391444651s) [noise=true , address=104.36.82.20:4451    , piece_id=CVO53ZISRV2ON542CVCHUAUDVZQI2L5KGCRCMZLP4POOBKLZNVFA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:50:39.176702995 (396h40m13.94734433s) [noise=true , address=45.91.95.4:4021      , piece_id=PFQ3VSEQPTNB4DERVNGT4BCSMZGY3C3OWWJJHVLQTTOCB6TWCMIA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:1dXfFE3nY9ZSEixFePGxdptsrybf38kYjYgV61MzV8kHtc12w, address:45.91.95.4:4021): protocol: expected piece hash; context deadline exceeded; EOF
Jul  9 21:50:39.176724405 (396h40m13.94736573s) [noise=true , address=104.36.82.44:4885    , piece_id=OZVJDJJLCK46MBKO6TGGHQFSW2QUDQ6GDUHTBZLI7Y5LWBXVPJCQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:118qGQLFSNbsYsvFrKjTXXWbFYu2sRaRHrUNkKNCrNVpzVQRtG, address:104.36.82.44:4885): protocol: expected piece hash; context deadline exceeded; EOF
Jul  9 21:50:39.176800822 (396h40m13.947442157s) [noise=true , address=45.91.95.3:4021      , piece_id=W7TAKLK7PEUHTITB74T7HJGOU6WTBPRTFHPQF6VTVM4OTPNYTRWA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:131LBDdhw5s1dsLF2CnAPWaL3Amwm4kvfjyqfTvjkrHSQUjJ2q, address:45.91.95.3:4021): protocol: write tcp 188.166.225.170:52410->45.91.95.3:4021: use of closed network connection; write tcp 188.166.225.170:52410->45.91.95.3:4021: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52410->45.91.95.3:4021: use of closed network connection
Jul  9 21:50:39.176914419 (396h40m13.947555744s) [noise=true , address=45.91.95.2:4017      , piece_id=W52X6YGCDZBSRQEB63HLCQV6CN5JL6JYC2SML5QIRBO5W7CIKDRQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:1vtusfmiftx4cbYbLEzPEpgvmaGQAD9wsJGBCk8r4f1MkY1RL6, address:45.91.95.2:4017): protocol: write tcp 188.166.225.170:33416->45.91.95.2:4017: use of closed network connection; write tcp 188.166.225.170:33416->45.91.95.2:4017: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33416->45.91.95.2:4017: use of closed network connection
Jul  9 21:50:39.176950669 (396h40m13.947591994s) [seg_pos={0 0}, upload=317350]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil>
Jul  9 21:50:39.412544674 (396h40m14.183186009s) [upload=317350]: Done uploading segments...
Jul  9 21:50:39.412568239 (396h40m14.183209574s) [upload=317350]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12)
Duration: 24.175691396s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip: 
8 out of 60 is failed (threshold=3) [.............X....X...............X..X.X...X...X.......X....]
duration: 
49.539210983s
FAIL (2025-07-09 21:53:43 UTC) 
orbiter warning: 
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 12)
======LOGS======
SegmentBegin
Jul  9 21:49:40.272144307 (396h39m15.042785642s) [seg_pos={0 0}, upload=317350]: Begin upload segment...
Jul  9 21:49:40.272207637 (396h39m15.042848972s) [seg_pos={0 0}, upload=317350]: Done begin upload segment.
Jul  9 21:49:40.272228447 (396h39m15.042869772s) [noise=true , address=45.91.116.8:4072     , piece_id=2THWBWLISKLKJFVUAESYPDVBGOSZ2M6AVHMUN2C22S46FYBNE5RA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.272260418 (396h39m15.042901743s) [noise=true , address=104.36.82.20:4451    , piece_id=CVO53ZISRV2ON542CVCHUAUDVZQI2L5KGCRCMZLP4POOBKLZNVFA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.272657718 (396h39m15.043299043s) [noise=true , address=104.36.82.34:4564    , piece_id=CXLC3UUVVIGKA2OP2BQXE7XH7HNHXOJ3O6BQVUNS5NVY4KRPUWIA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.272906815 (396h39m15.04354815s) [noise=true , address=104.36.82.45:4905    , piece_id=YQWZK3R425VYYPSXLTBCNZQUN2IPWYZTNU7NNR5EW5ONIOH7BG3A, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273256314 (396h39m15.043897649s) [noise=true , address=45.91.95.3:4021      , piece_id=W7TAKLK7PEUHTITB74T7HJGOU6WTBPRTFHPQF6VTVM4OTPNYTRWA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273291210 (396h39m15.043932535s) [noise=true , address=45.91.95.2:4017      , piece_id=W52X6YGCDZBSRQEB63HLCQV6CN5JL6JYC2SML5QIRBO5W7CIKDRQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273553742 (396h39m15.044195077s) [noise=true , address=79.127.219.38:4022   , piece_id=72QFHVOHWUNOSLO65KGIXMA7BYR4DTRPVLVAD4EHHZKXX3GAQMFQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273793651 (396h39m15.044434986s) [noise=true , address=104.36.82.44:4885    , piece_id=OZVJDJJLCK46MBKO6TGGHQFSW2QUDQ6GDUHTBZLI7Y5LWBXVPJCQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273834831 (396h39m15.044476156s) [noise=true , address=77.90.31.11:4573     , piece_id=G76LQFRBIKPUKF7CI7DXGL6JRYJOOZJ6SLPAM4Z64CXYJVPW42DA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273869627 (396h39m15.044510962s) [noise=true , address=77.90.31.18:4827     , piece_id=MQJMN3CW2AEP5T74I7WUUBIHFZOLMMKCIN7IOBWZT2VYQARYLIIQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274155423 (396h39m15.044796758s) [noise=true , address=77.90.31.19:4876     , piece_id=ROM6VJDIDOEUEGP3PMEHKEDM5POGHMFNKPYRC3LCIAWIVRUGVBUQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274314117 (396h39m15.044955452s) [noise=true , address=79.127.220.97:4371   , piece_id=XNPEHYQWPTFHLU5TJEO7HZC3MLOLE26GQWI4PI2CUCIL6QTAO7TQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274414660 (396h39m15.045055995s) [noise=true , address=45.91.95.5:4006      , piece_id=JGKTT6OVQ7T2C22UOWG5HPQ67DBF3NPA3OAMALDLQGATY5LT63PA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274653466 (396h39m15.045294791s) [noise=true , address=77.90.31.10:4528     , piece_id=XA7ZR76AK6TYNZDCMKPWNMZELNRGXFUU53L34IFMDWRB4LN3W4RA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274681149 (396h39m15.045322484s) [noise=true , address=45.91.95.4:4021      , piece_id=PFQ3VSEQPTNB4DERVNGT4BCSMZGY3C3OWWJJHVLQTTOCB6TWCMIA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274898425 (396h39m15.04553976s) [noise=true , address=77.90.31.21:4903     , piece_id=LYVWE3A5IAAEZNHB6DZ63XGBH2UQRJRYMJDMRBOJ2BIN3WESS6RQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.275008706 (396h39m15.045650041s) [noise=true , address=77.90.31.13:4652     , piece_id=IVLFU33BFOUXWJEYUUS2AEOZLAVTOKDMEK7RDPEBPOWF34SWNR6Q, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.275332215 (396h39m15.04597355s) [noise=true , address=45.91.116.7:4041     , piece_id=5JXKDZGV2EPLVSDUVP5LDFOGQ66FXPR2GXYEBFF5KWQXUPJNKPMA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:41.657764345 (396h39m16.42840568s) [upload=317350]: Next returned nil segment
Jul  9 21:49:41.657771018 (396h39m16.428412353s) [upload=317350]: Waiting for error group managing segments...
Jul  9 21:49:41.690644980 (396h39m16.461286315s) [noise=true , address=104.36.82.45:4905    , piece_id=YQWZK3R425VYYPSXLTBCNZQUN2IPWYZTNU7NNR5EW5ONIOH7BG3A, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:12ffKESNSVpXQzbwJinP6vvgE6zoF3RFz2NRUuuJHvd7bvk1gc9, address:104.36.82.45:4905): protocol: untrusted: invalid order limit signature: rpcpeer: drpc transport does not have required methods
Jul  9 21:49:42.092098451 (396h39m16.862739786s) [noise=true , address=79.127.220.97:4371   , piece_id=XNPEHYQWPTFHLU5TJEO7HZC3MLOLE26GQWI4PI2CUCIL6QTAO7TQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.266002837 (396h39m17.036644172s) [noise=true , address=77.90.31.19:4876     , piece_id=ROM6VJDIDOEUEGP3PMEHKEDM5POGHMFNKPYRC3LCIAWIVRUGVBUQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.269167210 (396h39m17.039808535s) [noise=true , address=77.90.31.13:4652     , piece_id=IVLFU33BFOUXWJEYUUS2AEOZLAVTOKDMEK7RDPEBPOWF34SWNR6Q, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.278551023 (396h39m17.049192358s) [noise=true , address=77.90.31.10:4528     , piece_id=XA7ZR76AK6TYNZDCMKPWNMZELNRGXFUU53L34IFMDWRB4LN3W4RA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.280070640 (396h39m17.050711975s) [noise=true , address=77.90.31.21:4903     , piece_id=LYVWE3A5IAAEZNHB6DZ63XGBH2UQRJRYMJDMRBOJ2BIN3WESS6RQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.296867786 (396h39m17.067509111s) [noise=true , address=77.90.31.11:4573     , piece_id=G76LQFRBIKPUKF7CI7DXGL6JRYJOOZJ6SLPAM4Z64CXYJVPW42DA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.303116681 (396h39m17.073758016s) [noise=true , address=77.90.31.18:4827     , piece_id=MQJMN3CW2AEP5T74I7WUUBIHFZOLMMKCIN7IOBWZT2VYQARYLIIQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:44.408881294 (396h39m19.179522629s) [noise=true , address=45.91.116.7:4041     , piece_id=5JXKDZGV2EPLVSDUVP5LDFOGQ66FXPR2GXYEBFF5KWQXUPJNKPMA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:44.871597160 (396h39m19.642238495s) [noise=true , address=45.91.95.5:4006      , piece_id=JGKTT6OVQ7T2C22UOWG5HPQ67DBF3NPA3OAMALDLQGATY5LT63PA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:12ViW64JDJxzvRU39MsLp5JZKAmHZmxCAJuLVGi2E1E1r9gfc9A, address:45.91.95.5:4006): protocol: storage node overloaded, request limit: 2000
Jul  9 21:49:51.702994736 (396h39m26.473636071s) [noise=true , address=45.91.116.8:4072     , piece_id=2THWBWLISKLKJFVUAESYPDVBGOSZ2M6AVHMUN2C22S46FYBNE5RA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:55.468073925 (396h39m30.23871526s) [noise=true , address=79.127.219.38:4022   , piece_id=72QFHVOHWUNOSLO65KGIXMA7BYR4DTRPVLVAD4EHHZKXX3GAQMFQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:50:22.315419748 (396h39m57.086061083s) [noise=true , address=104.36.82.34:4564    , piece_id=CXLC3UUVVIGKA2OP2BQXE7XH7HNHXOJ3O6BQVUNS5NVY4KRPUWIA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:50:32.620803316 (396h40m7.391444651s) [noise=true , address=104.36.82.20:4451    , piece_id=CVO53ZISRV2ON542CVCHUAUDVZQI2L5KGCRCMZLP4POOBKLZNVFA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:50:39.176702995 (396h40m13.94734433s) [noise=true , address=45.91.95.4:4021      , piece_id=PFQ3VSEQPTNB4DERVNGT4BCSMZGY3C3OWWJJHVLQTTOCB6TWCMIA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:1dXfFE3nY9ZSEixFePGxdptsrybf38kYjYgV61MzV8kHtc12w, address:45.91.95.4:4021): protocol: expected piece hash; context deadline exceeded; EOF
Jul  9 21:50:39.176724405 (396h40m13.94736573s) [noise=true , address=104.36.82.44:4885    , piece_id=OZVJDJJLCK46MBKO6TGGHQFSW2QUDQ6GDUHTBZLI7Y5LWBXVPJCQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:118qGQLFSNbsYsvFrKjTXXWbFYu2sRaRHrUNkKNCrNVpzVQRtG, address:104.36.82.44:4885): protocol: expected piece hash; context deadline exceeded; EOF
Jul  9 21:50:39.176800822 (396h40m13.947442157s) [noise=true , address=45.91.95.3:4021      , piece_id=W7TAKLK7PEUHTITB74T7HJGOU6WTBPRTFHPQF6VTVM4OTPNYTRWA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:131LBDdhw5s1dsLF2CnAPWaL3Amwm4kvfjyqfTvjkrHSQUjJ2q, address:45.91.95.3:4021): protocol: write tcp 188.166.225.170:52410->45.91.95.3:4021: use of closed network connection; write tcp 188.166.225.170:52410->45.91.95.3:4021: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52410->45.91.95.3:4021: use of closed network connection
Jul  9 21:50:39.176914419 (396h40m13.947555744s) [noise=true , address=45.91.95.2:4017      , piece_id=W52X6YGCDZBSRQEB63HLCQV6CN5JL6JYC2SML5QIRBO5W7CIKDRQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:1vtusfmiftx4cbYbLEzPEpgvmaGQAD9wsJGBCk8r4f1MkY1RL6, address:45.91.95.2:4017): protocol: write tcp 188.166.225.170:33416->45.91.95.2:4017: use of closed network connection; write tcp 188.166.225.170:33416->45.91.95.2:4017: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33416->45.91.95.2:4017: use of closed network connection
Jul  9 21:50:39.176950669 (396h40m13.947591994s) [seg_pos={0 0}, upload=317350]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil>
Jul  9 21:50:39.412544674 (396h40m14.183186009s) [upload=317350]: Done uploading segments...
Jul  9 21:50:39.412568239 (396h40m14.183209574s) [upload=317350]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12)
Duration: 49.539231101s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
8 out of 60 is failed (threshold=3) [..X....X..X.........X...............X..X....X........X......]
duration: 
26.359940723s
FAIL (2025-07-09 21:53:40 UTC) 
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 26.359955571s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
8 out of 60 is failed (threshold=3) [...X....X..X.........X...............X..X....X........X.....]
duration: 
26.457219993s
FAIL (2025-07-09 21:52:48 UTC) 
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 26.457232657s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip: 
8 out of 60 is failed (threshold=3) [..............X....X...............X..X.X...X...X.......X...]
duration: 
19.11442128s
FAIL (2025-07-09 21:52:39 UTC) 
orbiter warning: 
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 12)
======LOGS======
SegmentBegin
Jul  9 21:49:40.272144307 (396h39m15.042785642s) [seg_pos={0 0}, upload=317350]: Begin upload segment...
Jul  9 21:49:40.272207637 (396h39m15.042848972s) [seg_pos={0 0}, upload=317350]: Done begin upload segment.
Jul  9 21:49:40.272228447 (396h39m15.042869772s) [noise=true , address=45.91.116.8:4072     , piece_id=2THWBWLISKLKJFVUAESYPDVBGOSZ2M6AVHMUN2C22S46FYBNE5RA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.272260418 (396h39m15.042901743s) [noise=true , address=104.36.82.20:4451    , piece_id=CVO53ZISRV2ON542CVCHUAUDVZQI2L5KGCRCMZLP4POOBKLZNVFA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.272657718 (396h39m15.043299043s) [noise=true , address=104.36.82.34:4564    , piece_id=CXLC3UUVVIGKA2OP2BQXE7XH7HNHXOJ3O6BQVUNS5NVY4KRPUWIA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.272906815 (396h39m15.04354815s) [noise=true , address=104.36.82.45:4905    , piece_id=YQWZK3R425VYYPSXLTBCNZQUN2IPWYZTNU7NNR5EW5ONIOH7BG3A, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273256314 (396h39m15.043897649s) [noise=true , address=45.91.95.3:4021      , piece_id=W7TAKLK7PEUHTITB74T7HJGOU6WTBPRTFHPQF6VTVM4OTPNYTRWA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273291210 (396h39m15.043932535s) [noise=true , address=45.91.95.2:4017      , piece_id=W52X6YGCDZBSRQEB63HLCQV6CN5JL6JYC2SML5QIRBO5W7CIKDRQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273553742 (396h39m15.044195077s) [noise=true , address=79.127.219.38:4022   , piece_id=72QFHVOHWUNOSLO65KGIXMA7BYR4DTRPVLVAD4EHHZKXX3GAQMFQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273793651 (396h39m15.044434986s) [noise=true , address=104.36.82.44:4885    , piece_id=OZVJDJJLCK46MBKO6TGGHQFSW2QUDQ6GDUHTBZLI7Y5LWBXVPJCQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273834831 (396h39m15.044476156s) [noise=true , address=77.90.31.11:4573     , piece_id=G76LQFRBIKPUKF7CI7DXGL6JRYJOOZJ6SLPAM4Z64CXYJVPW42DA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273869627 (396h39m15.044510962s) [noise=true , address=77.90.31.18:4827     , piece_id=MQJMN3CW2AEP5T74I7WUUBIHFZOLMMKCIN7IOBWZT2VYQARYLIIQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274155423 (396h39m15.044796758s) [noise=true , address=77.90.31.19:4876     , piece_id=ROM6VJDIDOEUEGP3PMEHKEDM5POGHMFNKPYRC3LCIAWIVRUGVBUQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274314117 (396h39m15.044955452s) [noise=true , address=79.127.220.97:4371   , piece_id=XNPEHYQWPTFHLU5TJEO7HZC3MLOLE26GQWI4PI2CUCIL6QTAO7TQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274414660 (396h39m15.045055995s) [noise=true , address=45.91.95.5:4006      , piece_id=JGKTT6OVQ7T2C22UOWG5HPQ67DBF3NPA3OAMALDLQGATY5LT63PA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274653466 (396h39m15.045294791s) [noise=true , address=77.90.31.10:4528     , piece_id=XA7ZR76AK6TYNZDCMKPWNMZELNRGXFUU53L34IFMDWRB4LN3W4RA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274681149 (396h39m15.045322484s) [noise=true , address=45.91.95.4:4021      , piece_id=PFQ3VSEQPTNB4DERVNGT4BCSMZGY3C3OWWJJHVLQTTOCB6TWCMIA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274898425 (396h39m15.04553976s) [noise=true , address=77.90.31.21:4903     , piece_id=LYVWE3A5IAAEZNHB6DZ63XGBH2UQRJRYMJDMRBOJ2BIN3WESS6RQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.275008706 (396h39m15.045650041s) [noise=true , address=77.90.31.13:4652     , piece_id=IVLFU33BFOUXWJEYUUS2AEOZLAVTOKDMEK7RDPEBPOWF34SWNR6Q, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.275332215 (396h39m15.04597355s) [noise=true , address=45.91.116.7:4041     , piece_id=5JXKDZGV2EPLVSDUVP5LDFOGQ66FXPR2GXYEBFF5KWQXUPJNKPMA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:41.657764345 (396h39m16.42840568s) [upload=317350]: Next returned nil segment
Jul  9 21:49:41.657771018 (396h39m16.428412353s) [upload=317350]: Waiting for error group managing segments...
Jul  9 21:49:41.690644980 (396h39m16.461286315s) [noise=true , address=104.36.82.45:4905    , piece_id=YQWZK3R425VYYPSXLTBCNZQUN2IPWYZTNU7NNR5EW5ONIOH7BG3A, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:12ffKESNSVpXQzbwJinP6vvgE6zoF3RFz2NRUuuJHvd7bvk1gc9, address:104.36.82.45:4905): protocol: untrusted: invalid order limit signature: rpcpeer: drpc transport does not have required methods
Jul  9 21:49:42.092098451 (396h39m16.862739786s) [noise=true , address=79.127.220.97:4371   , piece_id=XNPEHYQWPTFHLU5TJEO7HZC3MLOLE26GQWI4PI2CUCIL6QTAO7TQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.266002837 (396h39m17.036644172s) [noise=true , address=77.90.31.19:4876     , piece_id=ROM6VJDIDOEUEGP3PMEHKEDM5POGHMFNKPYRC3LCIAWIVRUGVBUQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.269167210 (396h39m17.039808535s) [noise=true , address=77.90.31.13:4652     , piece_id=IVLFU33BFOUXWJEYUUS2AEOZLAVTOKDMEK7RDPEBPOWF34SWNR6Q, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.278551023 (396h39m17.049192358s) [noise=true , address=77.90.31.10:4528     , piece_id=XA7ZR76AK6TYNZDCMKPWNMZELNRGXFUU53L34IFMDWRB4LN3W4RA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.280070640 (396h39m17.050711975s) [noise=true , address=77.90.31.21:4903     , piece_id=LYVWE3A5IAAEZNHB6DZ63XGBH2UQRJRYMJDMRBOJ2BIN3WESS6RQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.296867786 (396h39m17.067509111s) [noise=true , address=77.90.31.11:4573     , piece_id=G76LQFRBIKPUKF7CI7DXGL6JRYJOOZJ6SLPAM4Z64CXYJVPW42DA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.303116681 (396h39m17.073758016s) [noise=true , address=77.90.31.18:4827     , piece_id=MQJMN3CW2AEP5T74I7WUUBIHFZOLMMKCIN7IOBWZT2VYQARYLIIQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:44.408881294 (396h39m19.179522629s) [noise=true , address=45.91.116.7:4041     , piece_id=5JXKDZGV2EPLVSDUVP5LDFOGQ66FXPR2GXYEBFF5KWQXUPJNKPMA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:44.871597160 (396h39m19.642238495s) [noise=true , address=45.91.95.5:4006      , piece_id=JGKTT6OVQ7T2C22UOWG5HPQ67DBF3NPA3OAMALDLQGATY5LT63PA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:12ViW64JDJxzvRU39MsLp5JZKAmHZmxCAJuLVGi2E1E1r9gfc9A, address:45.91.95.5:4006): protocol: storage node overloaded, request limit: 2000
Jul  9 21:49:51.702994736 (396h39m26.473636071s) [noise=true , address=45.91.116.8:4072     , piece_id=2THWBWLISKLKJFVUAESYPDVBGOSZ2M6AVHMUN2C22S46FYBNE5RA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:55.468073925 (396h39m30.23871526s) [noise=true , address=79.127.219.38:4022   , piece_id=72QFHVOHWUNOSLO65KGIXMA7BYR4DTRPVLVAD4EHHZKXX3GAQMFQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:50:22.315419748 (396h39m57.086061083s) [noise=true , address=104.36.82.34:4564    , piece_id=CXLC3UUVVIGKA2OP2BQXE7XH7HNHXOJ3O6BQVUNS5NVY4KRPUWIA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:50:32.620803316 (396h40m7.391444651s) [noise=true , address=104.36.82.20:4451    , piece_id=CVO53ZISRV2ON542CVCHUAUDVZQI2L5KGCRCMZLP4POOBKLZNVFA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:50:39.176702995 (396h40m13.94734433s) [noise=true , address=45.91.95.4:4021      , piece_id=PFQ3VSEQPTNB4DERVNGT4BCSMZGY3C3OWWJJHVLQTTOCB6TWCMIA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:1dXfFE3nY9ZSEixFePGxdptsrybf38kYjYgV61MzV8kHtc12w, address:45.91.95.4:4021): protocol: expected piece hash; context deadline exceeded; EOF
Jul  9 21:50:39.176724405 (396h40m13.94736573s) [noise=true , address=104.36.82.44:4885    , piece_id=OZVJDJJLCK46MBKO6TGGHQFSW2QUDQ6GDUHTBZLI7Y5LWBXVPJCQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:118qGQLFSNbsYsvFrKjTXXWbFYu2sRaRHrUNkKNCrNVpzVQRtG, address:104.36.82.44:4885): protocol: expected piece hash; context deadline exceeded; EOF
Jul  9 21:50:39.176800822 (396h40m13.947442157s) [noise=true , address=45.91.95.3:4021      , piece_id=W7TAKLK7PEUHTITB74T7HJGOU6WTBPRTFHPQF6VTVM4OTPNYTRWA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:131LBDdhw5s1dsLF2CnAPWaL3Amwm4kvfjyqfTvjkrHSQUjJ2q, address:45.91.95.3:4021): protocol: write tcp 188.166.225.170:52410->45.91.95.3:4021: use of closed network connection; write tcp 188.166.225.170:52410->45.91.95.3:4021: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52410->45.91.95.3:4021: use of closed network connection
Jul  9 21:50:39.176914419 (396h40m13.947555744s) [noise=true , address=45.91.95.2:4017      , piece_id=W52X6YGCDZBSRQEB63HLCQV6CN5JL6JYC2SML5QIRBO5W7CIKDRQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:1vtusfmiftx4cbYbLEzPEpgvmaGQAD9wsJGBCk8r4f1MkY1RL6, address:45.91.95.2:4017): protocol: write tcp 188.166.225.170:33416->45.91.95.2:4017: use of closed network connection; write tcp 188.166.225.170:33416->45.91.95.2:4017: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33416->45.91.95.2:4017: use of closed network connection
Jul  9 21:50:39.176950669 (396h40m13.947591994s) [seg_pos={0 0}, upload=317350]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil>
Jul  9 21:50:39.412544674 (396h40m14.183186009s) [upload=317350]: Done uploading segments...
Jul  9 21:50:39.412568239 (396h40m14.183209574s) [upload=317350]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12)
Duration: 19.114439965s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
8 out of 60 is failed (threshold=3) [....X....X..X.........X...............X..X....X........X....]
duration: 
30.999076968s
FAIL (2025-07-09 21:52:21 UTC) 
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 30.999101133s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip: 
8 out of 60 is failed (threshold=3) [...............X....X...............X..X.X...X...X.......X..]
duration: 
36.667380411s
FAIL (2025-07-09 21:52:20 UTC) 
orbiter warning: 
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 12)
======LOGS======
SegmentBegin
Jul  9 21:49:40.272144307 (396h39m15.042785642s) [seg_pos={0 0}, upload=317350]: Begin upload segment...
Jul  9 21:49:40.272207637 (396h39m15.042848972s) [seg_pos={0 0}, upload=317350]: Done begin upload segment.
Jul  9 21:49:40.272228447 (396h39m15.042869772s) [noise=true , address=45.91.116.8:4072     , piece_id=2THWBWLISKLKJFVUAESYPDVBGOSZ2M6AVHMUN2C22S46FYBNE5RA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.272260418 (396h39m15.042901743s) [noise=true , address=104.36.82.20:4451    , piece_id=CVO53ZISRV2ON542CVCHUAUDVZQI2L5KGCRCMZLP4POOBKLZNVFA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.272657718 (396h39m15.043299043s) [noise=true , address=104.36.82.34:4564    , piece_id=CXLC3UUVVIGKA2OP2BQXE7XH7HNHXOJ3O6BQVUNS5NVY4KRPUWIA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.272906815 (396h39m15.04354815s) [noise=true , address=104.36.82.45:4905    , piece_id=YQWZK3R425VYYPSXLTBCNZQUN2IPWYZTNU7NNR5EW5ONIOH7BG3A, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273256314 (396h39m15.043897649s) [noise=true , address=45.91.95.3:4021      , piece_id=W7TAKLK7PEUHTITB74T7HJGOU6WTBPRTFHPQF6VTVM4OTPNYTRWA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273291210 (396h39m15.043932535s) [noise=true , address=45.91.95.2:4017      , piece_id=W52X6YGCDZBSRQEB63HLCQV6CN5JL6JYC2SML5QIRBO5W7CIKDRQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273553742 (396h39m15.044195077s) [noise=true , address=79.127.219.38:4022   , piece_id=72QFHVOHWUNOSLO65KGIXMA7BYR4DTRPVLVAD4EHHZKXX3GAQMFQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273793651 (396h39m15.044434986s) [noise=true , address=104.36.82.44:4885    , piece_id=OZVJDJJLCK46MBKO6TGGHQFSW2QUDQ6GDUHTBZLI7Y5LWBXVPJCQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273834831 (396h39m15.044476156s) [noise=true , address=77.90.31.11:4573     , piece_id=G76LQFRBIKPUKF7CI7DXGL6JRYJOOZJ6SLPAM4Z64CXYJVPW42DA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273869627 (396h39m15.044510962s) [noise=true , address=77.90.31.18:4827     , piece_id=MQJMN3CW2AEP5T74I7WUUBIHFZOLMMKCIN7IOBWZT2VYQARYLIIQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274155423 (396h39m15.044796758s) [noise=true , address=77.90.31.19:4876     , piece_id=ROM6VJDIDOEUEGP3PMEHKEDM5POGHMFNKPYRC3LCIAWIVRUGVBUQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274314117 (396h39m15.044955452s) [noise=true , address=79.127.220.97:4371   , piece_id=XNPEHYQWPTFHLU5TJEO7HZC3MLOLE26GQWI4PI2CUCIL6QTAO7TQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274414660 (396h39m15.045055995s) [noise=true , address=45.91.95.5:4006      , piece_id=JGKTT6OVQ7T2C22UOWG5HPQ67DBF3NPA3OAMALDLQGATY5LT63PA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274653466 (396h39m15.045294791s) [noise=true , address=77.90.31.10:4528     , piece_id=XA7ZR76AK6TYNZDCMKPWNMZELNRGXFUU53L34IFMDWRB4LN3W4RA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274681149 (396h39m15.045322484s) [noise=true , address=45.91.95.4:4021      , piece_id=PFQ3VSEQPTNB4DERVNGT4BCSMZGY3C3OWWJJHVLQTTOCB6TWCMIA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274898425 (396h39m15.04553976s) [noise=true , address=77.90.31.21:4903     , piece_id=LYVWE3A5IAAEZNHB6DZ63XGBH2UQRJRYMJDMRBOJ2BIN3WESS6RQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.275008706 (396h39m15.045650041s) [noise=true , address=77.90.31.13:4652     , piece_id=IVLFU33BFOUXWJEYUUS2AEOZLAVTOKDMEK7RDPEBPOWF34SWNR6Q, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.275332215 (396h39m15.04597355s) [noise=true , address=45.91.116.7:4041     , piece_id=5JXKDZGV2EPLVSDUVP5LDFOGQ66FXPR2GXYEBFF5KWQXUPJNKPMA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:41.657764345 (396h39m16.42840568s) [upload=317350]: Next returned nil segment
Jul  9 21:49:41.657771018 (396h39m16.428412353s) [upload=317350]: Waiting for error group managing segments...
Jul  9 21:49:41.690644980 (396h39m16.461286315s) [noise=true , address=104.36.82.45:4905    , piece_id=YQWZK3R425VYYPSXLTBCNZQUN2IPWYZTNU7NNR5EW5ONIOH7BG3A, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:12ffKESNSVpXQzbwJinP6vvgE6zoF3RFz2NRUuuJHvd7bvk1gc9, address:104.36.82.45:4905): protocol: untrusted: invalid order limit signature: rpcpeer: drpc transport does not have required methods
Jul  9 21:49:42.092098451 (396h39m16.862739786s) [noise=true , address=79.127.220.97:4371   , piece_id=XNPEHYQWPTFHLU5TJEO7HZC3MLOLE26GQWI4PI2CUCIL6QTAO7TQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.266002837 (396h39m17.036644172s) [noise=true , address=77.90.31.19:4876     , piece_id=ROM6VJDIDOEUEGP3PMEHKEDM5POGHMFNKPYRC3LCIAWIVRUGVBUQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.269167210 (396h39m17.039808535s) [noise=true , address=77.90.31.13:4652     , piece_id=IVLFU33BFOUXWJEYUUS2AEOZLAVTOKDMEK7RDPEBPOWF34SWNR6Q, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.278551023 (396h39m17.049192358s) [noise=true , address=77.90.31.10:4528     , piece_id=XA7ZR76AK6TYNZDCMKPWNMZELNRGXFUU53L34IFMDWRB4LN3W4RA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.280070640 (396h39m17.050711975s) [noise=true , address=77.90.31.21:4903     , piece_id=LYVWE3A5IAAEZNHB6DZ63XGBH2UQRJRYMJDMRBOJ2BIN3WESS6RQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.296867786 (396h39m17.067509111s) [noise=true , address=77.90.31.11:4573     , piece_id=G76LQFRBIKPUKF7CI7DXGL6JRYJOOZJ6SLPAM4Z64CXYJVPW42DA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.303116681 (396h39m17.073758016s) [noise=true , address=77.90.31.18:4827     , piece_id=MQJMN3CW2AEP5T74I7WUUBIHFZOLMMKCIN7IOBWZT2VYQARYLIIQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:44.408881294 (396h39m19.179522629s) [noise=true , address=45.91.116.7:4041     , piece_id=5JXKDZGV2EPLVSDUVP5LDFOGQ66FXPR2GXYEBFF5KWQXUPJNKPMA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:44.871597160 (396h39m19.642238495s) [noise=true , address=45.91.95.5:4006      , piece_id=JGKTT6OVQ7T2C22UOWG5HPQ67DBF3NPA3OAMALDLQGATY5LT63PA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:12ViW64JDJxzvRU39MsLp5JZKAmHZmxCAJuLVGi2E1E1r9gfc9A, address:45.91.95.5:4006): protocol: storage node overloaded, request limit: 2000
Jul  9 21:49:51.702994736 (396h39m26.473636071s) [noise=true , address=45.91.116.8:4072     , piece_id=2THWBWLISKLKJFVUAESYPDVBGOSZ2M6AVHMUN2C22S46FYBNE5RA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:55.468073925 (396h39m30.23871526s) [noise=true , address=79.127.219.38:4022   , piece_id=72QFHVOHWUNOSLO65KGIXMA7BYR4DTRPVLVAD4EHHZKXX3GAQMFQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:50:22.315419748 (396h39m57.086061083s) [noise=true , address=104.36.82.34:4564    , piece_id=CXLC3UUVVIGKA2OP2BQXE7XH7HNHXOJ3O6BQVUNS5NVY4KRPUWIA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:50:32.620803316 (396h40m7.391444651s) [noise=true , address=104.36.82.20:4451    , piece_id=CVO53ZISRV2ON542CVCHUAUDVZQI2L5KGCRCMZLP4POOBKLZNVFA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:50:39.176702995 (396h40m13.94734433s) [noise=true , address=45.91.95.4:4021      , piece_id=PFQ3VSEQPTNB4DERVNGT4BCSMZGY3C3OWWJJHVLQTTOCB6TWCMIA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:1dXfFE3nY9ZSEixFePGxdptsrybf38kYjYgV61MzV8kHtc12w, address:45.91.95.4:4021): protocol: expected piece hash; context deadline exceeded; EOF
Jul  9 21:50:39.176724405 (396h40m13.94736573s) [noise=true , address=104.36.82.44:4885    , piece_id=OZVJDJJLCK46MBKO6TGGHQFSW2QUDQ6GDUHTBZLI7Y5LWBXVPJCQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:118qGQLFSNbsYsvFrKjTXXWbFYu2sRaRHrUNkKNCrNVpzVQRtG, address:104.36.82.44:4885): protocol: expected piece hash; context deadline exceeded; EOF
Jul  9 21:50:39.176800822 (396h40m13.947442157s) [noise=true , address=45.91.95.3:4021      , piece_id=W7TAKLK7PEUHTITB74T7HJGOU6WTBPRTFHPQF6VTVM4OTPNYTRWA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:131LBDdhw5s1dsLF2CnAPWaL3Amwm4kvfjyqfTvjkrHSQUjJ2q, address:45.91.95.3:4021): protocol: write tcp 188.166.225.170:52410->45.91.95.3:4021: use of closed network connection; write tcp 188.166.225.170:52410->45.91.95.3:4021: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52410->45.91.95.3:4021: use of closed network connection
Jul  9 21:50:39.176914419 (396h40m13.947555744s) [noise=true , address=45.91.95.2:4017      , piece_id=W52X6YGCDZBSRQEB63HLCQV6CN5JL6JYC2SML5QIRBO5W7CIKDRQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:1vtusfmiftx4cbYbLEzPEpgvmaGQAD9wsJGBCk8r4f1MkY1RL6, address:45.91.95.2:4017): protocol: write tcp 188.166.225.170:33416->45.91.95.2:4017: use of closed network connection; write tcp 188.166.225.170:33416->45.91.95.2:4017: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33416->45.91.95.2:4017: use of closed network connection
Jul  9 21:50:39.176950669 (396h40m13.947591994s) [seg_pos={0 0}, upload=317350]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil>
Jul  9 21:50:39.412544674 (396h40m14.183186009s) [upload=317350]: Done uploading segments...
Jul  9 21:50:39.412568239 (396h40m14.183209574s) [upload=317350]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12)
Duration: 36.667402774s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
8 out of 60 is failed (threshold=3) [.....X....X..X.........X...............X..X....X........X...]
duration: 
48.593266693s
FAIL (2025-07-09 21:51:44 UTC) 
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 48.593287805s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip: 
8 out of 60 is failed (threshold=3) [................X....X...............X..X.X...X...X.......X.]
duration: 
30.624740929s
FAIL (2025-07-09 21:51:10 UTC) 
orbiter warning: 
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 12)
======LOGS======
SegmentBegin
Jul  9 21:49:40.272144307 (396h39m15.042785642s) [seg_pos={0 0}, upload=317350]: Begin upload segment...
Jul  9 21:49:40.272207637 (396h39m15.042848972s) [seg_pos={0 0}, upload=317350]: Done begin upload segment.
Jul  9 21:49:40.272228447 (396h39m15.042869772s) [noise=true , address=45.91.116.8:4072     , piece_id=2THWBWLISKLKJFVUAESYPDVBGOSZ2M6AVHMUN2C22S46FYBNE5RA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.272260418 (396h39m15.042901743s) [noise=true , address=104.36.82.20:4451    , piece_id=CVO53ZISRV2ON542CVCHUAUDVZQI2L5KGCRCMZLP4POOBKLZNVFA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.272657718 (396h39m15.043299043s) [noise=true , address=104.36.82.34:4564    , piece_id=CXLC3UUVVIGKA2OP2BQXE7XH7HNHXOJ3O6BQVUNS5NVY4KRPUWIA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.272906815 (396h39m15.04354815s) [noise=true , address=104.36.82.45:4905    , piece_id=YQWZK3R425VYYPSXLTBCNZQUN2IPWYZTNU7NNR5EW5ONIOH7BG3A, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273256314 (396h39m15.043897649s) [noise=true , address=45.91.95.3:4021      , piece_id=W7TAKLK7PEUHTITB74T7HJGOU6WTBPRTFHPQF6VTVM4OTPNYTRWA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273291210 (396h39m15.043932535s) [noise=true , address=45.91.95.2:4017      , piece_id=W52X6YGCDZBSRQEB63HLCQV6CN5JL6JYC2SML5QIRBO5W7CIKDRQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273553742 (396h39m15.044195077s) [noise=true , address=79.127.219.38:4022   , piece_id=72QFHVOHWUNOSLO65KGIXMA7BYR4DTRPVLVAD4EHHZKXX3GAQMFQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273793651 (396h39m15.044434986s) [noise=true , address=104.36.82.44:4885    , piece_id=OZVJDJJLCK46MBKO6TGGHQFSW2QUDQ6GDUHTBZLI7Y5LWBXVPJCQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273834831 (396h39m15.044476156s) [noise=true , address=77.90.31.11:4573     , piece_id=G76LQFRBIKPUKF7CI7DXGL6JRYJOOZJ6SLPAM4Z64CXYJVPW42DA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273869627 (396h39m15.044510962s) [noise=true , address=77.90.31.18:4827     , piece_id=MQJMN3CW2AEP5T74I7WUUBIHFZOLMMKCIN7IOBWZT2VYQARYLIIQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274155423 (396h39m15.044796758s) [noise=true , address=77.90.31.19:4876     , piece_id=ROM6VJDIDOEUEGP3PMEHKEDM5POGHMFNKPYRC3LCIAWIVRUGVBUQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274314117 (396h39m15.044955452s) [noise=true , address=79.127.220.97:4371   , piece_id=XNPEHYQWPTFHLU5TJEO7HZC3MLOLE26GQWI4PI2CUCIL6QTAO7TQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274414660 (396h39m15.045055995s) [noise=true , address=45.91.95.5:4006      , piece_id=JGKTT6OVQ7T2C22UOWG5HPQ67DBF3NPA3OAMALDLQGATY5LT63PA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274653466 (396h39m15.045294791s) [noise=true , address=77.90.31.10:4528     , piece_id=XA7ZR76AK6TYNZDCMKPWNMZELNRGXFUU53L34IFMDWRB4LN3W4RA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274681149 (396h39m15.045322484s) [noise=true , address=45.91.95.4:4021      , piece_id=PFQ3VSEQPTNB4DERVNGT4BCSMZGY3C3OWWJJHVLQTTOCB6TWCMIA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274898425 (396h39m15.04553976s) [noise=true , address=77.90.31.21:4903     , piece_id=LYVWE3A5IAAEZNHB6DZ63XGBH2UQRJRYMJDMRBOJ2BIN3WESS6RQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.275008706 (396h39m15.045650041s) [noise=true , address=77.90.31.13:4652     , piece_id=IVLFU33BFOUXWJEYUUS2AEOZLAVTOKDMEK7RDPEBPOWF34SWNR6Q, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.275332215 (396h39m15.04597355s) [noise=true , address=45.91.116.7:4041     , piece_id=5JXKDZGV2EPLVSDUVP5LDFOGQ66FXPR2GXYEBFF5KWQXUPJNKPMA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:41.657764345 (396h39m16.42840568s) [upload=317350]: Next returned nil segment
Jul  9 21:49:41.657771018 (396h39m16.428412353s) [upload=317350]: Waiting for error group managing segments...
Jul  9 21:49:41.690644980 (396h39m16.461286315s) [noise=true , address=104.36.82.45:4905    , piece_id=YQWZK3R425VYYPSXLTBCNZQUN2IPWYZTNU7NNR5EW5ONIOH7BG3A, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:12ffKESNSVpXQzbwJinP6vvgE6zoF3RFz2NRUuuJHvd7bvk1gc9, address:104.36.82.45:4905): protocol: untrusted: invalid order limit signature: rpcpeer: drpc transport does not have required methods
Jul  9 21:49:42.092098451 (396h39m16.862739786s) [noise=true , address=79.127.220.97:4371   , piece_id=XNPEHYQWPTFHLU5TJEO7HZC3MLOLE26GQWI4PI2CUCIL6QTAO7TQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.266002837 (396h39m17.036644172s) [noise=true , address=77.90.31.19:4876     , piece_id=ROM6VJDIDOEUEGP3PMEHKEDM5POGHMFNKPYRC3LCIAWIVRUGVBUQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.269167210 (396h39m17.039808535s) [noise=true , address=77.90.31.13:4652     , piece_id=IVLFU33BFOUXWJEYUUS2AEOZLAVTOKDMEK7RDPEBPOWF34SWNR6Q, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.278551023 (396h39m17.049192358s) [noise=true , address=77.90.31.10:4528     , piece_id=XA7ZR76AK6TYNZDCMKPWNMZELNRGXFUU53L34IFMDWRB4LN3W4RA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.280070640 (396h39m17.050711975s) [noise=true , address=77.90.31.21:4903     , piece_id=LYVWE3A5IAAEZNHB6DZ63XGBH2UQRJRYMJDMRBOJ2BIN3WESS6RQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.296867786 (396h39m17.067509111s) [noise=true , address=77.90.31.11:4573     , piece_id=G76LQFRBIKPUKF7CI7DXGL6JRYJOOZJ6SLPAM4Z64CXYJVPW42DA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.303116681 (396h39m17.073758016s) [noise=true , address=77.90.31.18:4827     , piece_id=MQJMN3CW2AEP5T74I7WUUBIHFZOLMMKCIN7IOBWZT2VYQARYLIIQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:44.408881294 (396h39m19.179522629s) [noise=true , address=45.91.116.7:4041     , piece_id=5JXKDZGV2EPLVSDUVP5LDFOGQ66FXPR2GXYEBFF5KWQXUPJNKPMA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:44.871597160 (396h39m19.642238495s) [noise=true , address=45.91.95.5:4006      , piece_id=JGKTT6OVQ7T2C22UOWG5HPQ67DBF3NPA3OAMALDLQGATY5LT63PA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:12ViW64JDJxzvRU39MsLp5JZKAmHZmxCAJuLVGi2E1E1r9gfc9A, address:45.91.95.5:4006): protocol: storage node overloaded, request limit: 2000
Jul  9 21:49:51.702994736 (396h39m26.473636071s) [noise=true , address=45.91.116.8:4072     , piece_id=2THWBWLISKLKJFVUAESYPDVBGOSZ2M6AVHMUN2C22S46FYBNE5RA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:55.468073925 (396h39m30.23871526s) [noise=true , address=79.127.219.38:4022   , piece_id=72QFHVOHWUNOSLO65KGIXMA7BYR4DTRPVLVAD4EHHZKXX3GAQMFQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:50:22.315419748 (396h39m57.086061083s) [noise=true , address=104.36.82.34:4564    , piece_id=CXLC3UUVVIGKA2OP2BQXE7XH7HNHXOJ3O6BQVUNS5NVY4KRPUWIA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:50:32.620803316 (396h40m7.391444651s) [noise=true , address=104.36.82.20:4451    , piece_id=CVO53ZISRV2ON542CVCHUAUDVZQI2L5KGCRCMZLP4POOBKLZNVFA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:50:39.176702995 (396h40m13.94734433s) [noise=true , address=45.91.95.4:4021      , piece_id=PFQ3VSEQPTNB4DERVNGT4BCSMZGY3C3OWWJJHVLQTTOCB6TWCMIA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:1dXfFE3nY9ZSEixFePGxdptsrybf38kYjYgV61MzV8kHtc12w, address:45.91.95.4:4021): protocol: expected piece hash; context deadline exceeded; EOF
Jul  9 21:50:39.176724405 (396h40m13.94736573s) [noise=true , address=104.36.82.44:4885    , piece_id=OZVJDJJLCK46MBKO6TGGHQFSW2QUDQ6GDUHTBZLI7Y5LWBXVPJCQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:118qGQLFSNbsYsvFrKjTXXWbFYu2sRaRHrUNkKNCrNVpzVQRtG, address:104.36.82.44:4885): protocol: expected piece hash; context deadline exceeded; EOF
Jul  9 21:50:39.176800822 (396h40m13.947442157s) [noise=true , address=45.91.95.3:4021      , piece_id=W7TAKLK7PEUHTITB74T7HJGOU6WTBPRTFHPQF6VTVM4OTPNYTRWA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:131LBDdhw5s1dsLF2CnAPWaL3Amwm4kvfjyqfTvjkrHSQUjJ2q, address:45.91.95.3:4021): protocol: write tcp 188.166.225.170:52410->45.91.95.3:4021: use of closed network connection; write tcp 188.166.225.170:52410->45.91.95.3:4021: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52410->45.91.95.3:4021: use of closed network connection
Jul  9 21:50:39.176914419 (396h40m13.947555744s) [noise=true , address=45.91.95.2:4017      , piece_id=W52X6YGCDZBSRQEB63HLCQV6CN5JL6JYC2SML5QIRBO5W7CIKDRQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:1vtusfmiftx4cbYbLEzPEpgvmaGQAD9wsJGBCk8r4f1MkY1RL6, address:45.91.95.2:4017): protocol: write tcp 188.166.225.170:33416->45.91.95.2:4017: use of closed network connection; write tcp 188.166.225.170:33416->45.91.95.2:4017: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33416->45.91.95.2:4017: use of closed network connection
Jul  9 21:50:39.176950669 (396h40m13.947591994s) [seg_pos={0 0}, upload=317350]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil>
Jul  9 21:50:39.412544674 (396h40m14.183186009s) [upload=317350]: Done uploading segments...
Jul  9 21:50:39.412568239 (396h40m14.183209574s) [upload=317350]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12)
Duration: 30.624758173s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
8 out of 60 is failed (threshold=3) [......X....X..X.........X...............X..X....X........X..]
duration: 
57.067785042s
FAIL (2025-07-09 21:50:44 UTC) 
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 57.067798547s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip: 
9 out of 60 is failed (threshold=3) [X................X....X...............X..X.X...X...X.......X]
duration: 
1m0.237112493s
FAIL (2025-07-09 21:50:39 UTC) 
orbiter warning: 
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 12)
======LOGS======
SegmentBegin
Jul  9 21:49:40.272144307 (396h39m15.042785642s) [seg_pos={0 0}, upload=317350]: Begin upload segment...
Jul  9 21:49:40.272207637 (396h39m15.042848972s) [seg_pos={0 0}, upload=317350]: Done begin upload segment.
Jul  9 21:49:40.272228447 (396h39m15.042869772s) [noise=true , address=45.91.116.8:4072     , piece_id=2THWBWLISKLKJFVUAESYPDVBGOSZ2M6AVHMUN2C22S46FYBNE5RA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.272260418 (396h39m15.042901743s) [noise=true , address=104.36.82.20:4451    , piece_id=CVO53ZISRV2ON542CVCHUAUDVZQI2L5KGCRCMZLP4POOBKLZNVFA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.272657718 (396h39m15.043299043s) [noise=true , address=104.36.82.34:4564    , piece_id=CXLC3UUVVIGKA2OP2BQXE7XH7HNHXOJ3O6BQVUNS5NVY4KRPUWIA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.272906815 (396h39m15.04354815s) [noise=true , address=104.36.82.45:4905    , piece_id=YQWZK3R425VYYPSXLTBCNZQUN2IPWYZTNU7NNR5EW5ONIOH7BG3A, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273256314 (396h39m15.043897649s) [noise=true , address=45.91.95.3:4021      , piece_id=W7TAKLK7PEUHTITB74T7HJGOU6WTBPRTFHPQF6VTVM4OTPNYTRWA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273291210 (396h39m15.043932535s) [noise=true , address=45.91.95.2:4017      , piece_id=W52X6YGCDZBSRQEB63HLCQV6CN5JL6JYC2SML5QIRBO5W7CIKDRQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273553742 (396h39m15.044195077s) [noise=true , address=79.127.219.38:4022   , piece_id=72QFHVOHWUNOSLO65KGIXMA7BYR4DTRPVLVAD4EHHZKXX3GAQMFQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273793651 (396h39m15.044434986s) [noise=true , address=104.36.82.44:4885    , piece_id=OZVJDJJLCK46MBKO6TGGHQFSW2QUDQ6GDUHTBZLI7Y5LWBXVPJCQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273834831 (396h39m15.044476156s) [noise=true , address=77.90.31.11:4573     , piece_id=G76LQFRBIKPUKF7CI7DXGL6JRYJOOZJ6SLPAM4Z64CXYJVPW42DA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.273869627 (396h39m15.044510962s) [noise=true , address=77.90.31.18:4827     , piece_id=MQJMN3CW2AEP5T74I7WUUBIHFZOLMMKCIN7IOBWZT2VYQARYLIIQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274155423 (396h39m15.044796758s) [noise=true , address=77.90.31.19:4876     , piece_id=ROM6VJDIDOEUEGP3PMEHKEDM5POGHMFNKPYRC3LCIAWIVRUGVBUQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274314117 (396h39m15.044955452s) [noise=true , address=79.127.220.97:4371   , piece_id=XNPEHYQWPTFHLU5TJEO7HZC3MLOLE26GQWI4PI2CUCIL6QTAO7TQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274414660 (396h39m15.045055995s) [noise=true , address=45.91.95.5:4006      , piece_id=JGKTT6OVQ7T2C22UOWG5HPQ67DBF3NPA3OAMALDLQGATY5LT63PA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274653466 (396h39m15.045294791s) [noise=true , address=77.90.31.10:4528     , piece_id=XA7ZR76AK6TYNZDCMKPWNMZELNRGXFUU53L34IFMDWRB4LN3W4RA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274681149 (396h39m15.045322484s) [noise=true , address=45.91.95.4:4021      , piece_id=PFQ3VSEQPTNB4DERVNGT4BCSMZGY3C3OWWJJHVLQTTOCB6TWCMIA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.274898425 (396h39m15.04553976s) [noise=true , address=77.90.31.21:4903     , piece_id=LYVWE3A5IAAEZNHB6DZ63XGBH2UQRJRYMJDMRBOJ2BIN3WESS6RQ, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.275008706 (396h39m15.045650041s) [noise=true , address=77.90.31.13:4652     , piece_id=IVLFU33BFOUXWJEYUUS2AEOZLAVTOKDMEK7RDPEBPOWF34SWNR6Q, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:40.275332215 (396h39m15.04597355s) [noise=true , address=45.91.116.7:4041     , piece_id=5JXKDZGV2EPLVSDUVP5LDFOGQ66FXPR2GXYEBFF5KWQXUPJNKPMA, seg_pos={0 0}, upload=317350]: Uploading piece...
Jul  9 21:49:41.657764345 (396h39m16.42840568s) [upload=317350]: Next returned nil segment
Jul  9 21:49:41.657771018 (396h39m16.428412353s) [upload=317350]: Waiting for error group managing segments...
Jul  9 21:49:41.690644980 (396h39m16.461286315s) [noise=true , address=104.36.82.45:4905    , piece_id=YQWZK3R425VYYPSXLTBCNZQUN2IPWYZTNU7NNR5EW5ONIOH7BG3A, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:12ffKESNSVpXQzbwJinP6vvgE6zoF3RFz2NRUuuJHvd7bvk1gc9, address:104.36.82.45:4905): protocol: untrusted: invalid order limit signature: rpcpeer: drpc transport does not have required methods
Jul  9 21:49:42.092098451 (396h39m16.862739786s) [noise=true , address=79.127.220.97:4371   , piece_id=XNPEHYQWPTFHLU5TJEO7HZC3MLOLE26GQWI4PI2CUCIL6QTAO7TQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.266002837 (396h39m17.036644172s) [noise=true , address=77.90.31.19:4876     , piece_id=ROM6VJDIDOEUEGP3PMEHKEDM5POGHMFNKPYRC3LCIAWIVRUGVBUQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.269167210 (396h39m17.039808535s) [noise=true , address=77.90.31.13:4652     , piece_id=IVLFU33BFOUXWJEYUUS2AEOZLAVTOKDMEK7RDPEBPOWF34SWNR6Q, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.278551023 (396h39m17.049192358s) [noise=true , address=77.90.31.10:4528     , piece_id=XA7ZR76AK6TYNZDCMKPWNMZELNRGXFUU53L34IFMDWRB4LN3W4RA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.280070640 (396h39m17.050711975s) [noise=true , address=77.90.31.21:4903     , piece_id=LYVWE3A5IAAEZNHB6DZ63XGBH2UQRJRYMJDMRBOJ2BIN3WESS6RQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.296867786 (396h39m17.067509111s) [noise=true , address=77.90.31.11:4573     , piece_id=G76LQFRBIKPUKF7CI7DXGL6JRYJOOZJ6SLPAM4Z64CXYJVPW42DA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:42.303116681 (396h39m17.073758016s) [noise=true , address=77.90.31.18:4827     , piece_id=MQJMN3CW2AEP5T74I7WUUBIHFZOLMMKCIN7IOBWZT2VYQARYLIIQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:44.408881294 (396h39m19.179522629s) [noise=true , address=45.91.116.7:4041     , piece_id=5JXKDZGV2EPLVSDUVP5LDFOGQ66FXPR2GXYEBFF5KWQXUPJNKPMA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:44.871597160 (396h39m19.642238495s) [noise=true , address=45.91.95.5:4006      , piece_id=JGKTT6OVQ7T2C22UOWG5HPQ67DBF3NPA3OAMALDLQGATY5LT63PA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:12ViW64JDJxzvRU39MsLp5JZKAmHZmxCAJuLVGi2E1E1r9gfc9A, address:45.91.95.5:4006): protocol: storage node overloaded, request limit: 2000
Jul  9 21:49:51.702994736 (396h39m26.473636071s) [noise=true , address=45.91.116.8:4072     , piece_id=2THWBWLISKLKJFVUAESYPDVBGOSZ2M6AVHMUN2C22S46FYBNE5RA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:49:55.468073925 (396h39m30.23871526s) [noise=true , address=79.127.219.38:4022   , piece_id=72QFHVOHWUNOSLO65KGIXMA7BYR4DTRPVLVAD4EHHZKXX3GAQMFQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:50:22.315419748 (396h39m57.086061083s) [noise=true , address=104.36.82.34:4564    , piece_id=CXLC3UUVVIGKA2OP2BQXE7XH7HNHXOJ3O6BQVUNS5NVY4KRPUWIA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:50:32.620803316 (396h40m7.391444651s) [noise=true , address=104.36.82.20:4451    , piece_id=CVO53ZISRV2ON542CVCHUAUDVZQI2L5KGCRCMZLP4POOBKLZNVFA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: <nil>
Jul  9 21:50:39.176702995 (396h40m13.94734433s) [noise=true , address=45.91.95.4:4021      , piece_id=PFQ3VSEQPTNB4DERVNGT4BCSMZGY3C3OWWJJHVLQTTOCB6TWCMIA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:1dXfFE3nY9ZSEixFePGxdptsrybf38kYjYgV61MzV8kHtc12w, address:45.91.95.4:4021): protocol: expected piece hash; context deadline exceeded; EOF
Jul  9 21:50:39.176724405 (396h40m13.94736573s) [noise=true , address=104.36.82.44:4885    , piece_id=OZVJDJJLCK46MBKO6TGGHQFSW2QUDQ6GDUHTBZLI7Y5LWBXVPJCQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:118qGQLFSNbsYsvFrKjTXXWbFYu2sRaRHrUNkKNCrNVpzVQRtG, address:104.36.82.44:4885): protocol: expected piece hash; context deadline exceeded; EOF
Jul  9 21:50:39.176800822 (396h40m13.947442157s) [noise=true , address=45.91.95.3:4021      , piece_id=W7TAKLK7PEUHTITB74T7HJGOU6WTBPRTFHPQF6VTVM4OTPNYTRWA, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:131LBDdhw5s1dsLF2CnAPWaL3Amwm4kvfjyqfTvjkrHSQUjJ2q, address:45.91.95.3:4021): protocol: write tcp 188.166.225.170:52410->45.91.95.3:4021: use of closed network connection; write tcp 188.166.225.170:52410->45.91.95.3:4021: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52410->45.91.95.3:4021: use of closed network connection
Jul  9 21:50:39.176914419 (396h40m13.947555744s) [noise=true , address=45.91.95.2:4017      , piece_id=W52X6YGCDZBSRQEB63HLCQV6CN5JL6JYC2SML5QIRBO5W7CIKDRQ, seg_pos={0 0}, upload=317350]: Done uploading piece. err: ecclient: upload failed (node:1vtusfmiftx4cbYbLEzPEpgvmaGQAD9wsJGBCk8r4f1MkY1RL6, address:45.91.95.2:4017): protocol: write tcp 188.166.225.170:33416->45.91.95.2:4017: use of closed network connection; write tcp 188.166.225.170:33416->45.91.95.2:4017: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33416->45.91.95.2:4017: use of closed network connection
Jul  9 21:50:39.176950669 (396h40m13.947591994s) [seg_pos={0 0}, upload=317350]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil>
Jul  9 21:50:39.412544674 (396h40m14.183186009s) [upload=317350]: Done uploading segments...
Jul  9 21:50:39.412568239 (396h40m14.183209574s) [upload=317350]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12)
Duration: 1m0.237135427s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
9 out of 60 is failed (threshold=3) [X......X....X..X.........X...............X..X....X........X.]
duration: 
58.68449521s
FAIL (2025-07-09 21:49:47 UTC) 
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 58.684510099s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip: 
8 out of 60 is failed (threshold=3) [.X................X....X...............X..X.X...X...X.......]
duration: 
34.14993293s
FAIL (2025-07-09 21:49:17 UTC) 
orbiter warning: 
======ERROR======
uplink: context deadline exceeded
======LOGS======
17258]: Got next segment. Inline: false
Jul  9 21:42:48.387406701 (396h32m23.158048036s) [upload=317258]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  9 21:42:48.387413103 (396h32m23.158054439s) [upload=317258]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  9 21:42:48.834299395 (396h32m23.60494072s) [seg_pos={0 0}, upload=317258]: Begin upload segment...
Jul  9 21:42:48.834354481 (396h32m23.604995816s) [seg_pos={0 0}, upload=317258]: Done begin upload segment.
Jul  9 21:42:48.834374599 (396h32m23.605015924s) [noise=true , address=77.90.31.10:4523     , piece_id=SKESIP2VBIDJIBXIEGMC2LZESW47O7WJCLSBQBSWLHYWV4PRT7FQ, seg_pos={0 0}, upload=317258]: Uploading piece...
Jul  9 21:42:48.834761038 (396h32m23.605402363s) [noise=true , address=77.90.31.21:4908     , piece_id=HGKISLD6DZXJ6DL4UCZWUJD2V5CTDYRX2BSKDCDJYXCQQBX6Q3RA, seg_pos={0 0}, upload=317258]: Uploading piece...
Jul  9 21:42:48.835061884 (396h32m23.605703219s) [noise=true , address=79.127.201.215:4345  , piece_id=WEQTKXLED3S6W4HMRFM7YUEXBWGUUMQL65E4U4FG27AVCZFRK72A, seg_pos={0 0}, upload=317258]: Uploading piece...
Jul  9 21:42:48.835344354 (396h32m23.605985689s) [noise=true , address=104.36.82.23:4474    , piece_id=JJNF2423XB5JQXQJ3VWRUYGLZ2QR5SFPN7BUJO4GRPSDST6IFBCA, seg_pos={0 0}, upload=317258]: Uploading piece...
Jul  9 21:42:48.835641913 (396h32m23.606283248s) [noise=true , address=45.91.95.2:4022      , piece_id=UJ6PKLMNBID76O3ZR4SXRNLL3CCLNGTYBZSN57E2YBD57TDLKTPQ, seg_pos={0 0}, upload=317258]: Uploading piece...
Jul  9 21:42:48.835925006 (396h32m23.606566341s) [noise=true , address=77.90.31.14:4667     , piece_id=3XNOC4TIZJFEMIJQIMYHYNXA3SD72IYKBVBVWZ5J7NKVG5XOQYMA, seg_pos={0 0}, upload=317258]: Uploading piece...
Jul  9 21:42:48.836153993 (396h32m23.606795328s) [noise=true , address=104.36.82.38:4716    , piece_id=FK7WLNN6677LINQJ26LPGZ5X4JJ7ISGDRUHMVQTGK34OTL44EF6A, seg_pos={0 0}, upload=317258]: Uploading piece...
Jul  9 21:42:48.836372001 (396h32m23.607013336s) [noise=true , address=77.90.31.18:4810     , piece_id=33CXTR5YAVMPV3VGG23FMKLGAKR355O66PAHFZPKVQSFJGQIEYLQ, seg_pos={0 0}, upload=317258]: Uploading piece...
Jul  9 21:42:48.836627199 (396h32m23.607268524s) [noise=true , address=77.90.31.16:4768     , piece_id=LOU4TXWNZRUAIB7BVVZXKEVZSBL44DKOIITBGOCPDPM73L7CYRYQ, seg_pos={0 0}, upload=317258]: Uploading piece...
Jul  9 21:42:48.836860434 (396h32m23.607501759s) [noise=true , address=77.90.31.13:4640     , piece_id=XCMFSHLM372AAMNYL2YVGRUSGWT7RB4RE4TMZ6ONHPVNR26NKUAQ, seg_pos={0 0}, upload=317258]: Uploading piece...
Jul  9 21:42:48.837076287 (396h32m23.607717623s) [noise=true , address=45.91.95.5:4026      , piece_id=QQWGIQENU5TGALRAU4SRUFWJDQYOPW552SN46COWCRFNFBRRPBFA, seg_pos={0 0}, upload=317258]: Uploading piece...
Jul  9 21:42:48.837281300 (396h32m23.607922635s) [noise=true , address=79.127.220.101:4073  , piece_id=NNWGURWIPMP67UIQGVHZPFZJBD2QFOGBQ6KZNNTHLJXCGRIDTXZQ, seg_pos={0 0}, upload=317258]: Uploading piece...
Jul  9 21:42:48.837494658 (396h32m23.608135993s) [noise=true , address=104.36.82.18:4396    , piece_id=2DRRKEK2OLFL54G6BQIIQLEPONIHDUICJUVAEAONC2IOR22POPLA, seg_pos={0 0}, upload=317258]: Uploading piece...
Jul  9 21:42:48.837859957 (396h32m23.608501292s) [noise=true , address=45.91.95.4:4014      , piece_id=V5ZNHUMTQCZ5YXOYDAYCFKBBSAUKHJ2RJ3FSQNME6IXSGFSLIJ4Q, seg_pos={0 0}, upload=317258]: Uploading piece...
Jul  9 21:42:48.838145814 (396h32m23.608787139s) [noise=true , address=77.90.31.18:4838     , piece_id=EGYCA5GBMRI3JPX3SHKQ57GU6ZQV6S33BJNOJVUJHESMEKZU5WTQ, seg_pos={0 0}, upload=317258]: Uploading piece...
Jul  9 21:42:48.838416161 (396h32m23.609057486s) [noise=true , address=45.91.95.3:4019      , piece_id=3XZWJLZH5RXX45ULYQLXAG4SG2RNMOGWXLNFTOVCVKZ2QUQOC6KQ, seg_pos={0 0}, upload=317258]: Uploading piece...
Jul  9 21:42:48.838665709 (396h32m23.609307044s) [noise=true , address=77.90.31.19:4852     , piece_id=MQ7OIWIHD642LXDOEBKZF2DTZRLR5OJT4Q37DCLLDXR7XTJVKXKA, seg_pos={0 0}, upload=317258]: Uploading piece...
Jul  9 21:42:48.838944833 (396h32m23.609586168s) [noise=true , address=77.90.31.12:4621     , piece_id=CL234SZAWOTG4ONGWQ2ZBXEGWUYTQQVR76BVCHAPXETRGF5TQJBQ, seg_pos={0 0}, upload=317258]: Uploading piece...
Jul  9 21:42:50.183574564 (396h32m24.954215899s) [upload=317258]: Next returned nil segment
Jul  9 21:42:50.183596435 (396h32m24.95423777s) [upload=317258]: Waiting for error group managing segments...
Jul  9 21:42:50.548527303 (396h32m25.319168638s) [noise=true , address=79.127.220.101:4073  , piece_id=NNWGURWIPMP67UIQGVHZPFZJBD2QFOGBQ6KZNNTHLJXCGRIDTXZQ, seg_pos={0 0}, upload=317258]: Done uploading piece. err: <nil>
Jul  9 21:42:50.840602026 (396h32m25.611243361s) [noise=true , address=77.90.31.18:4838     , piece_id=EGYCA5GBMRI3JPX3SHKQ57GU6ZQV6S33BJNOJVUJHESMEKZU5WTQ, seg_pos={0 0}, upload=317258]: Done uploading piece. err: <nil>
Jul  9 21:42:50.841968832 (396h32m25.612610167s) [noise=true , address=77.90.31.18:4810     , piece_id=33CXTR5YAVMPV3VGG23FMKLGAKR355O66PAHFZPKVQSFJGQIEYLQ, seg_pos={0 0}, upload=317258]: Done uploading piece. err: <nil>
Jul  9 21:42:50.842708556 (396h32m25.613349951s) [noise=true , address=77.90.31.13:4640     , piece_id=XCMFSHLM372AAMNYL2YVGRUSGWT7RB4RE4TMZ6ONHPVNR26NKUAQ, seg_pos={0 0}, upload=317258]: Done uploading piece. err: <nil>
Jul  9 21:42:50.843190929 (396h32m25.613832265s) [noise=true , address=77.90.31.14:4667     , piece_id=3XNOC4TIZJFEMIJQIMYHYNXA3SD72IYKBVBVWZ5J7NKVG5XOQYMA, seg_pos={0 0}, upload=317258]: Done uploading piece. err: <nil>
Jul  9 21:42:50.844590978 (396h32m25.615232313s) [noise=true , address=77.90.31.10:4523     , piece_id=SKESIP2VBIDJIBXIEGMC2LZESW47O7WJCLSBQBSWLHYWV4PRT7FQ, seg_pos={0 0}, upload=317258]: Done uploading piece. err: <nil>
Jul  9 21:42:50.845022593 (396h32m25.615663928s) [noise=true , address=77.90.31.19:4852     , piece_id=MQ7OIWIHD642LXDOEBKZF2DTZRLR5OJT4Q37DCLLDXR7XTJVKXKA, seg_pos={0 0}, upload=317258]: Done uploading piece. err: <nil>
Jul  9 21:42:50.846516732 (396h32m25.617158067s) [noise=true , address=77.90.31.12:4621     , piece_id=CL234SZAWOTG4ONGWQ2ZBXEGWUYTQQVR76BVCHAPXETRGF5TQJBQ, seg_pos={0 0}, upload=317258]: Done uploading piece. err: <nil>
Jul  9 21:42:50.847220148 (396h32m25.617861473s) [noise=true , address=77.90.31.21:4908     , piece_id=HGKISLD6DZXJ6DL4UCZWUJD2V5CTDYRX2BSKDCDJYXCQQBX6Q3RA, seg_pos={0 0}, upload=317258]: Done uploading piece. err: <nil>
Jul  9 21:42:50.847310801 (396h32m25.617952126s) [noise=true , address=77.90.31.16:4768     , piece_id=LOU4TXWNZRUAIB7BVVZXKEVZSBL44DKOIITBGOCPDPM73L7CYRYQ, seg_pos={0 0}, upload=317258]: Done uploading piece. err: <nil>
Jul  9 21:42:55.315575878 (396h32m30.086217213s) [noise=true , address=79.127.201.215:4345  , piece_id=WEQTKXLED3S6W4HMRFM7YUEXBWGUUMQL65E4U4FG27AVCZFRK72A, seg_pos={0 0}, upload=317258]: Done uploading piece. err: <nil>
Jul  9 21:43:12.086886240 (396h32m46.857527576s) [noise=true , address=104.36.82.23:4474    , piece_id=JJNF2423XB5JQXQJ3VWRUYGLZ2QR5SFPN7BUJO4GRPSDST6IFBCA, seg_pos={0 0}, upload=317258]: Done uploading piece. err: <nil>
Jul  9 21:43:29.357614308 (396h33m4.128255643s) [noise=true , address=104.36.82.18:4396    , piece_id=2DRRKEK2OLFL54G6BQIIQLEPONIHDUICJUVAEAONC2IOR22POPLA, seg_pos={0 0}, upload=317258]: Done uploading piece. err: <nil>
Jul  9 21:43:38.089997559 (396h33m12.860638884s) [noise=true , address=45.91.95.4:4014      , piece_id=V5ZNHUMTQCZ5YXOYDAYCFKBBSAUKHJ2RJ3FSQNME6IXSGFSLIJ4Q, seg_pos={0 0}, upload=317258]: Done uploading piece. err: <nil>
Jul  9 21:43:38.090021875 (396h33m12.86066321s) [seg_pos={0 0}, upload=317258]: Segment reached optimal threshold of 14 pieces.
Jul  9 21:43:38.090108922 (396h33m12.860750257s) [noise=true , address=45.91.95.5:4026      , piece_id=QQWGIQENU5TGALRAU4SRUFWJDQYOPW552SN46COWCRFNFBRRPBFA, seg_pos={0 0}, upload=317258]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xxtZ3msZnUkE4kgTFKJmprcNS986Uhi1LjwVyd1DbrTfZS52H): protocol: expected piece hash; context canceled; EOF
Jul  9 21:43:38.090133739 (396h33m12.860775074s) [noise=true , address=104.36.82.38:4716    , piece_id=FK7WLNN6677LINQJ26LPGZ5X4JJ7ISGDRUHMVQTGK34OTL44EF6A, seg_pos={0 0}, upload=317258]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MAHcnhvjvD74dpLS5S3m751NzfjvJ8a9ZvHwA7mdXUEXm9DAX): protocol: expected piece hash; context canceled; EOF
Jul  9 21:43:38.090161603 (396h33m12.860802938s) [noise=true , address=45.91.95.3:4019      , piece_id=3XZWJLZH5RXX45ULYQLXAG4SG2RNMOGWXLNFTOVCVKZ2QUQOC6KQ, seg_pos={0 0}, upload=317258]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SGjoGjbfugbxFgDctHygi7qo8upC463TRw8sEceUNnti1iGV1): protocol: expected piece hash; context canceled; EOF
Jul  9 21:43:38.090225525 (396h33m12.86086685s) [noise=true , address=45.91.95.2:4022      , piece_id=UJ6PKLMNBID76O3ZR4SXRNLL3CCLNGTYBZSN57E2YBD57TDLKTPQ, seg_pos={0 0}, upload=317258]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XGBvsxi6S7dz9d93CWmnQhomJVg1x5evu7DxsGsujkejBkZVN): protocol: write tcp 188.166.225.170:50926->45.91.95.2:4022: use of closed network connection; write tcp 188.166.225.170:50926->45.91.95.2:4022: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50926->45.91.95.2:4022: use of closed network connection
Jul  9 21:43:38.090246715 (396h33m12.860888051s) [seg_pos={0 0}, upload=317258]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul  9 21:43:38.090334674 (396h33m12.860976009s) [upload=317258]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  9 21:43:38.090338631 (396h33m12.860979956s) [upload=317258]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  9 21:43:38.379746682 (396h33m13.150388017s) [upload=317258]: Done uploading segments...
Jul  9 21:43:38.379765919 (396h33m13.150407254s) [upload=317258]: Upload finished. err: <nil>
Duration: 34.149946444s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
9 out of 60 is failed (threshold=3) [.X......X....X..X.........X...............X..X....X........X]
duration: 
1m0.000976134s
FAIL (2025-07-09 21:48:48 UTC) 
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1m0.000987185s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip: 
8 out of 60 is failed (threshold=3) [..X................X....X...............X..X.X...X...X......]
duration: 
48.26210004s
FAIL (2025-07-09 21:48:43 UTC) 
orbiter warning: 
======ERROR======
uplink: context deadline exceeded
======LOGS======
17258]: Got next segment. Inline: false
Jul  9 21:42:48.387406701 (396h32m23.158048036s) [upload=317258]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  9 21:42:48.387413103 (396h32m23.158054439s) [upload=317258]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  9 21:42:48.834299395 (396h32m23.60494072s) [seg_pos={0 0}, upload=317258]: Begin upload segment...
Jul  9 21:42:48.834354481 (396h32m23.604995816s) [seg_pos={0 0}, upload=317258]: Done begin upload segment.
Jul  9 21:42:48.834374599 (396h32m23.605015924s) [noise=true , address=77.90.31.10:4523     , piece_id=SKESIP2VBIDJIBXIEGMC2LZESW47O7WJCLSBQBSWLHYWV4PRT7FQ, seg_pos={0 0}, upload=317258]: Uploading piece...
Jul  9 21:42:48.834761038 (396h32m23.605402363s) [noise=true , address=77.90.31.21:4908     , piece_id=HGKISLD6DZXJ6DL4UCZWUJD2V5CTDYRX2BSKDCDJYXCQQBX6Q3RA, seg_pos={0 0}, upload=317258]: Uploading piece...
Jul  9 21:42:48.835061884 (396h32m23.605703219s) [noise=true , address=79.127.201.215:4345  , piece_id=WEQTKXLED3S6W4HMRFM7YUEXBWGUUMQL65E4U4FG27AVCZFRK72A, seg_pos={0 0}, upload=317258]: Uploading piece...
Jul  9 21:42:48.835344354 (396h32m23.605985689s) [noise=true , address=104.36.82.23:4474    , piece_id=JJNF2423XB5JQXQJ3VWRUYGLZ2QR5SFPN7BUJO4GRPSDST6IFBCA, seg_pos={0 0}, upload=317258]: Uploading piece...
Jul  9 21:42:48.835641913 (396h32m23.606283248s) [noise=true , address=45.91.95.2:4022      , piece_id=UJ6PKLMNBID76O3ZR4SXRNLL3CCLNGTYBZSN57E2YBD57TDLKTPQ, seg_pos={0 0}, upload=317258]: Uploading piece...
Jul  9 21:42:48.835925006 (396h32m23.606566341s) [noise=true , address=77.90.31.14:4667     , piece_id=3XNOC4TIZJFEMIJQIMYHYNXA3SD72IYKBVBVWZ5J7NKVG5XOQYMA, seg_pos={0 0}, upload=317258]: Uploading piece...
Jul  9 21:42:48.836153993 (396h32m23.606795328s) [noise=true , address=104.36.82.38:4716    , piece_id=FK7WLNN6677LINQJ26LPGZ5X4JJ7ISGDRUHMVQTGK34OTL44EF6A, seg_pos={0 0}, upload=317258]: Uploading piece...
Jul  9 21:42:48.836372001 (396h32m23.607013336s) [noise=true , address=77.90.31.18:4810     , piece_id=33CXTR5YAVMPV3VGG23FMKLGAKR355O66PAHFZPKVQSFJGQIEYLQ, seg_pos={0 0}, upload=317258]: Uploading piece...
Jul  9 21:42:48.836627199 (396h32m23.607268524s) [noise=true , address=77.90.31.16:4768     , piece_id=LOU4TXWNZRUAIB7BVVZXKEVZSBL44DKOIITBGOCPDPM73L7CYRYQ, seg_pos={0 0}, upload=317258]: Uploading piece...
Jul  9 21:42:48.836860434 (396h32m23.607501759s) [noise=true , address=77.90.31.13:4640     , piece_id=XCMFSHLM372AAMNYL2YVGRUSGWT7RB4RE4TMZ6ONHPVNR26NKUAQ, seg_pos={0 0}, upload=317258]: Uploading piece...
Jul  9 21:42:48.837076287 (396h32m23.607717623s) [noise=true , address=45.91.95.5:4026      , piece_id=QQWGIQENU5TGALRAU4SRUFWJDQYOPW552SN46COWCRFNFBRRPBFA, seg_pos={0 0}, upload=317258]: Uploading piece...
Jul  9 21:42:48.837281300 (396h32m23.607922635s) [noise=true , address=79.127.220.101:4073  , piece_id=NNWGURWIPMP67UIQGVHZPFZJBD2QFOGBQ6KZNNTHLJXCGRIDTXZQ, seg_pos={0 0}, upload=317258]: Uploading piece...
Jul  9 21:42:48.837494658 (396h32m23.608135993s) [noise=true , address=104.36.82.18:4396    , piece_id=2DRRKEK2OLFL54G6BQIIQLEPONIHDUICJUVAEAONC2IOR22POPLA, seg_pos={0 0}, upload=317258]: Uploading piece...
Jul  9 21:42:48.837859957 (396h32m23.608501292s) [noise=true , address=45.91.95.4:4014      , piece_id=V5ZNHUMTQCZ5YXOYDAYCFKBBSAUKHJ2RJ3FSQNME6IXSGFSLIJ4Q, seg_pos={0 0}, upload=317258]: Uploading piece...
Jul  9 21:42:48.838145814 (396h32m23.608787139s) [noise=true , address=77.90.31.18:4838     , piece_id=EGYCA5GBMRI3JPX3SHKQ57GU6ZQV6S33BJNOJVUJHESMEKZU5WTQ, seg_pos={0 0}, upload=317258]: Uploading piece...
Jul  9 21:42:48.838416161 (396h32m23.609057486s) [noise=true , address=45.91.95.3:4019      , piece_id=3XZWJLZH5RXX45ULYQLXAG4SG2RNMOGWXLNFTOVCVKZ2QUQOC6KQ, seg_pos={0 0}, upload=317258]: Uploading piece...
Jul  9 21:42:48.838665709 (396h32m23.609307044s) [noise=true , address=77.90.31.19:4852     , piece_id=MQ7OIWIHD642LXDOEBKZF2DTZRLR5OJT4Q37DCLLDXR7XTJVKXKA, seg_pos={0 0}, upload=317258]: Uploading piece...
Jul  9 21:42:48.838944833 (396h32m23.609586168s) [noise=true , address=77.90.31.12:4621     , piece_id=CL234SZAWOTG4ONGWQ2ZBXEGWUYTQQVR76BVCHAPXETRGF5TQJBQ, seg_pos={0 0}, upload=317258]: Uploading piece...
Jul  9 21:42:50.183574564 (396h32m24.954215899s) [upload=317258]: Next returned nil segment
Jul  9 21:42:50.183596435 (396h32m24.95423777s) [upload=317258]: Waiting for error group managing segments...
Jul  9 21:42:50.548527303 (396h32m25.319168638s) [noise=true , address=79.127.220.101:4073  , piece_id=NNWGURWIPMP67UIQGVHZPFZJBD2QFOGBQ6KZNNTHLJXCGRIDTXZQ, seg_pos={0 0}, upload=317258]: Done uploading piece. err: <nil>
Jul  9 21:42:50.840602026 (396h32m25.611243361s) [noise=true , address=77.90.31.18:4838     , piece_id=EGYCA5GBMRI3JPX3SHKQ57GU6ZQV6S33BJNOJVUJHESMEKZU5WTQ, seg_pos={0 0}, upload=317258]: Done uploading piece. err: <nil>
Jul  9 21:42:50.841968832 (396h32m25.612610167s) [noise=true , address=77.90.31.18:4810     , piece_id=33CXTR5YAVMPV3VGG23FMKLGAKR355O66PAHFZPKVQSFJGQIEYLQ, seg_pos={0 0}, upload=317258]: Done uploading piece. err: <nil>
Jul  9 21:42:50.842708556 (396h32m25.613349951s) [noise=true , address=77.90.31.13:4640     , piece_id=XCMFSHLM372AAMNYL2YVGRUSGWT7RB4RE4TMZ6ONHPVNR26NKUAQ, seg_pos={0 0}, upload=317258]: Done uploading piece. err: <nil>
Jul  9 21:42:50.843190929 (396h32m25.613832265s) [noise=true , address=77.90.31.14:4667     , piece_id=3XNOC4TIZJFEMIJQIMYHYNXA3SD72IYKBVBVWZ5J7NKVG5XOQYMA, seg_pos={0 0}, upload=317258]: Done uploading piece. err: <nil>
Jul  9 21:42:50.844590978 (396h32m25.615232313s) [noise=true , address=77.90.31.10:4523     , piece_id=SKESIP2VBIDJIBXIEGMC2LZESW47O7WJCLSBQBSWLHYWV4PRT7FQ, seg_pos={0 0}, upload=317258]: Done uploading piece. err: <nil>
Jul  9 21:42:50.845022593 (396h32m25.615663928s) [noise=true , address=77.90.31.19:4852     , piece_id=MQ7OIWIHD642LXDOEBKZF2DTZRLR5OJT4Q37DCLLDXR7XTJVKXKA, seg_pos={0 0}, upload=317258]: Done uploading piece. err: <nil>
Jul  9 21:42:50.846516732 (396h32m25.617158067s) [noise=true , address=77.90.31.12:4621     , piece_id=CL234SZAWOTG4ONGWQ2ZBXEGWUYTQQVR76BVCHAPXETRGF5TQJBQ, seg_pos={0 0}, upload=317258]: Done uploading piece. err: <nil>
Jul  9 21:42:50.847220148 (396h32m25.617861473s) [noise=true , address=77.90.31.21:4908     , piece_id=HGKISLD6DZXJ6DL4UCZWUJD2V5CTDYRX2BSKDCDJYXCQQBX6Q3RA, seg_pos={0 0}, upload=317258]: Done uploading piece. err: <nil>
Jul  9 21:42:50.847310801 (396h32m25.617952126s) [noise=true , address=77.90.31.16:4768     , piece_id=LOU4TXWNZRUAIB7BVVZXKEVZSBL44DKOIITBGOCPDPM73L7CYRYQ, seg_pos={0 0}, upload=317258]: Done uploading piece. err: <nil>
Jul  9 21:42:55.315575878 (396h32m30.086217213s) [noise=true , address=79.127.201.215:4345  , piece_id=WEQTKXLED3S6W4HMRFM7YUEXBWGUUMQL65E4U4FG27AVCZFRK72A, seg_pos={0 0}, upload=317258]: Done uploading piece. err: <nil>
Jul  9 21:43:12.086886240 (396h32m46.857527576s) [noise=true , address=104.36.82.23:4474    , piece_id=JJNF2423XB5JQXQJ3VWRUYGLZ2QR5SFPN7BUJO4GRPSDST6IFBCA, seg_pos={0 0}, upload=317258]: Done uploading piece. err: <nil>
Jul  9 21:43:29.357614308 (396h33m4.128255643s) [noise=true , address=104.36.82.18:4396    , piece_id=2DRRKEK2OLFL54G6BQIIQLEPONIHDUICJUVAEAONC2IOR22POPLA, seg_pos={0 0}, upload=317258]: Done uploading piece. err: <nil>
Jul  9 21:43:38.089997559 (396h33m12.860638884s) [noise=true , address=45.91.95.4:4014      , piece_id=V5ZNHUMTQCZ5YXOYDAYCFKBBSAUKHJ2RJ3FSQNME6IXSGFSLIJ4Q, seg_pos={0 0}, upload=317258]: Done uploading piece. err: <nil>
Jul  9 21:43:38.090021875 (396h33m12.86066321s) [seg_pos={0 0}, upload=317258]: Segment reached optimal threshold of 14 pieces.
Jul  9 21:43:38.090108922 (396h33m12.860750257s) [noise=true , address=45.91.95.5:4026      , piece_id=QQWGIQENU5TGALRAU4SRUFWJDQYOPW552SN46COWCRFNFBRRPBFA, seg_pos={0 0}, upload=317258]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xxtZ3msZnUkE4kgTFKJmprcNS986Uhi1LjwVyd1DbrTfZS52H): protocol: expected piece hash; context canceled; EOF
Jul  9 21:43:38.090133739 (396h33m12.860775074s) [noise=true , address=104.36.82.38:4716    , piece_id=FK7WLNN6677LINQJ26LPGZ5X4JJ7ISGDRUHMVQTGK34OTL44EF6A, seg_pos={0 0}, upload=317258]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MAHcnhvjvD74dpLS5S3m751NzfjvJ8a9ZvHwA7mdXUEXm9DAX): protocol: expected piece hash; context canceled; EOF
Jul  9 21:43:38.090161603 (396h33m12.860802938s) [noise=true , address=45.91.95.3:4019      , piece_id=3XZWJLZH5RXX45ULYQLXAG4SG2RNMOGWXLNFTOVCVKZ2QUQOC6KQ, seg_pos={0 0}, upload=317258]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SGjoGjbfugbxFgDctHygi7qo8upC463TRw8sEceUNnti1iGV1): protocol: expected piece hash; context canceled; EOF
Jul  9 21:43:38.090225525 (396h33m12.86086685s) [noise=true , address=45.91.95.2:4022      , piece_id=UJ6PKLMNBID76O3ZR4SXRNLL3CCLNGTYBZSN57E2YBD57TDLKTPQ, seg_pos={0 0}, upload=317258]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XGBvsxi6S7dz9d93CWmnQhomJVg1x5evu7DxsGsujkejBkZVN): protocol: write tcp 188.166.225.170:50926->45.91.95.2:4022: use of closed network connection; write tcp 188.166.225.170:50926->45.91.95.2:4022: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50926->45.91.95.2:4022: use of closed network connection
Jul  9 21:43:38.090246715 (396h33m12.860888051s) [seg_pos={0 0}, upload=317258]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul  9 21:43:38.090334674 (396h33m12.860976009s) [upload=317258]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  9 21:43:38.090338631 (396h33m12.860979956s) [upload=317258]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  9 21:43:38.379746682 (396h33m13.150388017s) [upload=317258]: Done uploading segments...
Jul  9 21:43:38.379765919 (396h33m13.150407254s) [upload=317258]: Upload finished. err: <nil>
Duration: 48.262116471s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip: 
8 out of 60 is failed (threshold=3) [...X................X....X...............X..X.X...X...X.....]
duration: 
42.4569309s
FAIL (2025-07-09 21:47:54 UTC) 
orbiter warning: 
======ERROR======
uplink: context deadline exceeded
======LOGS======
17258]: Got next segment. Inline: false
Jul  9 21:42:48.387406701 (396h32m23.158048036s) [upload=317258]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  9 21:42:48.387413103 (396h32m23.158054439s) [upload=317258]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  9 21:42:48.834299395 (396h32m23.60494072s) [seg_pos={0 0}, upload=317258]: Begin upload segment...
Jul  9 21:42:48.834354481 (396h32m23.604995816s) [seg_pos={0 0}, upload=317258]: Done begin upload segment.
Jul  9 21:42:48.834374599 (396h32m23.605015924s) [noise=true , address=77.90.31.10:4523     , piece_id=SKESIP2VBIDJIBXIEGMC2LZESW47O7WJCLSBQBSWLHYWV4PRT7FQ, seg_pos={0 0}, upload=317258]: Uploading piece...
Jul  9 21:42:48.834761038 (396h32m23.605402363s) [noise=true , address=77.90.31.21:4908     , piece_id=HGKISLD6DZXJ6DL4UCZWUJD2V5CTDYRX2BSKDCDJYXCQQBX6Q3RA, seg_pos={0 0}, upload=317258]: Uploading piece...
Jul  9 21:42:48.835061884 (396h32m23.605703219s) [noise=true , address=79.127.201.215:4345  , piece_id=WEQTKXLED3S6W4HMRFM7YUEXBWGUUMQL65E4U4FG27AVCZFRK72A, seg_pos={0 0}, upload=317258]: Uploading piece...
Jul  9 21:42:48.835344354 (396h32m23.605985689s) [noise=true , address=104.36.82.23:4474    , piece_id=JJNF2423XB5JQXQJ3VWRUYGLZ2QR5SFPN7BUJO4GRPSDST6IFBCA, seg_pos={0 0}, upload=317258]: Uploading piece...
Jul  9 21:42:48.835641913 (396h32m23.606283248s) [noise=true , address=45.91.95.2:4022      , piece_id=UJ6PKLMNBID76O3ZR4SXRNLL3CCLNGTYBZSN57E2YBD57TDLKTPQ, seg_pos={0 0}, upload=317258]: Uploading piece...
Jul  9 21:42:48.835925006 (396h32m23.606566341s) [noise=true , address=77.90.31.14:4667     , piece_id=3XNOC4TIZJFEMIJQIMYHYNXA3SD72IYKBVBVWZ5J7NKVG5XOQYMA, seg_pos={0 0}, upload=317258]: Uploading piece...
Jul  9 21:42:48.836153993 (396h32m23.606795328s) [noise=true , address=104.36.82.38:4716    , piece_id=FK7WLNN6677LINQJ26LPGZ5X4JJ7ISGDRUHMVQTGK34OTL44EF6A, seg_pos={0 0}, upload=317258]: Uploading piece...
Jul  9 21:42:48.836372001 (396h32m23.607013336s) [noise=true , address=77.90.31.18:4810     , piece_id=33CXTR5YAVMPV3VGG23FMKLGAKR355O66PAHFZPKVQSFJGQIEYLQ, seg_pos={0 0}, upload=317258]: Uploading piece...
Jul  9 21:42:48.836627199 (396h32m23.607268524s) [noise=true , address=77.90.31.16:4768     , piece_id=LOU4TXWNZRUAIB7BVVZXKEVZSBL44DKOIITBGOCPDPM73L7CYRYQ, seg_pos={0 0}, upload=317258]: Uploading piece...
Jul  9 21:42:48.836860434 (396h32m23.607501759s) [noise=true , address=77.90.31.13:4640     , piece_id=XCMFSHLM372AAMNYL2YVGRUSGWT7RB4RE4TMZ6ONHPVNR26NKUAQ, seg_pos={0 0}, upload=317258]: Uploading piece...
Jul  9 21:42:48.837076287 (396h32m23.607717623s) [noise=true , address=45.91.95.5:4026      , piece_id=QQWGIQENU5TGALRAU4SRUFWJDQYOPW552SN46COWCRFNFBRRPBFA, seg_pos={0 0}, upload=317258]: Uploading piece...
Jul  9 21:42:48.837281300 (396h32m23.607922635s) [noise=true , address=79.127.220.101:4073  , piece_id=NNWGURWIPMP67UIQGVHZPFZJBD2QFOGBQ6KZNNTHLJXCGRIDTXZQ, seg_pos={0 0}, upload=317258]: Uploading piece...
Jul  9 21:42:48.837494658 (396h32m23.608135993s) [noise=true , address=104.36.82.18:4396    , piece_id=2DRRKEK2OLFL54G6BQIIQLEPONIHDUICJUVAEAONC2IOR22POPLA, seg_pos={0 0}, upload=317258]: Uploading piece...
Jul  9 21:42:48.837859957 (396h32m23.608501292s) [noise=true , address=45.91.95.4:4014      , piece_id=V5ZNHUMTQCZ5YXOYDAYCFKBBSAUKHJ2RJ3FSQNME6IXSGFSLIJ4Q, seg_pos={0 0}, upload=317258]: Uploading piece...
Jul  9 21:42:48.838145814 (396h32m23.608787139s) [noise=true , address=77.90.31.18:4838     , piece_id=EGYCA5GBMRI3JPX3SHKQ57GU6ZQV6S33BJNOJVUJHESMEKZU5WTQ, seg_pos={0 0}, upload=317258]: Uploading piece...
Jul  9 21:42:48.838416161 (396h32m23.609057486s) [noise=true , address=45.91.95.3:4019      , piece_id=3XZWJLZH5RXX45ULYQLXAG4SG2RNMOGWXLNFTOVCVKZ2QUQOC6KQ, seg_pos={0 0}, upload=317258]: Uploading piece...
Jul  9 21:42:48.838665709 (396h32m23.609307044s) [noise=true , address=77.90.31.19:4852     , piece_id=MQ7OIWIHD642LXDOEBKZF2DTZRLR5OJT4Q37DCLLDXR7XTJVKXKA, seg_pos={0 0}, upload=317258]: Uploading piece...
Jul  9 21:42:48.838944833 (396h32m23.609586168s) [noise=true , address=77.90.31.12:4621     , piece_id=CL234SZAWOTG4ONGWQ2ZBXEGWUYTQQVR76BVCHAPXETRGF5TQJBQ, seg_pos={0 0}, upload=317258]: Uploading piece...
Jul  9 21:42:50.183574564 (396h32m24.954215899s) [upload=317258]: Next returned nil segment
Jul  9 21:42:50.183596435 (396h32m24.95423777s) [upload=317258]: Waiting for error group managing segments...
Jul  9 21:42:50.548527303 (396h32m25.319168638s) [noise=true , address=79.127.220.101:4073  , piece_id=NNWGURWIPMP67UIQGVHZPFZJBD2QFOGBQ6KZNNTHLJXCGRIDTXZQ, seg_pos={0 0}, upload=317258]: Done uploading piece. err: <nil>
Jul  9 21:42:50.840602026 (396h32m25.611243361s) [noise=true , address=77.90.31.18:4838     , piece_id=EGYCA5GBMRI3JPX3SHKQ57GU6ZQV6S33BJNOJVUJHESMEKZU5WTQ, seg_pos={0 0}, upload=317258]: Done uploading piece. err: <nil>
Jul  9 21:42:50.841968832 (396h32m25.612610167s) [noise=true , address=77.90.31.18:4810     , piece_id=33CXTR5YAVMPV3VGG23FMKLGAKR355O66PAHFZPKVQSFJGQIEYLQ, seg_pos={0 0}, upload=317258]: Done uploading piece. err: <nil>
Jul  9 21:42:50.842708556 (396h32m25.613349951s) [noise=true , address=77.90.31.13:4640     , piece_id=XCMFSHLM372AAMNYL2YVGRUSGWT7RB4RE4TMZ6ONHPVNR26NKUAQ, seg_pos={0 0}, upload=317258]: Done uploading piece. err: <nil>
Jul  9 21:42:50.843190929 (396h32m25.613832265s) [noise=true , address=77.90.31.14:4667     , piece_id=3XNOC4TIZJFEMIJQIMYHYNXA3SD72IYKBVBVWZ5J7NKVG5XOQYMA, seg_pos={0 0}, upload=317258]: Done uploading piece. err: <nil>
Jul  9 21:42:50.844590978 (396h32m25.615232313s) [noise=true , address=77.90.31.10:4523     , piece_id=SKESIP2VBIDJIBXIEGMC2LZESW47O7WJCLSBQBSWLHYWV4PRT7FQ, seg_pos={0 0}, upload=317258]: Done uploading piece. err: <nil>
Jul  9 21:42:50.845022593 (396h32m25.615663928s) [noise=true , address=77.90.31.19:4852     , piece_id=MQ7OIWIHD642LXDOEBKZF2DTZRLR5OJT4Q37DCLLDXR7XTJVKXKA, seg_pos={0 0}, upload=317258]: Done uploading piece. err: <nil>
Jul  9 21:42:50.846516732 (396h32m25.617158067s) [noise=true , address=77.90.31.12:4621     , piece_id=CL234SZAWOTG4ONGWQ2ZBXEGWUYTQQVR76BVCHAPXETRGF5TQJBQ, seg_pos={0 0}, upload=317258]: Done uploading piece. err: <nil>
Jul  9 21:42:50.847220148 (396h32m25.617861473s) [noise=true , address=77.90.31.21:4908     , piece_id=HGKISLD6DZXJ6DL4UCZWUJD2V5CTDYRX2BSKDCDJYXCQQBX6Q3RA, seg_pos={0 0}, upload=317258]: Done uploading piece. err: <nil>
Jul  9 21:42:50.847310801 (396h32m25.617952126s) [noise=true , address=77.90.31.16:4768     , piece_id=LOU4TXWNZRUAIB7BVVZXKEVZSBL44DKOIITBGOCPDPM73L7CYRYQ, seg_pos={0 0}, upload=317258]: Done uploading piece. err: <nil>
Jul  9 21:42:55.315575878 (396h32m30.086217213s) [noise=true , address=79.127.201.215:4345  , piece_id=WEQTKXLED3S6W4HMRFM7YUEXBWGUUMQL65E4U4FG27AVCZFRK72A, seg_pos={0 0}, upload=317258]: Done uploading piece. err: <nil>
Jul  9 21:43:12.086886240 (396h32m46.857527576s) [noise=true , address=104.36.82.23:4474    , piece_id=JJNF2423XB5JQXQJ3VWRUYGLZ2QR5SFPN7BUJO4GRPSDST6IFBCA, seg_pos={0 0}, upload=317258]: Done uploading piece. err: <nil>
Jul  9 21:43:29.357614308 (396h33m4.128255643s) [noise=true , address=104.36.82.18:4396    , piece_id=2DRRKEK2OLFL54G6BQIIQLEPONIHDUICJUVAEAONC2IOR22POPLA, seg_pos={0 0}, upload=317258]: Done uploading piece. err: <nil>
Jul  9 21:43:38.089997559 (396h33m12.860638884s) [noise=true , address=45.91.95.4:4014      , piece_id=V5ZNHUMTQCZ5YXOYDAYCFKBBSAUKHJ2RJ3FSQNME6IXSGFSLIJ4Q, seg_pos={0 0}, upload=317258]: Done uploading piece. err: <nil>
Jul  9 21:43:38.090021875 (396h33m12.86066321s) [seg_pos={0 0}, upload=317258]: Segment reached optimal threshold of 14 pieces.
Jul  9 21:43:38.090108922 (396h33m12.860750257s) [noise=true , address=45.91.95.5:4026      , piece_id=QQWGIQENU5TGALRAU4SRUFWJDQYOPW552SN46COWCRFNFBRRPBFA, seg_pos={0 0}, upload=317258]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xxtZ3msZnUkE4kgTFKJmprcNS986Uhi1LjwVyd1DbrTfZS52H): protocol: expected piece hash; context canceled; EOF
Jul  9 21:43:38.090133739 (396h33m12.860775074s) [noise=true , address=104.36.82.38:4716    , piece_id=FK7WLNN6677LINQJ26LPGZ5X4JJ7ISGDRUHMVQTGK34OTL44EF6A, seg_pos={0 0}, upload=317258]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MAHcnhvjvD74dpLS5S3m751NzfjvJ8a9ZvHwA7mdXUEXm9DAX): protocol: expected piece hash; context canceled; EOF
Jul  9 21:43:38.090161603 (396h33m12.860802938s) [noise=true , address=45.91.95.3:4019      , piece_id=3XZWJLZH5RXX45ULYQLXAG4SG2RNMOGWXLNFTOVCVKZ2QUQOC6KQ, seg_pos={0 0}, upload=317258]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SGjoGjbfugbxFgDctHygi7qo8upC463TRw8sEceUNnti1iGV1): protocol: expected piece hash; context canceled; EOF
Jul  9 21:43:38.090225525 (396h33m12.86086685s) [noise=true , address=45.91.95.2:4022      , piece_id=UJ6PKLMNBID76O3ZR4SXRNLL3CCLNGTYBZSN57E2YBD57TDLKTPQ, seg_pos={0 0}, upload=317258]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XGBvsxi6S7dz9d93CWmnQhomJVg1x5evu7DxsGsujkejBkZVN): protocol: write tcp 188.166.225.170:50926->45.91.95.2:4022: use of closed network connection; write tcp 188.166.225.170:50926->45.91.95.2:4022: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50926->45.91.95.2:4022: use of closed network connection
Jul  9 21:43:38.090246715 (396h33m12.860888051s) [seg_pos={0 0}, upload=317258]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul  9 21:43:38.090334674 (396h33m12.860976009s) [upload=317258]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  9 21:43:38.090338631 (396h33m12.860979956s) [upload=317258]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  9 21:43:38.379746682 (396h33m13.150388017s) [upload=317258]: Done uploading segments...
Jul  9 21:43:38.379765919 (396h33m13.150407254s) [upload=317258]: Upload finished. err: <nil>
Duration: 42.456984302s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
8 out of 60 is failed (threshold=3) [..X......X....X..X.........X...............X..X....X........]
duration: 
53.38074498s
FAIL (2025-07-09 21:47:48 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 53.380768275s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip: 
9 out of 60 is failed (threshold=3) [X...X................X....X...............X..X.X...X...X....]
duration: 
51.119191328s
FAIL (2025-07-09 21:47:09 UTC) 
orbiter warning: 
======ERROR======
uplink: context deadline exceeded
======LOGS======
17258]: Got next segment. Inline: false
Jul  9 21:42:48.387406701 (396h32m23.158048036s) [upload=317258]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  9 21:42:48.387413103 (396h32m23.158054439s) [upload=317258]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  9 21:42:48.834299395 (396h32m23.60494072s) [seg_pos={0 0}, upload=317258]: Begin upload segment...
Jul  9 21:42:48.834354481 (396h32m23.604995816s) [seg_pos={0 0}, upload=317258]: Done begin upload segment.
Jul  9 21:42:48.834374599 (396h32m23.605015924s) [noise=true , address=77.90.31.10:4523     , piece_id=SKESIP2VBIDJIBXIEGMC2LZESW47O7WJCLSBQBSWLHYWV4PRT7FQ, seg_pos={0 0}, upload=317258]: Uploading piece...
Jul  9 21:42:48.834761038 (396h32m23.605402363s) [noise=true , address=77.90.31.21:4908     , piece_id=HGKISLD6DZXJ6DL4UCZWUJD2V5CTDYRX2BSKDCDJYXCQQBX6Q3RA, seg_pos={0 0}, upload=317258]: Uploading piece...
Jul  9 21:42:48.835061884 (396h32m23.605703219s) [noise=true , address=79.127.201.215:4345  , piece_id=WEQTKXLED3S6W4HMRFM7YUEXBWGUUMQL65E4U4FG27AVCZFRK72A, seg_pos={0 0}, upload=317258]: Uploading piece...
Jul  9 21:42:48.835344354 (396h32m23.605985689s) [noise=true , address=104.36.82.23:4474    , piece_id=JJNF2423XB5JQXQJ3VWRUYGLZ2QR5SFPN7BUJO4GRPSDST6IFBCA, seg_pos={0 0}, upload=317258]: Uploading piece...
Jul  9 21:42:48.835641913 (396h32m23.606283248s) [noise=true , address=45.91.95.2:4022      , piece_id=UJ6PKLMNBID76O3ZR4SXRNLL3CCLNGTYBZSN57E2YBD57TDLKTPQ, seg_pos={0 0}, upload=317258]: Uploading piece...
Jul  9 21:42:48.835925006 (396h32m23.606566341s) [noise=true , address=77.90.31.14:4667     , piece_id=3XNOC4TIZJFEMIJQIMYHYNXA3SD72IYKBVBVWZ5J7NKVG5XOQYMA, seg_pos={0 0}, upload=317258]: Uploading piece...
Jul  9 21:42:48.836153993 (396h32m23.606795328s) [noise=true , address=104.36.82.38:4716    , piece_id=FK7WLNN6677LINQJ26LPGZ5X4JJ7ISGDRUHMVQTGK34OTL44EF6A, seg_pos={0 0}, upload=317258]: Uploading piece...
Jul  9 21:42:48.836372001 (396h32m23.607013336s) [noise=true , address=77.90.31.18:4810     , piece_id=33CXTR5YAVMPV3VGG23FMKLGAKR355O66PAHFZPKVQSFJGQIEYLQ, seg_pos={0 0}, upload=317258]: Uploading piece...
Jul  9 21:42:48.836627199 (396h32m23.607268524s) [noise=true , address=77.90.31.16:4768     , piece_id=LOU4TXWNZRUAIB7BVVZXKEVZSBL44DKOIITBGOCPDPM73L7CYRYQ, seg_pos={0 0}, upload=317258]: Uploading piece...
Jul  9 21:42:48.836860434 (396h32m23.607501759s) [noise=true , address=77.90.31.13:4640     , piece_id=XCMFSHLM372AAMNYL2YVGRUSGWT7RB4RE4TMZ6ONHPVNR26NKUAQ, seg_pos={0 0}, upload=317258]: Uploading piece...
Jul  9 21:42:48.837076287 (396h32m23.607717623s) [noise=true , address=45.91.95.5:4026      , piece_id=QQWGIQENU5TGALRAU4SRUFWJDQYOPW552SN46COWCRFNFBRRPBFA, seg_pos={0 0}, upload=317258]: Uploading piece...
Jul  9 21:42:48.837281300 (396h32m23.607922635s) [noise=true , address=79.127.220.101:4073  , piece_id=NNWGURWIPMP67UIQGVHZPFZJBD2QFOGBQ6KZNNTHLJXCGRIDTXZQ, seg_pos={0 0}, upload=317258]: Uploading piece...
Jul  9 21:42:48.837494658 (396h32m23.608135993s) [noise=true , address=104.36.82.18:4396    , piece_id=2DRRKEK2OLFL54G6BQIIQLEPONIHDUICJUVAEAONC2IOR22POPLA, seg_pos={0 0}, upload=317258]: Uploading piece...
Jul  9 21:42:48.837859957 (396h32m23.608501292s) [noise=true , address=45.91.95.4:4014      , piece_id=V5ZNHUMTQCZ5YXOYDAYCFKBBSAUKHJ2RJ3FSQNME6IXSGFSLIJ4Q, seg_pos={0 0}, upload=317258]: Uploading piece...
Jul  9 21:42:48.838145814 (396h32m23.608787139s) [noise=true , address=77.90.31.18:4838     , piece_id=EGYCA5GBMRI3JPX3SHKQ57GU6ZQV6S33BJNOJVUJHESMEKZU5WTQ, seg_pos={0 0}, upload=317258]: Uploading piece...
Jul  9 21:42:48.838416161 (396h32m23.609057486s) [noise=true , address=45.91.95.3:4019      , piece_id=3XZWJLZH5RXX45ULYQLXAG4SG2RNMOGWXLNFTOVCVKZ2QUQOC6KQ, seg_pos={0 0}, upload=317258]: Uploading piece...
Jul  9 21:42:48.838665709 (396h32m23.609307044s) [noise=true , address=77.90.31.19:4852     , piece_id=MQ7OIWIHD642LXDOEBKZF2DTZRLR5OJT4Q37DCLLDXR7XTJVKXKA, seg_pos={0 0}, upload=317258]: Uploading piece...
Jul  9 21:42:48.838944833 (396h32m23.609586168s) [noise=true , address=77.90.31.12:4621     , piece_id=CL234SZAWOTG4ONGWQ2ZBXEGWUYTQQVR76BVCHAPXETRGF5TQJBQ, seg_pos={0 0}, upload=317258]: Uploading piece...
Jul  9 21:42:50.183574564 (396h32m24.954215899s) [upload=317258]: Next returned nil segment
Jul  9 21:42:50.183596435 (396h32m24.95423777s) [upload=317258]: Waiting for error group managing segments...
Jul  9 21:42:50.548527303 (396h32m25.319168638s) [noise=true , address=79.127.220.101:4073  , piece_id=NNWGURWIPMP67UIQGVHZPFZJBD2QFOGBQ6KZNNTHLJXCGRIDTXZQ, seg_pos={0 0}, upload=317258]: Done uploading piece. err: <nil>
Jul  9 21:42:50.840602026 (396h32m25.611243361s) [noise=true , address=77.90.31.18:4838     , piece_id=EGYCA5GBMRI3JPX3SHKQ57GU6ZQV6S33BJNOJVUJHESMEKZU5WTQ, seg_pos={0 0}, upload=317258]: Done uploading piece. err: <nil>
Jul  9 21:42:50.841968832 (396h32m25.612610167s) [noise=true , address=77.90.31.18:4810     , piece_id=33CXTR5YAVMPV3VGG23FMKLGAKR355O66PAHFZPKVQSFJGQIEYLQ, seg_pos={0 0}, upload=317258]: Done uploading piece. err: <nil>
Jul  9 21:42:50.842708556 (396h32m25.613349951s) [noise=true , address=77.90.31.13:4640     , piece_id=XCMFSHLM372AAMNYL2YVGRUSGWT7RB4RE4TMZ6ONHPVNR26NKUAQ, seg_pos={0 0}, upload=317258]: Done uploading piece. err: <nil>
Jul  9 21:42:50.843190929 (396h32m25.613832265s) [noise=true , address=77.90.31.14:4667     , piece_id=3XNOC4TIZJFEMIJQIMYHYNXA3SD72IYKBVBVWZ5J7NKVG5XOQYMA, seg_pos={0 0}, upload=317258]: Done uploading piece. err: <nil>
Jul  9 21:42:50.844590978 (396h32m25.615232313s) [noise=true , address=77.90.31.10:4523     , piece_id=SKESIP2VBIDJIBXIEGMC2LZESW47O7WJCLSBQBSWLHYWV4PRT7FQ, seg_pos={0 0}, upload=317258]: Done uploading piece. err: <nil>
Jul  9 21:42:50.845022593 (396h32m25.615663928s) [noise=true , address=77.90.31.19:4852     , piece_id=MQ7OIWIHD642LXDOEBKZF2DTZRLR5OJT4Q37DCLLDXR7XTJVKXKA, seg_pos={0 0}, upload=317258]: Done uploading piece. err: <nil>
Jul  9 21:42:50.846516732 (396h32m25.617158067s) [noise=true , address=77.90.31.12:4621     , piece_id=CL234SZAWOTG4ONGWQ2ZBXEGWUYTQQVR76BVCHAPXETRGF5TQJBQ, seg_pos={0 0}, upload=317258]: Done uploading piece. err: <nil>
Jul  9 21:42:50.847220148 (396h32m25.617861473s) [noise=true , address=77.90.31.21:4908     , piece_id=HGKISLD6DZXJ6DL4UCZWUJD2V5CTDYRX2BSKDCDJYXCQQBX6Q3RA, seg_pos={0 0}, upload=317258]: Done uploading piece. err: <nil>
Jul  9 21:42:50.847310801 (396h32m25.617952126s) [noise=true , address=77.90.31.16:4768     , piece_id=LOU4TXWNZRUAIB7BVVZXKEVZSBL44DKOIITBGOCPDPM73L7CYRYQ, seg_pos={0 0}, upload=317258]: Done uploading piece. err: <nil>
Jul  9 21:42:55.315575878 (396h32m30.086217213s) [noise=true , address=79.127.201.215:4345  , piece_id=WEQTKXLED3S6W4HMRFM7YUEXBWGUUMQL65E4U4FG27AVCZFRK72A, seg_pos={0 0}, upload=317258]: Done uploading piece. err: <nil>
Jul  9 21:43:12.086886240 (396h32m46.857527576s) [noise=true , address=104.36.82.23:4474    , piece_id=JJNF2423XB5JQXQJ3VWRUYGLZ2QR5SFPN7BUJO4GRPSDST6IFBCA, seg_pos={0 0}, upload=317258]: Done uploading piece. err: <nil>
Jul  9 21:43:29.357614308 (396h33m4.128255643s) [noise=true , address=104.36.82.18:4396    , piece_id=2DRRKEK2OLFL54G6BQIIQLEPONIHDUICJUVAEAONC2IOR22POPLA, seg_pos={0 0}, upload=317258]: Done uploading piece. err: <nil>
Jul  9 21:43:38.089997559 (396h33m12.860638884s) [noise=true , address=45.91.95.4:4014      , piece_id=V5ZNHUMTQCZ5YXOYDAYCFKBBSAUKHJ2RJ3FSQNME6IXSGFSLIJ4Q, seg_pos={0 0}, upload=317258]: Done uploading piece. err: <nil>
Jul  9 21:43:38.090021875 (396h33m12.86066321s) [seg_pos={0 0}, upload=317258]: Segment reached optimal threshold of 14 pieces.
Jul  9 21:43:38.090108922 (396h33m12.860750257s) [noise=true , address=45.91.95.5:4026      , piece_id=QQWGIQENU5TGALRAU4SRUFWJDQYOPW552SN46COWCRFNFBRRPBFA, seg_pos={0 0}, upload=317258]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xxtZ3msZnUkE4kgTFKJmprcNS986Uhi1LjwVyd1DbrTfZS52H): protocol: expected piece hash; context canceled; EOF
Jul  9 21:43:38.090133739 (396h33m12.860775074s) [noise=true , address=104.36.82.38:4716    , piece_id=FK7WLNN6677LINQJ26LPGZ5X4JJ7ISGDRUHMVQTGK34OTL44EF6A, seg_pos={0 0}, upload=317258]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MAHcnhvjvD74dpLS5S3m751NzfjvJ8a9ZvHwA7mdXUEXm9DAX): protocol: expected piece hash; context canceled; EOF
Jul  9 21:43:38.090161603 (396h33m12.860802938s) [noise=true , address=45.91.95.3:4019      , piece_id=3XZWJLZH5RXX45ULYQLXAG4SG2RNMOGWXLNFTOVCVKZ2QUQOC6KQ, seg_pos={0 0}, upload=317258]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SGjoGjbfugbxFgDctHygi7qo8upC463TRw8sEceUNnti1iGV1): protocol: expected piece hash; context canceled; EOF
Jul  9 21:43:38.090225525 (396h33m12.86086685s) [noise=true , address=45.91.95.2:4022      , piece_id=UJ6PKLMNBID76O3ZR4SXRNLL3CCLNGTYBZSN57E2YBD57TDLKTPQ, seg_pos={0 0}, upload=317258]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XGBvsxi6S7dz9d93CWmnQhomJVg1x5evu7DxsGsujkejBkZVN): protocol: write tcp 188.166.225.170:50926->45.91.95.2:4022: use of closed network connection; write tcp 188.166.225.170:50926->45.91.95.2:4022: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50926->45.91.95.2:4022: use of closed network connection
Jul  9 21:43:38.090246715 (396h33m12.860888051s) [seg_pos={0 0}, upload=317258]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul  9 21:43:38.090334674 (396h33m12.860976009s) [upload=317258]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  9 21:43:38.090338631 (396h33m12.860979956s) [upload=317258]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  9 21:43:38.379746682 (396h33m13.150388017s) [upload=317258]: Done uploading segments...
Jul  9 21:43:38.379765919 (396h33m13.150407254s) [upload=317258]: Upload finished. err: <nil>
Duration: 51.119214581s core uplink us-select-1 us1-placement-20